-
Notifications
You must be signed in to change notification settings - Fork 4.8k
HIVE-29270: Remove HMS compactor workers deprecated functionality #6132
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: master
Are you sure you want to change the base?
Conversation
@tanishq-chugh besides HMS local workers support, please drop the supplemental functionality such as revokeFromLocalWorkers: #6068 |
Addressed dropping revokeFromLocalWorkers supplementary functionality in commit - 5350c3d |
ql/src/test/org/apache/hadoop/hive/ql/txn/compactor/TestInitiator.java
Outdated
Show resolved
Hide resolved
ql/src/java/org/apache/hadoop/hive/ql/txn/compactor/Initiator.java
Outdated
Show resolved
Hide resolved
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
+1, pending tests
startedAt = System.currentTimeMillis(); | ||
prevStart = handle.getLastUpdateTime(); | ||
|
||
recoverFailedCompactions(); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
could you please add new line after and keep the comment: // Check for timed out workers.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yes, added in commit ed91be6
|
What changes were proposed in this pull request?
Removal of the deprecated functionality of HMS compactor workers
Why are the changes needed?
The particular functionality has been deprecated since a long time pending for removal.
Does this PR introduce any user-facing change?
More of a configuration removal, that user won't be able to update/use in upcoming releases.
How was this patch tested?
Manual verification & CI