Skip to content

Modify the optimizer to support obtaining tasks from each AMS node for processing. #3950

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 20 commits into
base: master
Choose a base branch
from
Open

Modify the optimizer to support obtaining tasks from each AMS node for processing. #3950

wants to merge 20 commits into from

Conversation

@wardlican
Copy link
Contributor

@wardlican wardlican commented Nov 17, 2025 •
edited
Loading

Why are the changes needed?

In master-slave mode, the optimizer needs to support pulling optimization tasks from each ams node for processing.

Close #3928.

Brief change log

  1. In master-slave mode, the optimizer can pull tasks from each currently active AMS.
  2. In master-slave mode, the AMS automatically detects the addition and timeout of the optimizer from the database.

How was this patch tested?

  • Add some test cases that check the changes thoroughly including negative and positive cases if possible

  • Add screenshots for manual tests if appropriate

  • Run test locally before making a pull request

Documentation

  • Does this pull request introduce a new feature? (yes / no)
  • If yes, how is the feature documented? (not applicable / docs / JavaDocs / not documented)

wardli added 18 commits October 29, 2025 17:49
[Subtask]: Use a new configuration item to control whether master & s…
e527acb 
…lave mode is enabled. apache#3845
[Subtask]: Use a new configuration item to control whether master & s…
064f4ea 
…lave mode is enabled. apache#3845
[Subtask]: Add a registration function for table allocation in master…
879e398 
…-slave mode. apache#3919
[Subtask]: Add a registration function for table allocation in master…
bb1593b 
…-slave mode. apache#3919
[Subtask]: Add a registration function for table allocation in master…
2c60a4d 
…-slave mode. apache#3919
[Subtask]: Replace zk with mocking. apache#3919
a3acd97
[Subtask]: Replace zk with mocking. apache#3919
b635c0d
[Subtask]: add AmsAssignService to implement balanced bucket allocati…
3335790 
…on in master-slave mode. apache#3921
Merge branch 'amoro#3919' into amoro#3921
79a1d85
[Subtask]: add AmsAssignService to implement balanced bucket allocati…
80ba8f2 
…on in master-slave mode. apache#3921
[Subtask]: add AmsAssignService to implement balanced bucket allocati…
0c91452 
…on in master-slave mode. apache#3921
[Subtask]: add AmsAssignService to implement balanced bucket allocati…
f2ecc06 
…on in master-slave mode. apache#3921
[Subtask]: Modify DefaultTableService to be compatible with master-sl…
b1da165 
…ave mode apache#3923
[Subtask]: Modify DefaultTableService to be compatible with master-sl…
9fdda5c 
…ave mode apache#3923
[Subtask]: Modify DefaultTableService to be compatible with master-sl…
d4d9073 
…ave mode apache#3923
[Subtask]: Fix unit test failure issue apache#3923
d0cb6b2
[Subtask]: In master-slave mode, each AMS should automatically senses…
cf7b3ad 
… the optimizer. apache#3929
[Subtask]: Modify the optimizer to support obtaining tasks from each …
4ec6be4 
…AMS node for processing. apache#3928
@github-actions github-actions bot added module:ams-server Ams server module module:ams-optimizer AMS optimizer module module:common labels Nov 17, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

module:ams-optimizer AMS optimizer module module:ams-server Ams server module module:common

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

[Subtask]: Modify the optimizer to support obtaining tasks from each AMS node for processing.

1 participant

@wardlican