Backport PR #15925 to 8.12: Set Netty's maxOrder options to previous default #15928
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Updates Netty's configuration of maxOrder to a previously proven value, if not already customised by the user. Adds a step to the JvmOption parsing tool, which is used to compose the JVM options string to pass down to Logstash at startup. The added step rework the parsed options to set the allocator max order -Dio.netty.allocator.maxOrder=11 so that the maximum pooled buffer is up to 16MB and not 4MB. This option is added iff it's not yet specified by the user (cherry picked from commit 52ce3ff)
|
💚 Build Succeeded
|
This was referenced Mar 11, 2024
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Backport PR #15925 to 8.12 branch, original message:
Release notes
Updates Netty's configuration of maxOrder to a previously proven value, if not already customised by the user.
What does this PR do?
Adds a step to the JvmOption parsing tool, which is used to compose the JVM options string to pass down to Logstash at startup.
The added step rework the parsed options to set the allocator max order
-Dio.netty.allocator.maxOrder=11so that the maximum pooled buffer is up to 16MB and not 4MB.This option is added iff it's not yet specified by the user
Why is it important/What is the impact to the user?
It brings back the performance of Netty based plugins to the same as of Logstash previous of
8.7.0, which introduced an update of Netty library.With messages bigger then 2Kb each it triggered a problem of using unpooled buffers, which kills performance. With this change it moved back to 8Kb.
Checklist
[ ] I have made corresponding changes to the documentation[ ] I have made corresponding change to the default configuration files (and/or docker env variables)Author's Checklist
How to test this PR locally
The test splits in 2, verify that the line
-Dio.netty.allocator.maxOrder=11is added when the flag is not inconfig/jvm.optionsand verify that if the flag is already present it's not overwritten.Run Logstash with
bin/logstash -e "input {stdin {}} output {stdout{}}"-second test: edit
config/jvm.optionsand add a customio.netty.allocator.maxOrder, start Logstash and verify logs contains the definition was added.Related issues
Use cases
Screenshots
Logs