Skip to content

Conversation

@github-actions
Copy link
Contributor

This PR updates the Gradle dependencies. ⚠️ Don't forget to squash commits before merging. ⚠️

  • Update PR title if a code change is needed to support one of those new dependencies

@github-actions github-actions bot added tag: no release notes Changes to exclude from release notes tag: dependencies Dependencies related changes labels May 18, 2025
@github-actions github-actions bot requested review from a team as code owners May 18, 2025 04:28
@github-actions github-actions bot requested review from anmarchenko, ojung, sezen-datadog and smola and removed request for a team May 18, 2025 04:28
@pr-commenter
Copy link

pr-commenter bot commented May 18, 2025

Debugger benchmarks

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
ci_job_date 1747745852 1747746235
end_time 2025-05-20T12:58:51 2025-05-20T13:05:12
git_branch master ci/update-gradle-dependencies-20250518
git_commit_sha 0ebd52b 34765a8
start_time 2025-05-20T12:57:33 2025-05-20T13:03:56
See matching parameters
Baseline Candidate
ci_job_id 945775896 945775896
ci_pipeline_id 65601853 65601853
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1747745181 1747745181

Summary

Found 5 performance improvements and 0 performance regressions! Performance is the same for 5 metrics, 5 unstable metrics.

scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:loop better
[-672.622µs; -666.254µs] or [-6.318%; -6.259%]
better
[-730.158µs; -667.342µs] or [-6.745%; -6.165%]
better
[-721.304µs; -606.788µs] or [-6.615%; -5.565%]
better
[-939.867µs; -602.699µs] or [-8.341%; -5.349%]
better
[+5.383op/s; +7.091op/s] or [+5.894%; +7.765%]
See unchanged results
scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:noprobe unstable
[-35.165µs; +9.627µs] or [-12.513%; +3.426%]
unstable
[-48.090µs; +19.266µs] or [-14.943%; +5.986%]
unstable
[-59.845µs; +28.586µs] or [-17.783%; +8.494%]
unstable
[-138.913µs; +82.532µs] or [-22.637%; +13.449%]
same
scenario:basic same same same unstable
[-31.608µs; +34.341µs] or [-6.002%; +6.521%]
same
Request duration reports for reports
gantt
    title reports - request duration [CI 0.99] : candidate=None, baseline=None
    dateFormat X
    axisFormat %s
section baseline
noprobe (321.834 µs) : 281, 362
.   : milestone, 322,
basic (304.674 µs) : 297, 313
.   : milestone, 305,
loop (10.825 ms) : 10791, 10859
.   : milestone, 10825,
section candidate
noprobe (307.422 µs) : 287, 328
.   : milestone, 307,
basic (308.37 µs) : 300, 317
.   : milestone, 308,
loop (10.126 ms) : 10103, 10150
.   : milestone, 10126,
Loading
  • baseline results
Scenario Request median duration [CI 0.99]
noprobe 321.834 µs [281.477 µs, 362.19 µs]
basic 304.674 µs [296.832 µs, 312.516 µs]
loop 10.825 ms [10.791 ms, 10.859 ms]
  • candidate results
Scenario Request median duration [CI 0.99]
noprobe 307.422 µs [286.678 µs, 328.165 µs]
basic 308.37 µs [300.055 µs, 316.684 µs]
loop 10.126 ms [10.103 ms, 10.15 ms]

@pr-commenter
Copy link

pr-commenter bot commented May 18, 2025

Benchmarks

Startup

Load

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20250518
git_commit_date 1747743756 1747745181
git_commit_sha 0ebd52b 34765a8
release_version 1.50.0-SNAPSHOT~0ebd52ba72 1.50.0-SNAPSHOT~34765a8136
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1747747192 1747747192
ci_job_id 945775892 945775892
ci_pipeline_id 65601853 65601853
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-vppyl2yp-project-304-concurrent-0-jppn6hn6 6.8.0-1028-aws #30~22.04.1-Ubuntu SMP Sun Apr 20 06:03:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-vppyl2yp-project-304-concurrent-0-jppn6hn6 6.8.0-1028-aws #30~22.04.1-Ubuntu SMP Sun Apr 20 06:03:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~34765a8136, baseline=1.50.0-SNAPSHOT~0ebd52ba72
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.727 s) : 14727000, 14727000
.   : milestone, 14727000,
appsec (14.858 s) : 14858000, 14858000
.   : milestone, 14858000,
iast (18.893 s) : 18893000, 18893000
.   : milestone, 18893000,
iast_GLOBAL (18.047 s) : 18047000, 18047000
.   : milestone, 18047000,
profiling (14.823 s) : 14823000, 14823000
.   : milestone, 14823000,
tracing (15.025 s) : 15025000, 15025000
.   : milestone, 15025000,
section candidate
no_agent (15.453 s) : 15453000, 15453000
.   : milestone, 15453000,
appsec (15.15 s) : 15150000, 15150000
.   : milestone, 15150000,
iast (19.288 s) : 19288000, 19288000
.   : milestone, 19288000,
iast_GLOBAL (18.278 s) : 18278000, 18278000
.   : milestone, 18278000,
profiling (15.451 s) : 15451000, 15451000
.   : milestone, 15451000,
tracing (14.763 s) : 14763000, 14763000
.   : milestone, 14763000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.727 s [14.727 s, 14.727 s] -
appsec 14.858 s [14.858 s, 14.858 s] 131.0 ms (0.9%)
iast 18.893 s [18.893 s, 18.893 s] 4.166 s (28.3%)
iast_GLOBAL 18.047 s [18.047 s, 18.047 s] 3.32 s (22.5%)
profiling 14.823 s [14.823 s, 14.823 s] 96.0 ms (0.7%)
tracing 15.025 s [15.025 s, 15.025 s] 298.0 ms (2.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.453 s [15.453 s, 15.453 s] -
appsec 15.15 s [15.15 s, 15.15 s] -303.0 ms (-2.0%)
iast 19.288 s [19.288 s, 19.288 s] 3.835 s (24.8%)
iast_GLOBAL 18.278 s [18.278 s, 18.278 s] 2.825 s (18.3%)
profiling 15.451 s [15.451 s, 15.451 s] -2.0 ms (-0.0%)
tracing 14.763 s [14.763 s, 14.763 s] -690.0 ms (-4.5%)
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~34765a8136, baseline=1.50.0-SNAPSHOT~0ebd52ba72
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.482 ms) : 1470, 1493
.   : milestone, 1482,
appsec (2.421 ms) : 2371, 2470
.   : milestone, 2421,
iast (2.2 ms) : 2137, 2262
.   : milestone, 2200,
iast_GLOBAL (2.254 ms) : 2191, 2316
.   : milestone, 2254,
profiling (2.067 ms) : 2016, 2118
.   : milestone, 2067,
tracing (2.025 ms) : 1977, 2074
.   : milestone, 2025,
section candidate
no_agent (1.485 ms) : 1473, 1496
.   : milestone, 1485,
appsec (2.42 ms) : 2371, 2469
.   : milestone, 2420,
iast (2.202 ms) : 2140, 2265
.   : milestone, 2202,
iast_GLOBAL (2.244 ms) : 2181, 2306
.   : milestone, 2244,
profiling (2.052 ms) : 2002, 2103
.   : milestone, 2052,
tracing (2.025 ms) : 1977, 2073
.   : milestone, 2025,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.482 ms [1.47 ms, 1.493 ms] -
appsec 2.421 ms [2.371 ms, 2.47 ms] 938.815 µs (63.4%)
iast 2.2 ms [2.137 ms, 2.262 ms] 717.688 µs (48.4%)
iast_GLOBAL 2.254 ms [2.191 ms, 2.316 ms] 771.747 µs (52.1%)
profiling 2.067 ms [2.016 ms, 2.118 ms] 585.04 µs (39.5%)
tracing 2.025 ms [1.977 ms, 2.074 ms] 543.509 µs (36.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.485 ms [1.473 ms, 1.496 ms] -
appsec 2.42 ms [2.371 ms, 2.469 ms] 935.511 µs (63.0%)
iast 2.202 ms [2.14 ms, 2.265 ms] 717.848 µs (48.4%)
iast_GLOBAL 2.244 ms [2.181 ms, 2.306 ms] 758.926 µs (51.1%)
profiling 2.052 ms [2.002 ms, 2.103 ms] 567.722 µs (38.2%)
tracing 2.025 ms [1.977 ms, 2.073 ms] 540.689 µs (36.4%)

@pr-commenter
Copy link

pr-commenter bot commented May 18, 2025

Kafka / producer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20250518
git_commit_date 1747743756 1747745181
git_commit_sha 0ebd52b 34765a8
See matching parameters
Baseline Candidate
ci_job_date 1747746354 1747746354
ci_job_id 945775894 945775894
ci_pipeline_id 65601853 65601853
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaProduceBenchmark.benchProduce same

@pr-commenter
Copy link

pr-commenter bot commented May 18, 2025

Kafka / consumer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20250518
git_commit_date 1747743756 1747745181
git_commit_sha 0ebd52b 34765a8
See matching parameters
Baseline Candidate
ci_job_date 1747746396 1747746396
ci_job_id 945775895 945775895
ci_pipeline_id 65601853 65601853
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaConsumerBenchmark.benchConsume same

@smola smola mentioned this pull request May 19, 2025
1 task
@smola smola requested review from a team as code owners May 20, 2025 12:46
@smola smola enabled auto-merge (squash) May 20, 2025 12:49
@smola smola closed this Jun 23, 2025
auto-merge was automatically disabled June 23, 2025 06:13

Pull request was closed

@smola smola deleted the ci/update-gradle-dependencies-20250518 branch June 23, 2025 06:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

tag: dependencies Dependencies related changes tag: no release notes Changes to exclude from release notes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants