Skip to content

Conversation

@github-actions
Copy link
Contributor

This PR updates the Gradle dependencies. ⚠️ Don't forget to squash commits before merging. ⚠️

  • Update PR title if a code change is needed to support one of those new dependencies

@github-actions github-actions bot added tag: no release notes Changes to exclude from release notes tag: dependencies Dependencies related changes labels May 11, 2025
@github-actions github-actions bot requested review from a team as code owners May 11, 2025 04:47
@github-actions github-actions bot requested review from jandro996, nikita-tkachenko-datadog, shatzi and smola and removed request for a team May 11, 2025 04:47
@pr-commenter
Copy link

pr-commenter bot commented May 11, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20250511
git_commit_date 1746825821 1746938784
git_commit_sha f494c33 0ee8a0f
release_version 1.50.0-SNAPSHOT~f494c33b01 1.50.0-SNAPSHOT~0ee8a0f1d1
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1746941449 1746941449
ci_job_id 932609201 932609201
ci_pipeline_id 64723776 64723776
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-ujqpvmht-project-304-concurrent-3-vyar12nr 6.8.0-1027-aws #29~22.04.1-Ubuntu SMP Sun Mar 30 07:45:38 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-ujqpvmht-project-304-concurrent-3-vyar12nr 6.8.0-1027-aws #29~22.04.1-Ubuntu SMP Sun Mar 30 07:45:38 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 58 metrics, 13 unstable metrics.

Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.50.0-SNAPSHOT~0ee8a0f1d1, baseline=1.50.0-SNAPSHOT~f494c33b01

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.027 s) : 0, 1027242
Total [baseline] (8.736 s) : 0, 8735939
Agent [candidate] (1.018 s) : 0, 1017935
Total [candidate] (8.637 s) : 0, 8636663
section iast
Agent [baseline] (1.152 s) : 0, 1152280
Total [baseline] (9.266 s) : 0, 9265547
Agent [candidate] (1.148 s) : 0, 1147508
Total [candidate] (9.29 s) : 0, 9290156
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.148 s) : 0, 1147770
Total [baseline] (9.209 s) : 0, 9209185
Agent [candidate] (1.15 s) : 0, 1150007
Total [candidate] (9.263 s) : 0, 9262710
section iast_TELEMETRY_OFF
Agent [baseline] (1.145 s) : 0, 1144962
Total [baseline] (9.308 s) : 0, 9308459
Agent [candidate] (1.141 s) : 0, 1141352
Total [candidate] (9.221 s) : 0, 9221322
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.027 s -
Agent iast 1.152 s 125.038 ms (12.2%)
Agent iast_HARDCODED_SECRET_DISABLED 1.148 s 120.528 ms (11.7%)
Agent iast_TELEMETRY_OFF 1.145 s 117.72 ms (11.5%)
Total tracing 8.736 s -
Total iast 9.266 s 529.608 ms (6.1%)
Total iast_HARDCODED_SECRET_DISABLED 9.209 s 473.246 ms (5.4%)
Total iast_TELEMETRY_OFF 9.308 s 572.52 ms (6.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.018 s -
Agent iast 1.148 s 129.574 ms (12.7%)
Agent iast_HARDCODED_SECRET_DISABLED 1.15 s 132.073 ms (13.0%)
Agent iast_TELEMETRY_OFF 1.141 s 123.418 ms (12.1%)
Total tracing 8.637 s -
Total iast 9.29 s 653.492 ms (7.6%)
Total iast_HARDCODED_SECRET_DISABLED 9.263 s 626.046 ms (7.2%)
Total iast_TELEMETRY_OFF 9.221 s 584.658 ms (6.8%)
gantt
    title insecure-bank - break down per module: candidate=1.50.0-SNAPSHOT~0ee8a0f1d1, baseline=1.50.0-SNAPSHOT~f494c33b01

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (687.905 ms) : 0, 687905
BytebuddyAgent [candidate] (679.97 ms) : 0, 679970
GlobalTracer [baseline] (242.225 ms) : 0, 242225
GlobalTracer [candidate] (239.191 ms) : 0, 239191
AppSec [baseline] (55.121 ms) : 0, 55121
AppSec [candidate] (54.439 ms) : 0, 54439
Debugger [baseline] (8.5 ms) : 0, 8500
Debugger [candidate] (8.967 ms) : 0, 8967
Remote Config [baseline] (694.64 µs) : 0, 695
Remote Config [candidate] (692.821 µs) : 0, 693
Telemetry [baseline] (9.068 ms) : 0, 9068
Telemetry [candidate] (11.193 ms) : 0, 11193
section iast
BytebuddyAgent [baseline] (802.964 ms) : 0, 802964
BytebuddyAgent [candidate] (800.714 ms) : 0, 800714
GlobalTracer [baseline] (231.881 ms) : 0, 231881
GlobalTracer [candidate] (229.803 ms) : 0, 229803
IAST [baseline] (28.597 ms) : 0, 28597
IAST [candidate] (27.538 ms) : 0, 27538
AppSec [baseline] (50.787 ms) : 0, 50787
AppSec [candidate] (51.48 ms) : 0, 51480
Debugger [baseline] (5.958 ms) : 0, 5958
Debugger [candidate] (5.979 ms) : 0, 5979
Remote Config [baseline] (595.761 µs) : 0, 596
Remote Config [candidate] (619.469 µs) : 0, 619
Telemetry [baseline] (7.952 ms) : 0, 7952
Telemetry [candidate] (7.977 ms) : 0, 7977
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (801.327 ms) : 0, 801327
BytebuddyAgent [candidate] (801.453 ms) : 0, 801453
GlobalTracer [baseline] (230.352 ms) : 0, 230352
GlobalTracer [candidate] (231.466 ms) : 0, 231466
IAST [baseline] (28.22 ms) : 0, 28220
IAST [candidate] (28.527 ms) : 0, 28527
AppSec [baseline] (50.062 ms) : 0, 50062
AppSec [candidate] (50.645 ms) : 0, 50645
Debugger [baseline] (5.875 ms) : 0, 5875
Debugger [candidate] (5.934 ms) : 0, 5934
Remote Config [baseline] (590.427 µs) : 0, 590
Remote Config [candidate] (600.122 µs) : 0, 600
Telemetry [baseline] (7.869 ms) : 0, 7869
Telemetry [candidate] (7.89 ms) : 0, 7890
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (798.231 ms) : 0, 798231
BytebuddyAgent [candidate] (796.04 ms) : 0, 796040
GlobalTracer [baseline] (230.873 ms) : 0, 230873
GlobalTracer [candidate] (230.033 ms) : 0, 230033
IAST [baseline] (22.363 ms) : 0, 22363
IAST [candidate] (23.047 ms) : 0, 23047
AppSec [baseline] (55.66 ms) : 0, 55660
AppSec [candidate] (54.63 ms) : 0, 54630
Debugger [baseline] (5.951 ms) : 0, 5951
Debugger [candidate] (5.89 ms) : 0, 5890
Remote Config [baseline] (604.172 µs) : 0, 604
Remote Config [candidate] (595.033 µs) : 0, 595
Telemetry [baseline] (7.795 ms) : 0, 7795
Telemetry [candidate] (7.705 ms) : 0, 7705
Loading
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.50.0-SNAPSHOT~0ee8a0f1d1, baseline=1.50.0-SNAPSHOT~f494c33b01

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.024 s) : 0, 1023910
Total [baseline] (10.489 s) : 0, 10489073
Agent [candidate] (1.025 s) : 0, 1024602
Total [candidate] (10.503 s) : 0, 10502894
section appsec
Agent [baseline] (1.159 s) : 0, 1159329
Total [baseline] (10.656 s) : 0, 10656172
Agent [candidate] (1.164 s) : 0, 1163655
Total [candidate] (10.672 s) : 0, 10671940
section iast
Agent [baseline] (1.149 s) : 0, 1148678
Total [baseline] (10.917 s) : 0, 10916928
Agent [candidate] (1.149 s) : 0, 1149262
Total [candidate] (10.93 s) : 0, 10929569
section profiling
Agent [baseline] (1.283 s) : 0, 1283116
Total [baseline] (10.922 s) : 0, 10921585
Agent [candidate] (1.291 s) : 0, 1290836
Total [candidate] (10.919 s) : 0, 10918676
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.024 s -
Agent appsec 1.159 s 135.42 ms (13.2%)
Agent iast 1.149 s 124.769 ms (12.2%)
Agent profiling 1.283 s 259.207 ms (25.3%)
Total tracing 10.489 s -
Total appsec 10.656 s 167.1 ms (1.6%)
Total iast 10.917 s 427.855 ms (4.1%)
Total profiling 10.922 s 432.513 ms (4.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.025 s -
Agent appsec 1.164 s 139.054 ms (13.6%)
Agent iast 1.149 s 124.66 ms (12.2%)
Agent profiling 1.291 s 266.235 ms (26.0%)
Total tracing 10.503 s -
Total appsec 10.672 s 169.046 ms (1.6%)
Total iast 10.93 s 426.675 ms (4.1%)
Total profiling 10.919 s 415.783 ms (4.0%)
gantt
    title petclinic - break down per module: candidate=1.50.0-SNAPSHOT~0ee8a0f1d1, baseline=1.50.0-SNAPSHOT~f494c33b01

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (686.396 ms) : 0, 686396
BytebuddyAgent [candidate] (686.14 ms) : 0, 686140
GlobalTracer [baseline] (241.149 ms) : 0, 241149
GlobalTracer [candidate] (239.76 ms) : 0, 239760
AppSec [baseline] (56.065 ms) : 0, 56065
AppSec [candidate] (54.521 ms) : 0, 54521
Debugger [baseline] (7.616 ms) : 0, 7616
Debugger [candidate] (9.228 ms) : 0, 9228
Remote Config [baseline] (690.297 µs) : 0, 690
Remote Config [candidate] (701.066 µs) : 0, 701
Telemetry [baseline] (8.295 ms) : 0, 8295
Telemetry [candidate] (10.475 ms) : 0, 10475
section appsec
BytebuddyAgent [baseline] (699.479 ms) : 0, 699479
BytebuddyAgent [candidate] (703.037 ms) : 0, 703037
GlobalTracer [baseline] (236.154 ms) : 0, 236154
GlobalTracer [candidate] (237.216 ms) : 0, 237216
IAST [baseline] (21.664 ms) : 0, 21664
IAST [candidate] (21.727 ms) : 0, 21727
AppSec [baseline] (175.433 ms) : 0, 175433
AppSec [candidate] (175.067 ms) : 0, 175067
Debugger [baseline] (5.928 ms) : 0, 5928
Debugger [candidate] (5.931 ms) : 0, 5931
Remote Config [baseline] (623.948 µs) : 0, 624
Remote Config [candidate] (614.699 µs) : 0, 615
Telemetry [baseline] (7.373 ms) : 0, 7373
Telemetry [candidate] (7.349 ms) : 0, 7349
section iast
BytebuddyAgent [baseline] (801.96 ms) : 0, 801960
BytebuddyAgent [candidate] (802.83 ms) : 0, 802830
GlobalTracer [baseline] (229.919 ms) : 0, 229919
GlobalTracer [candidate] (230.532 ms) : 0, 230532
IAST [baseline] (27.613 ms) : 0, 27613
IAST [candidate] (28.049 ms) : 0, 28049
AppSec [baseline] (49.73 ms) : 0, 49730
AppSec [candidate] (49.278 ms) : 0, 49278
Debugger [baseline] (5.89 ms) : 0, 5890
Debugger [candidate] (5.817 ms) : 0, 5817
Remote Config [baseline] (589.451 µs) : 0, 589
Remote Config [candidate] (581.518 µs) : 0, 582
Telemetry [baseline] (7.942 ms) : 0, 7942
Telemetry [candidate] (7.882 ms) : 0, 7882
section profiling
BytebuddyAgent [baseline] (675.614 ms) : 0, 675614
BytebuddyAgent [candidate] (678.825 ms) : 0, 678825
GlobalTracer [baseline] (377.895 ms) : 0, 377895
GlobalTracer [candidate] (381.15 ms) : 0, 381150
AppSec [baseline] (54.313 ms) : 0, 54313
AppSec [candidate] (53.615 ms) : 0, 53615
Debugger [baseline] (6.08 ms) : 0, 6080
Debugger [candidate] (6.125 ms) : 0, 6125
Remote Config [baseline] (649.697 µs) : 0, 650
Remote Config [candidate] (658.471 µs) : 0, 658
Telemetry [baseline] (8.063 ms) : 0, 8063
Telemetry [candidate] (8.107 ms) : 0, 8107
ProfilingAgent [baseline] (109.827 ms) : 0, 109827
ProfilingAgent [candidate] (111.334 ms) : 0, 111334
Profiling [baseline] (109.852 ms) : 0, 109852
Profiling [candidate] (111.36 ms) : 0, 111360
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-05-11T04:59:37 2025-05-11T05:07:22
git_branch master ci/update-gradle-dependencies-20250511
git_commit_date 1746825821 1746938784
git_commit_sha f494c33 0ee8a0f
release_version 1.50.0-SNAPSHOT~f494c33b01 1.50.0-SNAPSHOT~0ee8a0f1d1
start_time 2025-05-11T04:59:22 2025-05-11T05:07:08
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1746940440 1746940440
ci_job_id 932609202 932609202
ci_pipeline_id 64723776 64723776
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-snzwzxk-project-304-concurrent-2-1tvtzvl5 6.8.0-1027-aws #29~22.04.1-Ubuntu SMP Sun Mar 30 07:45:38 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-snzwzxk-project-304-concurrent-2-1tvtzvl5 6.8.0-1027-aws #29~22.04.1-Ubuntu SMP Sun Mar 30 07:45:38 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 18 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:petclinic:profiling better
[-108.801µs; -44.047µs] or [-6.959%; -2.817%]
unstable
[-326.907op/s; +800.981op/s] or [-11.033%; +27.033%]
1.487ms 3200.000op/s 1.563ms 2962.963op/s
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~0ee8a0f1d1, baseline=1.50.0-SNAPSHOT~f494c33b01
    dateFormat X
    axisFormat %s
section baseline
no_agent (384.941 µs) : 364, 406
.   : milestone, 385,
iast (529.402 µs) : 506, 553
.   : milestone, 529,
iast_FULL (736.673 µs) : 715, 758
.   : milestone, 737,
iast_GLOBAL (580.022 µs) : 557, 603
.   : milestone, 580,
iast_HARDCODED_SECRET_DISABLED (518.211 µs) : 496, 540
.   : milestone, 518,
iast_INACTIVE (467.538 µs) : 445, 490
.   : milestone, 468,
iast_TELEMETRY_OFF (510.038 µs) : 487, 533
.   : milestone, 510,
tracing (466.774 µs) : 445, 489
.   : milestone, 467,
section candidate
no_agent (380.374 µs) : 360, 400
.   : milestone, 380,
iast (524.087 µs) : 502, 547
.   : milestone, 524,
iast_FULL (741.921 µs) : 720, 764
.   : milestone, 742,
iast_GLOBAL (557.85 µs) : 536, 579
.   : milestone, 558,
iast_HARDCODED_SECRET_DISABLED (526.001 µs) : 504, 548
.   : milestone, 526,
iast_INACTIVE (473.8 µs) : 451, 497
.   : milestone, 474,
iast_TELEMETRY_OFF (522.46 µs) : 499, 546
.   : milestone, 522,
tracing (458.586 µs) : 437, 480
.   : milestone, 459,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 384.941 µs [363.962 µs, 405.92 µs] -
iast 529.402 µs [506.26 µs, 552.545 µs] 144.461 µs (37.5%)
iast_FULL 736.673 µs [714.952 µs, 758.395 µs] 351.732 µs (91.4%)
iast_GLOBAL 580.022 µs [557.493 µs, 602.552 µs] 195.081 µs (50.7%)
iast_HARDCODED_SECRET_DISABLED 518.211 µs [496.16 µs, 540.261 µs] 133.269 µs (34.6%)
iast_INACTIVE 467.538 µs [444.957 µs, 490.119 µs] 82.597 µs (21.5%)
iast_TELEMETRY_OFF 510.038 µs [486.851 µs, 533.224 µs] 125.097 µs (32.5%)
tracing 466.774 µs [444.567 µs, 488.98 µs] 81.832 µs (21.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 380.374 µs [360.401 µs, 400.348 µs] -
iast 524.087 µs [501.632 µs, 546.541 µs] 143.712 µs (37.8%)
iast_FULL 741.921 µs [719.886 µs, 763.956 µs] 361.546 µs (95.1%)
iast_GLOBAL 557.85 µs [536.29 µs, 579.41 µs] 177.475 µs (46.7%)
iast_HARDCODED_SECRET_DISABLED 526.001 µs [503.725 µs, 548.277 µs] 145.627 µs (38.3%)
iast_INACTIVE 473.8 µs [451.025 µs, 496.575 µs] 93.425 µs (24.6%)
iast_TELEMETRY_OFF 522.46 µs [499.306 µs, 545.613 µs] 142.085 µs (37.4%)
tracing 458.586 µs [436.834 µs, 480.339 µs] 78.212 µs (20.6%)
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~0ee8a0f1d1, baseline=1.50.0-SNAPSHOT~f494c33b01
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.359 ms) : 1340, 1379
.   : milestone, 1359,
appsec (1.716 ms) : 1693, 1740
.   : milestone, 1716,
appsec_no_iast (1.73 ms) : 1707, 1753
.   : milestone, 1730,
code_origins (1.672 ms) : 1645, 1699
.   : milestone, 1672,
iast (1.533 ms) : 1509, 1557
.   : milestone, 1533,
profiling (1.563 ms) : 1528, 1599
.   : milestone, 1563,
tracing (1.495 ms) : 1473, 1518
.   : milestone, 1495,
section candidate
no_agent (1.373 ms) : 1353, 1394
.   : milestone, 1373,
appsec (1.74 ms) : 1716, 1764
.   : milestone, 1740,
appsec_no_iast (1.74 ms) : 1716, 1764
.   : milestone, 1740,
code_origins (1.672 ms) : 1646, 1699
.   : milestone, 1672,
iast (1.519 ms) : 1495, 1543
.   : milestone, 1519,
profiling (1.487 ms) : 1463, 1511
.   : milestone, 1487,
tracing (1.499 ms) : 1476, 1523
.   : milestone, 1499,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.359 ms [1.34 ms, 1.379 ms] -
appsec 1.716 ms [1.693 ms, 1.74 ms] 357.074 µs (26.3%)
appsec_no_iast 1.73 ms [1.707 ms, 1.753 ms] 370.502 µs (27.3%)
code_origins 1.672 ms [1.645 ms, 1.699 ms] 312.53 µs (23.0%)
iast 1.533 ms [1.509 ms, 1.557 ms] 173.9 µs (12.8%)
profiling 1.563 ms [1.528 ms, 1.599 ms] 204.22 µs (15.0%)
tracing 1.495 ms [1.473 ms, 1.518 ms] 136.114 µs (10.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.373 ms [1.353 ms, 1.394 ms] -
appsec 1.74 ms [1.716 ms, 1.764 ms] 366.734 µs (26.7%)
appsec_no_iast 1.74 ms [1.716 ms, 1.764 ms] 366.673 µs (26.7%)
code_origins 1.672 ms [1.646 ms, 1.699 ms] 298.867 µs (21.8%)
iast 1.519 ms [1.495 ms, 1.543 ms] 145.883 µs (10.6%)
profiling 1.487 ms [1.463 ms, 1.511 ms] 113.788 µs (8.3%)
tracing 1.499 ms [1.476 ms, 1.523 ms] 125.853 µs (9.2%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20250511
git_commit_date 1746825821 1746938784
git_commit_sha f494c33 0ee8a0f
release_version 1.50.0-SNAPSHOT~f494c33b01 1.50.0-SNAPSHOT~0ee8a0f1d1
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1746940999 1746940999
ci_job_id 932609203 932609203
ci_pipeline_id 64723776 64723776
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-ecrswmq9-project-304-concurrent-3-ntjbfkb7 6.8.0-1027-aws #29~22.04.1-Ubuntu SMP Sun Mar 30 07:45:38 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-ecrswmq9-project-304-concurrent-3-ntjbfkb7 6.8.0-1027-aws #29~22.04.1-Ubuntu SMP Sun Mar 30 07:45:38 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~0ee8a0f1d1, baseline=1.50.0-SNAPSHOT~f494c33b01
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.469 ms) : 1457, 1480
.   : milestone, 1469,
appsec (2.417 ms) : 2368, 2467
.   : milestone, 2417,
iast (2.197 ms) : 2135, 2259
.   : milestone, 2197,
iast_GLOBAL (2.229 ms) : 2166, 2291
.   : milestone, 2229,
profiling (2.032 ms) : 1983, 2081
.   : milestone, 2032,
tracing (2.014 ms) : 1966, 2062
.   : milestone, 2014,
section candidate
no_agent (1.478 ms) : 1467, 1490
.   : milestone, 1478,
appsec (2.406 ms) : 2357, 2455
.   : milestone, 2406,
iast (2.199 ms) : 2136, 2261
.   : milestone, 2199,
iast_GLOBAL (2.234 ms) : 2171, 2296
.   : milestone, 2234,
profiling (2.05 ms) : 1999, 2101
.   : milestone, 2050,
tracing (2.019 ms) : 1971, 2068
.   : milestone, 2019,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.469 ms [1.457 ms, 1.48 ms] -
appsec 2.417 ms [2.368 ms, 2.467 ms] 948.706 µs (64.6%)
iast 2.197 ms [2.135 ms, 2.259 ms] 728.022 µs (49.6%)
iast_GLOBAL 2.229 ms [2.166 ms, 2.291 ms] 760.023 µs (51.8%)
profiling 2.032 ms [1.983 ms, 2.081 ms] 563.67 µs (38.4%)
tracing 2.014 ms [1.966 ms, 2.062 ms] 545.763 µs (37.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.478 ms [1.467 ms, 1.49 ms] -
appsec 2.406 ms [2.357 ms, 2.455 ms] 927.617 µs (62.8%)
iast 2.199 ms [2.136 ms, 2.261 ms] 720.54 µs (48.7%)
iast_GLOBAL 2.234 ms [2.171 ms, 2.296 ms] 755.843 µs (51.1%)
profiling 2.05 ms [1.999 ms, 2.101 ms] 571.555 µs (38.7%)
tracing 2.019 ms [1.971 ms, 2.068 ms] 541.151 µs (36.6%)
Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~0ee8a0f1d1, baseline=1.50.0-SNAPSHOT~f494c33b01
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.841 s) : 14841000, 14841000
.   : milestone, 14841000,
appsec (15.198 s) : 15198000, 15198000
.   : milestone, 15198000,
iast (19.202 s) : 19202000, 19202000
.   : milestone, 19202000,
iast_GLOBAL (18.207 s) : 18207000, 18207000
.   : milestone, 18207000,
profiling (14.863 s) : 14863000, 14863000
.   : milestone, 14863000,
tracing (15.018 s) : 15018000, 15018000
.   : milestone, 15018000,
section candidate
no_agent (15.21 s) : 15210000, 15210000
.   : milestone, 15210000,
appsec (15.098 s) : 15098000, 15098000
.   : milestone, 15098000,
iast (18.93 s) : 18930000, 18930000
.   : milestone, 18930000,
iast_GLOBAL (17.87 s) : 17870000, 17870000
.   : milestone, 17870000,
profiling (14.994 s) : 14994000, 14994000
.   : milestone, 14994000,
tracing (15.11 s) : 15110000, 15110000
.   : milestone, 15110000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.841 s [14.841 s, 14.841 s] -
appsec 15.198 s [15.198 s, 15.198 s] 357.0 ms (2.4%)
iast 19.202 s [19.202 s, 19.202 s] 4.361 s (29.4%)
iast_GLOBAL 18.207 s [18.207 s, 18.207 s] 3.366 s (22.7%)
profiling 14.863 s [14.863 s, 14.863 s] 22.0 ms (0.1%)
tracing 15.018 s [15.018 s, 15.018 s] 177.0 ms (1.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.21 s [15.21 s, 15.21 s] -
appsec 15.098 s [15.098 s, 15.098 s] -112.0 ms (-0.7%)
iast 18.93 s [18.93 s, 18.93 s] 3.72 s (24.5%)
iast_GLOBAL 17.87 s [17.87 s, 17.87 s] 2.66 s (17.5%)
profiling 14.994 s [14.994 s, 14.994 s] -216.0 ms (-1.4%)
tracing 15.11 s [15.11 s, 15.11 s] -100.0 ms (-0.7%)

@pr-commenter
Copy link

pr-commenter bot commented May 11, 2025

Debugger benchmarks

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
ci_job_date 1746939578 1746939975
end_time 2025-05-11T05:00:56 2025-05-11T05:07:34
git_branch master ci/update-gradle-dependencies-20250511
git_commit_sha f494c33 1e44600
start_time 2025-05-11T04:59:39 2025-05-11T05:06:16
See matching parameters
Baseline Candidate
ci_job_id 932610737 932610737
ci_pipeline_id 64723786 64723786
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1746938811 1746938811

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 8 metrics, 6 unstable metrics.

scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:loop unsure
[-449.812µs; -28.270µs] or [-3.956%; -0.249%]
unsure
[-436.432µs; -6.375µs] or [-3.779%; -0.055%]
same same better
[+1.655op/s; +4.449op/s] or [+1.928%; +5.183%]
See unchanged results
scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:noprobe unstable
[-17.112µs; +23.685µs] or [-6.242%; +8.640%]
unstable
[-29.289µs; +34.739µs] or [-9.254%; +10.976%]
unstable
[-42.202µs; +46.116µs] or [-12.732%; +13.913%]
unstable
[-111.353µs; +76.340µs] or [-18.319%; +12.559%]
same
scenario:basic same same same unstable
[-55.417µs; +12.053µs] or [-9.924%; +2.158%]
unstable
[-211.490op/s; +89.539op/s] or [-8.460%; +3.582%]
Request duration reports for reports
gantt
    title reports - request duration [CI 0.99] : candidate=None, baseline=None
    dateFormat X
    axisFormat %s
section baseline
noprobe (316.511 µs) : 286, 347
.   : milestone, 317,
basic (315.75 µs) : 307, 325
.   : milestone, 316,
loop (11.55 ms) : 11532, 11568
.   : milestone, 11550,
section candidate
noprobe (319.237 µs) : 289, 350
.   : milestone, 319,
basic (319.284 µs) : 311, 328
.   : milestone, 319,
loop (11.329 ms) : 11047, 11611
.   : milestone, 11329,
Loading
  • baseline results
Scenario Request median duration [CI 0.99]
noprobe 316.511 µs [285.894 µs, 347.129 µs]
basic 315.75 µs [306.748 µs, 324.753 µs]
loop 11.55 ms [11.532 ms, 11.568 ms]
  • candidate results
Scenario Request median duration [CI 0.99]
noprobe 319.237 µs [288.853 µs, 349.62 µs]
basic 319.284 µs [310.929 µs, 327.638 µs]
loop 11.329 ms [11.047 ms, 11.611 ms]

@pr-commenter
Copy link

pr-commenter bot commented May 11, 2025

Kafka / producer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20250511
git_commit_date 1746825821 1746938808
git_commit_sha f494c33 cace63b
See matching parameters
Baseline Candidate
ci_job_date 1746940068 1746940068
ci_job_id 932610582 932610582
ci_pipeline_id 64723785 64723785
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaProduceBenchmark.benchProduce same

@pr-commenter
Copy link

pr-commenter bot commented May 11, 2025

Kafka / consumer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20250511
git_commit_date 1746825821 1746938789
git_commit_sha f494c33 1ede360
See matching parameters
Baseline Candidate
ci_job_date 1746940123 1746940123
ci_job_id 932609512 932609512
ci_pipeline_id 64723778 64723778
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaConsumerBenchmark.benchConsume same

@smola
Copy link
Member

smola commented May 19, 2025

Closing in favor of #8842

@smola smola closed this May 19, 2025
@AlexeyKuznetsov-DD AlexeyKuznetsov-DD deleted the ci/update-gradle-dependencies-20250511 branch July 22, 2025 19:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

tag: dependencies Dependencies related changes tag: no release notes Changes to exclude from release notes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants