Skip to content

Ignore jboss and quarkus smoke tests for JDK 24+ #9147

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 2 commits into from
Jul 10, 2025
Merged

Ignore jboss and quarkus smoke tests for JDK 24+ #9147

merged 2 commits into from
Jul 10, 2025

Conversation

@sarahchen6
Copy link
Contributor

@sarahchen6 sarahchen6 commented Jul 10, 2025

What Does This Do

Ignore jboss and quarkus smoke tests for JDK 24+

Motivation

They do not support JDK 24+

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@sarahchen6 sarahchen6 added type: enhancement Enhancements and improvements comp: testing Testing tag: no release notes Changes to exclude from release notes labels Jul 10, 2025
@pr-commenter
Copy link

pr-commenter bot commented Jul 10, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/ignore-jboss-and-quarkus
git_commit_date 1752155835 1752163061
git_commit_sha 90a02ce 2b0cb88
release_version 1.52.0-SNAPSHOT~90a02cea31 1.52.0-SNAPSHOT~2b0cb8827e
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1752164963 1752164963
ci_job_id 1023268892 1023268892
ci_pipeline_id 70199518 70199518
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-hyo9nkcj 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-hyo9nkcj 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 42 metrics, 11 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.52.0-SNAPSHOT~2b0cb8827e, baseline=1.52.0-SNAPSHOT~90a02cea31

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.001 s) : 0, 1000914
Total [baseline] (10.598 s) : 0, 10597647
Agent [candidate] (1.002 s) : 0, 1002500
Total [candidate] (10.626 s) : 0, 10626092
section appsec
Agent [baseline] (1.175 s) : 0, 1175426
Total [baseline] (10.744 s) : 0, 10743516
Agent [candidate] (1.174 s) : 0, 1174498
Total [candidate] (10.74 s) : 0, 10739898
section iast
Agent [baseline] (1.132 s) : 0, 1131931
Total [baseline] (10.815 s) : 0, 10815128
Agent [candidate] (1.131 s) : 0, 1130918
Total [candidate] (10.789 s) : 0, 10789349
section profiling
Agent [baseline] (1.243 s) : 0, 1242808
Total [baseline] (11.001 s) : 0, 11000721
Agent [candidate] (1.251 s) : 0, 1250943
Total [candidate] (11.041 s) : 0, 11040678
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.001 s -
Agent appsec 1.175 s 174.512 ms (17.4%)
Agent iast 1.132 s 131.017 ms (13.1%)
Agent profiling 1.243 s 241.894 ms (24.2%)
Total tracing 10.598 s -
Total appsec 10.744 s 145.869 ms (1.4%)
Total iast 10.815 s 217.481 ms (2.1%)
Total profiling 11.001 s 403.075 ms (3.8%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.002 s -
Agent appsec 1.174 s 171.998 ms (17.2%)
Agent iast 1.131 s 128.418 ms (12.8%)
Agent profiling 1.251 s 248.443 ms (24.8%)
Total tracing 10.626 s -
Total appsec 10.74 s 113.806 ms (1.1%)
Total iast 10.789 s 163.257 ms (1.5%)
Total profiling 11.041 s 414.586 ms (3.9%) 
gantt
    title petclinic - break down per module: candidate=1.52.0-SNAPSHOT~2b0cb8827e, baseline=1.52.0-SNAPSHOT~90a02cea31

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (691.275 ms) : 0, 691275
BytebuddyAgent [candidate] (692.195 ms) : 0, 692195
GlobalTracer [baseline] (242.583 ms) : 0, 242583
GlobalTracer [candidate] (243.777 ms) : 0, 243777
AppSec [baseline] (30.526 ms) : 0, 30526
AppSec [candidate] (30.538 ms) : 0, 30538
Debugger [baseline] (5.999 ms) : 0, 5999
Debugger [candidate] (6.076 ms) : 0, 6076
Remote Config [baseline] (698.916 µs) : 0, 699
Remote Config [candidate] (703.322 µs) : 0, 703
Telemetry [baseline] (9.022 ms) : 0, 9022
Telemetry [candidate] (8.323 ms) : 0, 8323
section appsec
BytebuddyAgent [baseline] (710.652 ms) : 0, 710652
BytebuddyAgent [candidate] (709.966 ms) : 0, 709966
GlobalTracer [baseline] (235.008 ms) : 0, 235008
GlobalTracer [candidate] (234.616 ms) : 0, 234616
AppSec [baseline] (170.859 ms) : 0, 170859
AppSec [candidate] (171.091 ms) : 0, 171091
Debugger [baseline] (5.742 ms) : 0, 5742
Debugger [candidate] (5.704 ms) : 0, 5704
Remote Config [baseline] (605.168 µs) : 0, 605
Remote Config [candidate] (594.315 µs) : 0, 594
Telemetry [baseline] (8.101 ms) : 0, 8101
Telemetry [candidate] (8.052 ms) : 0, 8052
IAST [baseline] (23.538 ms) : 0, 23538
IAST [candidate] (23.504 ms) : 0, 23504
section iast
BytebuddyAgent [baseline] (806.024 ms) : 0, 806024
BytebuddyAgent [candidate] (806.524 ms) : 0, 806524
GlobalTracer [baseline] (232.897 ms) : 0, 232897
GlobalTracer [candidate] (231.957 ms) : 0, 231957
AppSec [baseline] (27.315 ms) : 0, 27315
AppSec [candidate] (29.332 ms) : 0, 29332
Debugger [baseline] (5.82 ms) : 0, 5820
Debugger [candidate] (5.73 ms) : 0, 5730
Remote Config [baseline] (591.115 µs) : 0, 591
Remote Config [candidate] (574.766 µs) : 0, 575
Telemetry [baseline] (7.999 ms) : 0, 7999
Telemetry [candidate] (7.889 ms) : 0, 7889
IAST [baseline] (30.497 ms) : 0, 30497
IAST [candidate] (28.147 ms) : 0, 28147
section profiling
BytebuddyAgent [baseline] (677.155 ms) : 0, 677155
BytebuddyAgent [candidate] (681.153 ms) : 0, 681153
GlobalTracer [baseline] (361.233 ms) : 0, 361233
GlobalTracer [candidate] (363.056 ms) : 0, 363056
AppSec [baseline] (31.419 ms) : 0, 31419
AppSec [candidate] (31.621 ms) : 0, 31621
Debugger [baseline] (11.32 ms) : 0, 11320
Debugger [candidate] (12.138 ms) : 0, 12138
Remote Config [baseline] (664.779 µs) : 0, 665
Remote Config [candidate] (668.475 µs) : 0, 668
Telemetry [baseline] (9.478 ms) : 0, 9478
Telemetry [candidate] (8.87 ms) : 0, 8870
ProfilingAgent [baseline] (102.893 ms) : 0, 102893
ProfilingAgent [candidate] (104.549 ms) : 0, 104549
Profiling [baseline] (102.917 ms) : 0, 102917
Profiling [candidate] (104.573 ms) : 0, 104573
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.52.0-SNAPSHOT~2b0cb8827e, baseline=1.52.0-SNAPSHOT~90a02cea31

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.005 s) : 0, 1004657
Total [baseline] (8.609 s) : 0, 8608862
Agent [candidate] (994.869 ms) : 0, 994869
Total [candidate] (8.571 s) : 0, 8570910
section iast
Agent [baseline] (1.131 s) : 0, 1130633
Total [baseline] (9.308 s) : 0, 9308232
Agent [candidate] (1.138 s) : 0, 1138044
Total [candidate] (9.284 s) : 0, 9284293
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.005 s -
Agent iast 1.131 s 125.977 ms (12.5%)
Total tracing 8.609 s -
Total iast 9.308 s 699.371 ms (8.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 994.869 ms -
Agent iast 1.138 s 143.175 ms (14.4%)
Total tracing 8.571 s -
Total iast 9.284 s 713.383 ms (8.3%) 
gantt
    title insecure-bank - break down per module: candidate=1.52.0-SNAPSHOT~2b0cb8827e, baseline=1.52.0-SNAPSHOT~90a02cea31

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (694.424 ms) : 0, 694424
BytebuddyAgent [candidate] (686.752 ms) : 0, 686752
GlobalTracer [baseline] (243.843 ms) : 0, 243843
GlobalTracer [candidate] (242.132 ms) : 0, 242132
AppSec [baseline] (30.38 ms) : 0, 30380
AppSec [candidate] (30.169 ms) : 0, 30169
Debugger [baseline] (6.033 ms) : 0, 6033
Debugger [candidate] (6.006 ms) : 0, 6006
Remote Config [baseline] (697.229 µs) : 0, 697
Remote Config [candidate] (681.397 µs) : 0, 681
Telemetry [baseline] (8.282 ms) : 0, 8282
Telemetry [candidate] (8.268 ms) : 0, 8268
section iast
BytebuddyAgent [baseline] (805.688 ms) : 0, 805688
BytebuddyAgent [candidate] (811.883 ms) : 0, 811883
GlobalTracer [baseline] (231.087 ms) : 0, 231087
GlobalTracer [candidate] (232.669 ms) : 0, 232669
AppSec [baseline] (31.003 ms) : 0, 31003
AppSec [candidate] (30.67 ms) : 0, 30670
Debugger [baseline] (6.713 ms) : 0, 6713
Debugger [candidate] (5.777 ms) : 0, 5777
Remote Config [baseline] (650.998 µs) : 0, 651
Remote Config [candidate] (593.906 µs) : 0, 594
Telemetry [baseline] (8.04 ms) : 0, 8040
Telemetry [candidate] (8.022 ms) : 0, 8022
IAST [baseline] (26.648 ms) : 0, 26648
IAST [candidate] (27.516 ms) : 0, 27516
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/ignore-jboss-and-quarkus
git_commit_date 1752155835 1752163061
git_commit_sha 90a02ce 2b0cb88
release_version 1.52.0-SNAPSHOT~90a02cea31 1.52.0-SNAPSHOT~2b0cb8827e
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1752164575 1752164575
ci_job_id 1023268895 1023268895
ci_pipeline_id 70199518 70199518
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-gxctu48g 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-gxctu48g 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 4 performance regressions! Performance is the same for 6 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:insecure-bank:no_agent:high_load worse
[+181.931µs; +298.898µs] or [+4.223%; +6.938%]		 unstable
[-160.878op/s; +51.003op/s] or [-15.110%; +4.790%]		 4.548ms 1009.781op/s 4.308ms 1064.719op/s
scenario:load:insecure-bank:profiling:high_load better
[-553.870µs; -258.855µs] or [-6.256%; -2.924%]		 unstable
[-42.106op/s; +91.793op/s] or [-8.036%; +17.519%]		 8.447ms 548.812op/s 8.854ms 523.969op/s
scenario:load:petclinic:no_agent:high_load worse
[+3.194ms; +3.846ms] or [+8.976%; +10.808%]		 unstable
[-20.935op/s; -2.590op/s] or [-15.938%; -1.972%]		 39.107ms 119.588op/s 35.586ms 131.350op/s
scenario:load:petclinic:iast:high_load better
[-2.905ms; -2.083ms] or [-6.427%; -4.608%]		 unstable
[-1.876op/s; +13.926op/s] or [-1.812%; +13.449%]		 42.701ms 109.575op/s 45.195ms 103.550op/s
scenario:load:petclinic:code_origins:high_load worse
[+1.723ms; +2.554ms] or [+3.885%; +5.757%]		 unstable
[-13.315op/s; +0.995op/s] or [-12.469%; +0.932%]		 46.497ms 100.625op/s 44.358ms 106.785op/s
scenario:load:petclinic:profiling:high_load worse
[+0.994ms; +1.947ms] or [+2.087%; +4.089%]		 unstable
[-10.039op/s; +4.139op/s] or [-10.212%; +4.210%]		 49.080ms 95.350op/s 47.610ms 98.300op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.52.0-SNAPSHOT~2b0cb8827e, baseline=1.52.0-SNAPSHOT~90a02cea31
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.308 ms) : 4251, 4365
.   : milestone, 4308,
iast (9.235 ms) : 9084, 9386
.   : milestone, 9235,
iast_FULL (14.002 ms) : 13729, 14274
.   : milestone, 14002,
iast_GLOBAL (10.242 ms) : 10062, 10421
.   : milestone, 10242,
profiling (8.854 ms) : 8707, 9001
.   : milestone, 8854,
tracing (7.685 ms) : 7576, 7793
.   : milestone, 7685,
section candidate
no_agent (4.548 ms) : 4496, 4600
.   : milestone, 4548,
iast (9.468 ms) : 9313, 9622
.   : milestone, 9468,
iast_FULL (13.653 ms) : 13383, 13922
.   : milestone, 13653,
iast_GLOBAL (10.229 ms) : 10049, 10409
.   : milestone, 10229,
profiling (8.447 ms) : 8321, 8573
.   : milestone, 8447,
tracing (7.489 ms) : 7382, 7596
.   : milestone, 7489,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.308 ms [4.251 ms, 4.365 ms] -
iast 9.235 ms [9.084 ms, 9.386 ms] 4.927 ms (114.4%)
iast_FULL 14.002 ms [13.729 ms, 14.274 ms] 9.694 ms (225.0%)
iast_GLOBAL 10.242 ms [10.062 ms, 10.421 ms] 5.934 ms (137.7%)
profiling 8.854 ms [8.707 ms, 9.001 ms] 4.546 ms (105.5%)
tracing 7.685 ms [7.576 ms, 7.793 ms] 3.377 ms (78.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.548 ms [4.496 ms, 4.6 ms] -
iast 9.468 ms [9.313 ms, 9.622 ms] 4.919 ms (108.2%)
iast_FULL 13.653 ms [13.383 ms, 13.922 ms] 9.104 ms (200.2%)
iast_GLOBAL 10.229 ms [10.049 ms, 10.409 ms] 5.68 ms (124.9%)
profiling 8.447 ms [8.321 ms, 8.573 ms] 3.899 ms (85.7%)
tracing 7.489 ms [7.382 ms, 7.596 ms] 2.941 ms (64.7%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.52.0-SNAPSHOT~2b0cb8827e, baseline=1.52.0-SNAPSHOT~90a02cea31
    dateFormat X
    axisFormat %s
section baseline
no_agent (35.586 ms) : 35307, 35866
.   : milestone, 35586,
appsec (46.627 ms) : 46222, 47033
.   : milestone, 46627,
code_origins (44.358 ms) : 43986, 44730
.   : milestone, 44358,
iast (45.195 ms) : 44808, 45582
.   : milestone, 45195,
profiling (47.61 ms) : 47190, 48029
.   : milestone, 47610,
tracing (42.285 ms) : 41941, 42629
.   : milestone, 42285,
section candidate
no_agent (39.107 ms) : 38782, 39431
.   : milestone, 39107,
appsec (46.903 ms) : 46474, 47331
.   : milestone, 46903,
code_origins (46.497 ms) : 46097, 46896
.   : milestone, 46497,
iast (42.701 ms) : 42324, 43078
.   : milestone, 42701,
profiling (49.08 ms) : 48615, 49545
.   : milestone, 49080,
tracing (42.609 ms) : 42252, 42966
.   : milestone, 42609,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 35.586 ms [35.307 ms, 35.866 ms] -
appsec 46.627 ms [46.222 ms, 47.033 ms] 11.041 ms (31.0%)
code_origins 44.358 ms [43.986 ms, 44.73 ms] 8.772 ms (24.6%)
iast 45.195 ms [44.808 ms, 45.582 ms] 9.609 ms (27.0%)
profiling 47.61 ms [47.19 ms, 48.029 ms] 12.024 ms (33.8%)
tracing 42.285 ms [41.941 ms, 42.629 ms] 6.699 ms (18.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 39.107 ms [38.782 ms, 39.431 ms] -
appsec 46.903 ms [46.474 ms, 47.331 ms] 7.796 ms (19.9%)
code_origins 46.497 ms [46.097 ms, 46.896 ms] 7.39 ms (18.9%)
iast 42.701 ms [42.324 ms, 43.078 ms] 3.595 ms (9.2%)
profiling 49.08 ms [48.615 ms, 49.545 ms] 9.973 ms (25.5%)
tracing 42.609 ms [42.252 ms, 42.966 ms] 3.503 ms (9.0%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/ignore-jboss-and-quarkus
git_commit_date 1752155835 1752163061
git_commit_sha 90a02ce 2b0cb88
release_version 1.52.0-SNAPSHOT~90a02cea31 1.52.0-SNAPSHOT~2b0cb8827e
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1752165048 1752165048
ci_job_id 1023268899 1023268899
ci_pipeline_id 70199518 70199518
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-7yef59yq 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-7yef59yq 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.52.0-SNAPSHOT~2b0cb8827e, baseline=1.52.0-SNAPSHOT~90a02cea31
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.481 ms) : 1469, 1492
.   : milestone, 1481,
appsec (2.427 ms) : 2376, 2478
.   : milestone, 2427,
iast (2.206 ms) : 2142, 2269
.   : milestone, 2206,
iast_GLOBAL (2.26 ms) : 2196, 2324
.   : milestone, 2260,
profiling (2.523 ms) : 2344, 2703
.   : milestone, 2523,
tracing (2.026 ms) : 1977, 2076
.   : milestone, 2026,
section candidate
no_agent (1.482 ms) : 1470, 1493
.   : milestone, 1482,
appsec (2.434 ms) : 2383, 2485
.   : milestone, 2434,
iast (2.215 ms) : 2152, 2279
.   : milestone, 2215,
iast_GLOBAL (2.263 ms) : 2198, 2327
.   : milestone, 2263,
profiling (2.065 ms) : 2014, 2117
.   : milestone, 2065,
tracing (2.028 ms) : 1979, 2078
.   : milestone, 2028,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.481 ms [1.469 ms, 1.492 ms] -
appsec 2.427 ms [2.376 ms, 2.478 ms] 946.296 µs (63.9%)
iast 2.206 ms [2.142 ms, 2.269 ms] 724.877 µs (49.0%)
iast_GLOBAL 2.26 ms [2.196 ms, 2.324 ms] 779.091 µs (52.6%)
profiling 2.523 ms [2.344 ms, 2.703 ms] 1.043 ms (70.4%)
tracing 2.026 ms [1.977 ms, 2.076 ms] 545.657 µs (36.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.482 ms [1.47 ms, 1.493 ms] -
appsec 2.434 ms [2.383 ms, 2.485 ms] 952.774 µs (64.3%)
iast 2.215 ms [2.152 ms, 2.279 ms] 733.803 µs (49.5%)
iast_GLOBAL 2.263 ms [2.198 ms, 2.327 ms] 781.397 µs (52.7%)
profiling 2.065 ms [2.014 ms, 2.117 ms] 583.543 µs (39.4%)
tracing 2.028 ms [1.979 ms, 2.078 ms] 546.77 µs (36.9%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.52.0-SNAPSHOT~2b0cb8827e, baseline=1.52.0-SNAPSHOT~90a02cea31
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.274 s) : 15274000, 15274000
.   : milestone, 15274000,
appsec (14.782 s) : 14782000, 14782000
.   : milestone, 14782000,
iast (18.178 s) : 18178000, 18178000
.   : milestone, 18178000,
iast_GLOBAL (17.938 s) : 17938000, 17938000
.   : milestone, 17938000,
profiling (15.69 s) : 15690000, 15690000
.   : milestone, 15690000,
tracing (14.648 s) : 14648000, 14648000
.   : milestone, 14648000,
section candidate
no_agent (15.207 s) : 15207000, 15207000
.   : milestone, 15207000,
appsec (14.904 s) : 14904000, 14904000
.   : milestone, 14904000,
iast (18.189 s) : 18189000, 18189000
.   : milestone, 18189000,
iast_GLOBAL (18.21 s) : 18210000, 18210000
.   : milestone, 18210000,
profiling (15.029 s) : 15029000, 15029000
.   : milestone, 15029000,
tracing (15.038 s) : 15038000, 15038000
.   : milestone, 15038000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.274 s [15.274 s, 15.274 s] -
appsec 14.782 s [14.782 s, 14.782 s] -492.0 ms (-3.2%)
iast 18.178 s [18.178 s, 18.178 s] 2.904 s (19.0%)
iast_GLOBAL 17.938 s [17.938 s, 17.938 s] 2.664 s (17.4%)
profiling 15.69 s [15.69 s, 15.69 s] 416.0 ms (2.7%)
tracing 14.648 s [14.648 s, 14.648 s] -626.0 ms (-4.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.207 s [15.207 s, 15.207 s] -
appsec 14.904 s [14.904 s, 14.904 s] -303.0 ms (-2.0%)
iast 18.189 s [18.189 s, 18.189 s] 2.982 s (19.6%)
iast_GLOBAL 18.21 s [18.21 s, 18.21 s] 3.003 s (19.7%)
profiling 15.029 s [15.029 s, 15.029 s] -178.0 ms (-1.2%)
tracing 15.038 s [15.038 s, 15.038 s] -169.0 ms (-1.1%)

@sarahchen6 sarahchen6 marked this pull request as ready for review July 10, 2025 16:40
@sarahchen6 sarahchen6 requested a review from a team as a code owner July 10, 2025 16:40
@sarahchen6 sarahchen6 requested review from amarziali and mcculls July 10, 2025 16:40
amarziali
amarziali approved these changes Jul 10, 2025
View reviewed changes
Copy link
Contributor

@amarziali amarziali left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@sarahchen6 sarahchen6 merged commit 923ac63 into master Jul 10, 2025
511 of 513 checks passed
@sarahchen6 sarahchen6 deleted the sarahchen6/ignore-jboss-and-quarkus branch July 10, 2025 18:10
@github-actions github-actions bot added this to the 1.52.0 milestone Jul 10, 2025
@bric3
Copy link
Contributor

bric3 commented Jul 10, 2025

Maybe we should have a reminder to activate them back when 25 is out and boss and quarkus support it?

@sarahchen6
Copy link
Contributor Author

sarahchen6 commented Jul 10, 2025

Maybe we should have a reminder to activate them back when 25 is out and boss and quarkus support it?

I think the problem with quarkus is that our smoke tests run a really old version (v1.9.2.Final) whereas even Java 21 is not officially supported until v3.5 (quarkus blog). Similarly, jboss v2 specifically tests v2.0.0.Final which was released about 4 years ago (mvnrepository). If testing with 25, we would probably need to write new smoke tests instead of reactivating. 😅

mhlidd pushed a commit that referenced this pull request Jul 17, 2025
@sarahchen6 @mhlidd
Ignore jboss and quarkus smoke tests for JDK 24+ (#9147)
8fef951 
* Update jboss

* Update quarkus
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@amarziali amarziali amarziali approved these changes

@mcculls mcculls Awaiting requested review from mcculls mcculls is a code owner automatically assigned from DataDog/apm-java

Assignees

No one assigned

Labels

comp: testing Testing tag: no release notes Changes to exclude from release notes type: enhancement Enhancements and improvements

Projects

None yet

Milestone

1.52.0

Development

Successfully merging this pull request may close these issues.

4 participants

@sarahchen6 @bric3 @amarziali