Add graalvm25 image to testing #9562

sarahchen6 · 2025-09-18T14:38:57Z

What Does This Do

Test Graalvm 25 image in CI

Motivation

Additional Notes

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, move, or deletion
Update the public documentation in case of new configuration flag or behavior

Jira ticket: https://datadoghq.atlassian.net/browse/LANGPLAT-83

datadog-official · 2025-09-18T15:00:31Z

🎯 Code Coverage
• Patch Coverage: 100.00%
• Total Coverage: 59.34% (-0.48%)

View detailed report

_{This comment will be updated automatically if new data arrives.

🔗 Commit SHA: 7f3e77e | Docs | Was this helpful? Give us feedback!}

pr-commenter · 2025-09-18T15:14:26Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	sarahchen6/test-graalvm25
git_commit_date	1758306588	1758311422
git_commit_sha	`3a389f5`	`7f3e77e`
release_version	1.54.0-SNAPSHOT~3a389f573c	1.54.0-SNAPSHOT~7f3e77eddb

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1758313143	1758313143
ci_job_id	1139251610	1139251610
ci_pipeline_id	77037228	77037228
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-4-bkt17q32 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-4-bkt17q32 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 1 performance improvements and 13 performance regressions! Performance is the same for 33 metrics, 12 unstable metrics.

scenario	Δ mean execution_time	candidate mean execution_time	baseline mean execution_time
scenario:startup:insecure-bank:iast:Agent.start	worse [+29.854ms; +43.565ms] or [+2.590%; +3.779%]	1.190s	1.153s
scenario:startup:insecure-bank:iast:BytebuddyAgent	worse [+39.077ms; +48.492ms] or [+4.838%; +6.003%]	851.551ms	807.766ms
scenario:startup:insecure-bank:tracing:Agent.start	worse [+31.991ms; +49.664ms] or [+3.118%; +4.840%]	1.067s	1.026s
scenario:startup:insecure-bank:tracing:BytebuddyAgent	worse [+42.168ms; +49.379ms] or [+6.117%; +7.164%]	735.075ms	689.301ms
scenario:startup:petclinic:appsec:BytebuddyAgent	worse [+32.400ms; +65.469ms] or [+4.525%; +9.144%]	764.906ms	715.971ms
scenario:startup:petclinic:appsec:IAST	better [-1.902ms; -0.577ms] or [-7.560%; -2.293%]	23.915ms	25.154ms
scenario:startup:petclinic:iast:Agent.start	worse [+34.724ms; +43.548ms] or [+3.014%; +3.780%]	1.191s	1.152s
scenario:startup:petclinic:iast:BytebuddyAgent	worse [+42.251ms; +48.334ms] or [+5.237%; +5.991%]	852.135ms	806.842ms
scenario:startup:petclinic:profiling:Agent.start	worse [+39.581ms; +49.227ms] or [+3.392%; +4.219%]	1.211s	1.167s
scenario:startup:petclinic:profiling:ProfilingAgent	worse [+6.138ms; +9.330ms] or [+6.021%; +9.153%]	109.671ms	101.937ms
scenario:startup:petclinic:profiling:BytebuddyAgent	worse [+38.040ms; +43.884ms] or [+5.281%; +6.093%]	761.223ms	720.261ms
scenario:startup:petclinic:profiling:Profiling	worse [+6.180ms; +9.382ms] or [+6.027%; +9.150%]	110.317ms	102.536ms
scenario:startup:petclinic:tracing:Agent.start	worse [+31.724ms; +60.979ms] or [+3.109%; +5.975%]	1.067s	1.020s
scenario:startup:petclinic:tracing:BytebuddyAgent	worse [+38.511ms; +58.709ms] or [+5.603%; +8.542%]	735.945ms	687.335ms

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.54.0-SNAPSHOT~7f3e77eddb, baseline=1.54.0-SNAPSHOT~3a389f573c

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.026 s) : 0, 1026095
Total [baseline] (8.704 s) : 0, 8704131
Agent [candidate] (1.067 s) : 0, 1066923
Total [candidate] (8.678 s) : 0, 8678423
section iast
Agent [baseline] (1.153 s) : 0, 1152858
Total [baseline] (9.381 s) : 0, 9381260
Agent [candidate] (1.19 s) : 0, 1189567
Total [candidate] (9.318 s) : 0, 9318441

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.026 s	-
Agent	iast	1.153 s	126.762 ms (12.4%)
Total	tracing	8.704 s	-
Total	iast	9.381 s	677.129 ms (7.8%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.067 s	-
Agent	iast	1.19 s	122.644 ms (11.5%)
Total	tracing	8.678 s	-
Total	iast	9.318 s	640.018 ms (7.4%)

gantt
    title insecure-bank - break down per module: candidate=1.54.0-SNAPSHOT~7f3e77eddb, baseline=1.54.0-SNAPSHOT~3a389f573c

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.456 ms) : 0, 1456
crashtracking [candidate] (1.453 ms) : 0, 1453
BytebuddyAgent [baseline] (689.301 ms) : 0, 689301
BytebuddyAgent [candidate] (735.075 ms) : 0, 735075
GlobalTracer [baseline] (260.224 ms) : 0, 260224
GlobalTracer [candidate] (255.025 ms) : 0, 255025
AppSec [baseline] (31.904 ms) : 0, 31904
AppSec [candidate] (31.073 ms) : 0, 31073
Debugger [baseline] (6.392 ms) : 0, 6392
Debugger [candidate] (6.428 ms) : 0, 6428
Remote Config [baseline] (691.836 µs) : 0, 692
Remote Config [candidate] (690.094 µs) : 0, 690
Telemetry [baseline] (15.068 ms) : 0, 15068
Telemetry [candidate] (16.215 ms) : 0, 16215
section iast
crashtracking [baseline] (1.453 ms) : 0, 1453
crashtracking [candidate] (1.454 ms) : 0, 1454
BytebuddyAgent [baseline] (807.766 ms) : 0, 807766
BytebuddyAgent [candidate] (851.551 ms) : 0, 851551
GlobalTracer [baseline] (249.411 ms) : 0, 249411
GlobalTracer [candidate] (244.426 ms) : 0, 244426
IAST [baseline] (29.99 ms) : 0, 29990
IAST [candidate] (31.13 ms) : 0, 31130
AppSec [baseline] (28.596 ms) : 0, 28596
AppSec [candidate] (25.44 ms) : 0, 25440
Debugger [baseline] (6.025 ms) : 0, 6025
Debugger [candidate] (6.035 ms) : 0, 6035
Remote Config [baseline] (603.28 µs) : 0, 603
Remote Config [candidate] (584.09 µs) : 0, 584
Telemetry [baseline] (8.117 ms) : 0, 8117
Telemetry [candidate] (8.086 ms) : 0, 8086

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.54.0-SNAPSHOT~7f3e77eddb, baseline=1.54.0-SNAPSHOT~3a389f573c

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.02 s) : 0, 1020494
Total [baseline] (10.707 s) : 0, 10707270
Agent [candidate] (1.067 s) : 0, 1066846
Total [candidate] (10.791 s) : 0, 10790947
section appsec
Agent [baseline] (1.205 s) : 0, 1204900
Total [baseline] (11.086 s) : 0, 11086030
Agent [candidate] (1.246 s) : 0, 1246404
Total [candidate] (11.046 s) : 0, 11046348
section iast
Agent [baseline] (1.152 s) : 0, 1151946
Total [baseline] (11.053 s) : 0, 11053338
Agent [candidate] (1.191 s) : 0, 1191082
Total [candidate] (11.051 s) : 0, 11050980
section profiling
Agent [baseline] (1.167 s) : 0, 1166711
Total [baseline] (11.036 s) : 0, 11035710
Agent [candidate] (1.211 s) : 0, 1211115
Total [candidate] (11.023 s) : 0, 11023226

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.02 s	-
Agent	appsec	1.205 s	184.406 ms (18.1%)
Agent	iast	1.152 s	131.452 ms (12.9%)
Agent	profiling	1.167 s	146.217 ms (14.3%)
Total	tracing	10.707 s	-
Total	appsec	11.086 s	378.76 ms (3.5%)
Total	iast	11.053 s	346.068 ms (3.2%)
Total	profiling	11.036 s	328.44 ms (3.1%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.067 s	-
Agent	appsec	1.246 s	179.558 ms (16.8%)
Agent	iast	1.191 s	124.237 ms (11.6%)
Agent	profiling	1.211 s	144.27 ms (13.5%)
Total	tracing	10.791 s	-
Total	appsec	11.046 s	255.401 ms (2.4%)
Total	iast	11.051 s	260.033 ms (2.4%)
Total	profiling	11.023 s	232.278 ms (2.2%)

gantt
    title petclinic - break down per module: candidate=1.54.0-SNAPSHOT~7f3e77eddb, baseline=1.54.0-SNAPSHOT~3a389f573c

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.463 ms) : 0, 1463
crashtracking [candidate] (1.458 ms) : 0, 1458
BytebuddyAgent [baseline] (687.335 ms) : 0, 687335
BytebuddyAgent [candidate] (735.945 ms) : 0, 735945
GlobalTracer [baseline] (259.144 ms) : 0, 259144
GlobalTracer [candidate] (253.844 ms) : 0, 253844
AppSec [baseline] (31.749 ms) : 0, 31749
AppSec [candidate] (30.735 ms) : 0, 30735
Debugger [baseline] (6.36 ms) : 0, 6360
Debugger [candidate] (6.498 ms) : 0, 6498
Remote Config [baseline] (689.772 µs) : 0, 690
Remote Config [candidate] (696.03 µs) : 0, 696
Telemetry [baseline] (12.667 ms) : 0, 12667
Telemetry [candidate] (16.474 ms) : 0, 16474
section appsec
crashtracking [baseline] (1.468 ms) : 0, 1468
crashtracking [candidate] (1.492 ms) : 0, 1492
BytebuddyAgent [baseline] (715.971 ms) : 0, 715971
BytebuddyAgent [candidate] (764.906 ms) : 0, 764906
GlobalTracer [baseline] (253.22 ms) : 0, 253220
GlobalTracer [candidate] (247.609 ms) : 0, 247609
IAST [baseline] (25.154 ms) : 0, 25154
IAST [candidate] (23.915 ms) : 0, 23915
AppSec [baseline] (171.43 ms) : 0, 171430
AppSec [candidate] (170.96 ms) : 0, 170960
Debugger [baseline] (6.079 ms) : 0, 6079
Debugger [candidate] (6.922 ms) : 0, 6922
Remote Config [baseline] (625.672 µs) : 0, 626
Remote Config [candidate] (640.291 µs) : 0, 640
Telemetry [baseline] (9.809 ms) : 0, 9809
Telemetry [candidate] (8.53 ms) : 0, 8530
section iast
crashtracking [baseline] (1.459 ms) : 0, 1459
crashtracking [candidate] (1.442 ms) : 0, 1442
BytebuddyAgent [baseline] (806.842 ms) : 0, 806842
BytebuddyAgent [candidate] (852.135 ms) : 0, 852135
GlobalTracer [baseline] (248.718 ms) : 0, 248718
GlobalTracer [candidate] (247.247 ms) : 0, 247247
IAST [baseline] (30.826 ms) : 0, 30826
IAST [candidate] (28.829 ms) : 0, 28829
AppSec [baseline] (28.205 ms) : 0, 28205
AppSec [candidate] (25.546 ms) : 0, 25546
Debugger [baseline] (6.093 ms) : 0, 6093
Debugger [candidate] (6.075 ms) : 0, 6075
Remote Config [baseline] (612.77 µs) : 0, 613
Remote Config [candidate] (599.739 µs) : 0, 600
Telemetry [baseline] (8.163 ms) : 0, 8163
Telemetry [candidate] (8.204 ms) : 0, 8204
section profiling
crashtracking [baseline] (1.443 ms) : 0, 1443
crashtracking [candidate] (1.429 ms) : 0, 1429
BytebuddyAgent [baseline] (720.261 ms) : 0, 720261
BytebuddyAgent [candidate] (761.223 ms) : 0, 761223
GlobalTracer [baseline] (237.13 ms) : 0, 237130
GlobalTracer [candidate] (232.901 ms) : 0, 232901
AppSec [baseline] (31.121 ms) : 0, 31121
AppSec [candidate] (30.564 ms) : 0, 30564
Debugger [baseline] (7.215 ms) : 0, 7215
Debugger [candidate] (13.801 ms) : 0, 13801
Remote Config [baseline] (708.774 µs) : 0, 709
Remote Config [candidate] (748.433 µs) : 0, 748
Telemetry [baseline] (15.741 ms) : 0, 15741
Telemetry [candidate] (9.514 ms) : 0, 9514
ProfilingAgent [baseline] (101.937 ms) : 0, 101937
ProfilingAgent [candidate] (109.671 ms) : 0, 109671
Profiling [baseline] (102.536 ms) : 0, 102536
Profiling [candidate] (110.317 ms) : 0, 110317

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	sarahchen6/test-graalvm25
git_commit_date	1758306588	1758311422
git_commit_sha	`3a389f5`	`7f3e77e`
release_version	1.54.0-SNAPSHOT~3a389f573c	1.54.0-SNAPSHOT~7f3e77eddb

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1758312885	1758312885
ci_job_id	1139251611	1139251611
ci_pipeline_id	77037228	77037228
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-5-ngwpjzki 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-5-ngwpjzki 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 3 performance improvements and 2 performance regressions! Performance is the same for 7 metrics, 12 unstable metrics.

scenario	Δ mean http_req_duration	Δ mean throughput	candidate mean http_req_duration	candidate mean throughput	baseline mean http_req_duration	baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load	better [-1043.777µs; -620.606µs] or [-9.113%; -5.418%]	unstable [-18.728op/s; +81.728op/s] or [-4.613%; +20.129%]	10.622ms	437.531op/s	11.454ms	406.031op/s
scenario:load:insecure-bank:iast_FULL:high_load	better [-1.353ms; -0.748ms] or [-9.216%; -5.095%]	unstable [-12.932op/s; +61.682op/s] or [-4.074%; +19.431%]	13.629ms	341.812op/s	14.680ms	317.438op/s
scenario:load:petclinic:code_origins:high_load	worse [+1.728ms; +2.595ms] or [+3.854%; +5.785%]	unstable [-11.972op/s; +2.347op/s] or [-11.475%; +2.250%]	47.014ms	99.525op/s	44.852ms	104.338op/s
scenario:load:petclinic:tracing:high_load	better [-2.682ms; -1.905ms] or [-6.034%; -4.285%]	unstable [-1.960op/s; +13.385op/s] or [-1.861%; +12.711%]	42.151ms	111.013op/s	44.444ms	105.300op/s
scenario:load:petclinic:appsec:high_load	worse [+1.135ms; +2.000ms] or [+2.422%; +4.270%]	unstable [-10.259op/s; +3.884op/s] or [-10.269%; +3.887%]	48.404ms	96.713op/s	46.837ms	99.900op/s

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~7f3e77eddb, baseline=1.54.0-SNAPSHOT~3a389f573c
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.409 ms) : 4359, 4458
.   : milestone, 4409,
iast (9.665 ms) : 9495, 9835
.   : milestone, 9665,
iast_FULL (14.68 ms) : 14388, 14971
.   : milestone, 14680,
iast_GLOBAL (11.454 ms) : 11248, 11660
.   : milestone, 11454,
profiling (8.926 ms) : 8790, 9062
.   : milestone, 8926,
tracing (7.788 ms) : 7675, 7900
.   : milestone, 7788,
section candidate
no_agent (4.545 ms) : 4490, 4600
.   : milestone, 4545,
iast (9.651 ms) : 9488, 9814
.   : milestone, 9651,
iast_FULL (13.629 ms) : 13359, 13900
.   : milestone, 13629,
iast_GLOBAL (10.622 ms) : 10435, 10809
.   : milestone, 10622,
profiling (8.77 ms) : 8635, 8905
.   : milestone, 8770,
tracing (7.631 ms) : 7521, 7741
.   : milestone, 7631,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.409 ms [4.359 ms, 4.458 ms]	-
iast	9.665 ms [9.495 ms, 9.835 ms]	5.257 ms (119.2%)
iast_FULL	14.68 ms [14.388 ms, 14.971 ms]	10.271 ms (233.0%)
iast_GLOBAL	11.454 ms [11.248 ms, 11.66 ms]	7.045 ms (159.8%)
profiling	8.926 ms [8.79 ms, 9.062 ms]	4.517 ms (102.5%)
tracing	7.788 ms [7.675 ms, 7.9 ms]	3.379 ms (76.6%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.545 ms [4.49 ms, 4.6 ms]	-
iast	9.651 ms [9.488 ms, 9.814 ms]	5.106 ms (112.4%)
iast_FULL	13.629 ms [13.359 ms, 13.9 ms]	9.085 ms (199.9%)
iast_GLOBAL	10.622 ms [10.435 ms, 10.809 ms]	6.077 ms (133.7%)
profiling	8.77 ms [8.635 ms, 8.905 ms]	4.225 ms (93.0%)
tracing	7.631 ms [7.521 ms, 7.741 ms]	3.086 ms (67.9%)

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~7f3e77eddb, baseline=1.54.0-SNAPSHOT~3a389f573c
    dateFormat X
    axisFormat %s
section baseline
no_agent (36.81 ms) : 36513, 37107
.   : milestone, 36810,
appsec (46.837 ms) : 46426, 47247
.   : milestone, 46837,
code_origins (44.852 ms) : 44475, 45230
.   : milestone, 44852,
iast (45.04 ms) : 44647, 45434
.   : milestone, 45040,
profiling (50.456 ms) : 49955, 50957
.   : milestone, 50456,
tracing (44.444 ms) : 44067, 44822
.   : milestone, 44444,
section candidate
no_agent (37.81 ms) : 37495, 38126
.   : milestone, 37810,
appsec (48.404 ms) : 48011, 48797
.   : milestone, 48404,
code_origins (47.014 ms) : 46588, 47440
.   : milestone, 47014,
iast (45.82 ms) : 45424, 46216
.   : milestone, 45820,
profiling (50.006 ms) : 49514, 50499
.   : milestone, 50006,
tracing (42.151 ms) : 41807, 42495
.   : milestone, 42151,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	36.81 ms [36.513 ms, 37.107 ms]	-
appsec	46.837 ms [46.426 ms, 47.247 ms]	10.027 ms (27.2%)
code_origins	44.852 ms [44.475 ms, 45.23 ms]	8.042 ms (21.8%)
iast	45.04 ms [44.647 ms, 45.434 ms]	8.23 ms (22.4%)
profiling	50.456 ms [49.955 ms, 50.957 ms]	13.646 ms (37.1%)
tracing	44.444 ms [44.067 ms, 44.822 ms]	7.634 ms (20.7%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	37.81 ms [37.495 ms, 38.126 ms]	-
appsec	48.404 ms [48.011 ms, 48.797 ms]	10.593 ms (28.0%)
code_origins	47.014 ms [46.588 ms, 47.44 ms]	9.203 ms (24.3%)
iast	45.82 ms [45.424 ms, 46.216 ms]	8.01 ms (21.2%)
profiling	50.006 ms [49.514 ms, 50.499 ms]	12.196 ms (32.3%)
tracing	42.151 ms [41.807 ms, 42.495 ms]	4.341 ms (11.5%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	sarahchen6/test-graalvm25
git_commit_date	1758306588	1758311422
git_commit_sha	`3a389f5`	`7f3e77e`
release_version	1.54.0-SNAPSHOT~3a389f573c	1.54.0-SNAPSHOT~7f3e77eddb

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1758313345	1758313345
ci_job_id	1139251612	1139251612
ci_pipeline_id	77037228	77037228
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-2-wvpnzzf4 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-2-wvpnzzf4 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~7f3e77eddb, baseline=1.54.0-SNAPSHOT~3a389f573c
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.883 s) : 14883000, 14883000
.   : milestone, 14883000,
appsec (14.951 s) : 14951000, 14951000
.   : milestone, 14951000,
iast (18.549 s) : 18549000, 18549000
.   : milestone, 18549000,
iast_GLOBAL (17.884 s) : 17884000, 17884000
.   : milestone, 17884000,
profiling (16.005 s) : 16005000, 16005000
.   : milestone, 16005000,
tracing (15.035 s) : 15035000, 15035000
.   : milestone, 15035000,
section candidate
no_agent (15.536 s) : 15536000, 15536000
.   : milestone, 15536000,
appsec (14.862 s) : 14862000, 14862000
.   : milestone, 14862000,
iast (18.231 s) : 18231000, 18231000
.   : milestone, 18231000,
iast_GLOBAL (18.253 s) : 18253000, 18253000
.   : milestone, 18253000,
profiling (15.323 s) : 15323000, 15323000
.   : milestone, 15323000,
tracing (14.711 s) : 14711000, 14711000
.   : milestone, 14711000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.883 s [14.883 s, 14.883 s]	-
appsec	14.951 s [14.951 s, 14.951 s]	68.0 ms (0.5%)
iast	18.549 s [18.549 s, 18.549 s]	3.666 s (24.6%)
iast_GLOBAL	17.884 s [17.884 s, 17.884 s]	3.001 s (20.2%)
profiling	16.005 s [16.005 s, 16.005 s]	1.122 s (7.5%)
tracing	15.035 s [15.035 s, 15.035 s]	152.0 ms (1.0%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.536 s [15.536 s, 15.536 s]	-
appsec	14.862 s [14.862 s, 14.862 s]	-674.0 ms (-4.3%)
iast	18.231 s [18.231 s, 18.231 s]	2.695 s (17.3%)
iast_GLOBAL	18.253 s [18.253 s, 18.253 s]	2.717 s (17.5%)
profiling	15.323 s [15.323 s, 15.323 s]	-213.0 ms (-1.4%)
tracing	14.711 s [14.711 s, 14.711 s]	-825.0 ms (-5.3%)

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~7f3e77eddb, baseline=1.54.0-SNAPSHOT~3a389f573c
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.484 ms) : 1472, 1495
.   : milestone, 1484,
appsec (3.724 ms) : 3504, 3944
.   : milestone, 3724,
iast (2.201 ms) : 2138, 2264
.   : milestone, 2201,
iast_GLOBAL (2.245 ms) : 2182, 2309
.   : milestone, 2245,
profiling (2.051 ms) : 2001, 2102
.   : milestone, 2051,
tracing (2.032 ms) : 1983, 2081
.   : milestone, 2032,
section candidate
no_agent (1.481 ms) : 1469, 1492
.   : milestone, 1481,
appsec (3.71 ms) : 3491, 3930
.   : milestone, 3710,
iast (2.207 ms) : 2144, 2270
.   : milestone, 2207,
iast_GLOBAL (2.244 ms) : 2181, 2307
.   : milestone, 2244,
profiling (2.069 ms) : 2016, 2121
.   : milestone, 2069,
tracing (2.024 ms) : 1975, 2073
.   : milestone, 2024,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.484 ms [1.472 ms, 1.495 ms]	-
appsec	3.724 ms [3.504 ms, 3.944 ms]	2.24 ms (151.0%)
iast	2.201 ms [2.138 ms, 2.264 ms]	717.257 µs (48.3%)
iast_GLOBAL	2.245 ms [2.182 ms, 2.309 ms]	761.77 µs (51.3%)
profiling	2.051 ms [2.001 ms, 2.102 ms]	567.76 µs (38.3%)
tracing	2.032 ms [1.983 ms, 2.081 ms]	548.423 µs (37.0%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.481 ms [1.469 ms, 1.492 ms]	-
appsec	3.71 ms [3.491 ms, 3.93 ms]	2.23 ms (150.6%)
iast	2.207 ms [2.144 ms, 2.27 ms]	726.714 µs (49.1%)
iast_GLOBAL	2.244 ms [2.181 ms, 2.307 ms]	763.36 µs (51.6%)
profiling	2.069 ms [2.016 ms, 2.121 ms]	588.243 µs (39.7%)
tracing	2.024 ms [1.975 ms, 2.073 ms]	543.616 µs (36.7%)

Add graalvm25 image to testing

cb070ae

sarahchen6 added 2 commits September 18, 2025 11:38

Add flag to allow use of unsafe

1829f7f

Add Graalvm 25 specification to profiling

e3bdbce

sarahchen6 mentioned this pull request Sep 18, 2025

Add graalvm25 image DataDog/dd-trace-java-docker-build#119

Open

sarahchen6 added type: enhancement Enhancements and improvements comp: testing Testing tag: no release notes Changes to exclude from release notes labels Sep 18, 2025

sarahchen6 force-pushed the sarahchen6/test-graalvm25 branch from 2bf27d8 to 506ec84 Compare September 18, 2025 19:50

Change arg for Graalvm 25

b191c6f

sarahchen6 force-pushed the sarahchen6/test-graalvm25 branch from 506ec84 to b191c6f Compare September 18, 2025 20:57

sarahchen6 added 2 commits September 19, 2025 14:35

Add flag to start jfr recording

e2f5d64

Try removing extra flags

7f3e77e

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Add graalvm25 image to testing #9562

Add graalvm25 image to testing #9562

Uh oh!

sarahchen6 commented Sep 18, 2025 •

edited

Loading

Uh oh!

datadog-official bot commented Sep 18, 2025 •

edited

Loading

Uh oh!

pr-commenter bot commented Sep 18, 2025 •

edited

Loading

Uh oh!

Uh oh!

Add graalvm25 image to testing #9562

Are you sure you want to change the base?

Add graalvm25 image to testing #9562

Uh oh!

Conversation

sarahchen6 commented Sep 18, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

datadog-official bot commented Sep 18, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

pr-commenter bot commented Sep 18, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

Uh oh!

sarahchen6 commented Sep 18, 2025 •

edited

Loading

datadog-official bot commented Sep 18, 2025 •

edited

Loading

pr-commenter bot commented Sep 18, 2025 •

edited

Loading