Using ddprof nightly snapshot for nightly test #9919

zhengyu123 · 2025-11-07T17:02:07Z

What Does This Do

Allows dd-trace-java's nightly test to use java-profiler's latest snapshot.

Motivation

Up to now, dd-trace-java always uses latest release version of java-profiler for testing, that means java-profiler does not get any integration tests until it has been released.

With the PR, java-profiler gets early exposure to dd-trace-java's nightly test, should help to catch any integration problems and improve test coverage.

Additional Notes

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any useful labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, move, or deletion
Update the public documentation in case of new configuration flag or behavior

Jira ticket: [PROJ-IDENT]

datadog-datadog-prod-us1 · 2025-11-07T17:26:25Z

🎯 Code Coverage
• Patch Coverage: 100.00%
• Total Coverage: 59.60% (-0.04%)

View detailed report

_{This comment will be updated automatically if new data arrives.

🔗 Commit SHA: cb69d71 | Docs | Datadog PR Page | Was this helpful? Give us feedback!}

pr-commenter · 2025-11-07T17:51:47Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	zgu/profiler_nightly_test
git_commit_date	1762533227	1762534631
git_commit_sha	`54da873`	`cb69d71`
release_version	1.56.0-SNAPSHOT~54da873ecc	1.56.0-SNAPSHOT~cb69d71194

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1762536825	1762536825
ci_job_id	1222847156	1222847156
ci_pipeline_id	81621344	81621344
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-jipb4pyw 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-jipb4pyw 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 53 metrics, 12 unstable metrics.

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.56.0-SNAPSHOT~cb69d71194, baseline=1.56.0-SNAPSHOT~54da873ecc

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.051 s) : 0, 1051067
Total [baseline] (10.866 s) : 0, 10865905
Agent [candidate] (1.055 s) : 0, 1055344
Total [candidate] (10.682 s) : 0, 10682092
section appsec
Agent [baseline] (1.233 s) : 0, 1232841
Total [baseline] (10.918 s) : 0, 10918371
Agent [candidate] (1.222 s) : 0, 1221533
Total [candidate] (10.894 s) : 0, 10894016
section iast
Agent [baseline] (1.183 s) : 0, 1183223
Total [baseline] (11.143 s) : 0, 11142961
Agent [candidate] (1.178 s) : 0, 1178332
Total [candidate] (11.151 s) : 0, 11151116
section profiling
Agent [baseline] (1.201 s) : 0, 1200996
Total [baseline] (10.931 s) : 0, 10931096
Agent [candidate] (1.201 s) : 0, 1201049
Total [candidate] (10.881 s) : 0, 10880884

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.051 s	-
Agent	appsec	1.233 s	181.774 ms (17.3%)
Agent	iast	1.183 s	132.155 ms (12.6%)
Agent	profiling	1.201 s	149.928 ms (14.3%)
Total	tracing	10.866 s	-
Total	appsec	10.918 s	52.466 ms (0.5%)
Total	iast	11.143 s	277.055 ms (2.5%)
Total	profiling	10.931 s	65.191 ms (0.6%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.055 s	-
Agent	appsec	1.222 s	166.189 ms (15.7%)
Agent	iast	1.178 s	122.988 ms (11.7%)
Agent	profiling	1.201 s	145.706 ms (13.8%)
Total	tracing	10.682 s	-
Total	appsec	10.894 s	211.924 ms (2.0%)
Total	iast	11.151 s	469.024 ms (4.4%)
Total	profiling	10.881 s	198.792 ms (1.9%)

gantt
    title petclinic - break down per module: candidate=1.56.0-SNAPSHOT~cb69d71194, baseline=1.56.0-SNAPSHOT~54da873ecc

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.486 ms) : 0, 1486
crashtracking [candidate] (1.463 ms) : 0, 1463
BytebuddyAgent [baseline] (708.127 ms) : 0, 708127
BytebuddyAgent [candidate] (710.836 ms) : 0, 710836
GlobalTracer [baseline] (245.944 ms) : 0, 245944
GlobalTracer [candidate] (247.474 ms) : 0, 247474
AppSec [baseline] (32.549 ms) : 0, 32549
AppSec [candidate] (32.605 ms) : 0, 32605
Debugger [baseline] (6.411 ms) : 0, 6411
Debugger [candidate] (6.483 ms) : 0, 6483
Remote Config [baseline] (715.575 µs) : 0, 716
Remote Config [candidate] (709.734 µs) : 0, 710
Telemetry [baseline] (13.602 ms) : 0, 13602
Telemetry [candidate] (13.679 ms) : 0, 13679
Flare Poller [baseline] (7.422 ms) : 0, 7422
Flare Poller [candidate] (7.205 ms) : 0, 7205
section appsec
crashtracking [baseline] (1.462 ms) : 0, 1462
crashtracking [candidate] (1.445 ms) : 0, 1445
BytebuddyAgent [baseline] (736.049 ms) : 0, 736049
BytebuddyAgent [candidate] (729.355 ms) : 0, 729355
GlobalTracer [baseline] (239.627 ms) : 0, 239627
GlobalTracer [candidate] (237.222 ms) : 0, 237222
IAST [baseline] (25.238 ms) : 0, 25238
IAST [candidate] (25.027 ms) : 0, 25027
AppSec [baseline] (175.946 ms) : 0, 175946
AppSec [candidate] (174.605 ms) : 0, 174605
Debugger [baseline] (6.1 ms) : 0, 6100
Debugger [candidate] (5.992 ms) : 0, 5992
Remote Config [baseline] (656.972 µs) : 0, 657
Remote Config [candidate] (655.647 µs) : 0, 656
Telemetry [baseline] (8.696 ms) : 0, 8696
Telemetry [candidate] (8.471 ms) : 0, 8471
Flare Poller [baseline] (4.008 ms) : 0, 4008
Flare Poller [candidate] (3.982 ms) : 0, 3982
section iast
crashtracking [baseline] (1.456 ms) : 0, 1456
crashtracking [candidate] (1.455 ms) : 0, 1455
BytebuddyAgent [baseline] (831.306 ms) : 0, 831306
BytebuddyAgent [candidate] (827.98 ms) : 0, 827980
GlobalTracer [baseline] (235.599 ms) : 0, 235599
GlobalTracer [candidate] (234.618 ms) : 0, 234618
IAST [baseline] (33.403 ms) : 0, 33403
IAST [candidate] (33.746 ms) : 0, 33746
AppSec [baseline] (27.687 ms) : 0, 27687
AppSec [candidate] (26.973 ms) : 0, 26973
Debugger [baseline] (5.975 ms) : 0, 5975
Debugger [candidate] (5.919 ms) : 0, 5919
Remote Config [baseline] (591.995 µs) : 0, 592
Remote Config [candidate] (585.964 µs) : 0, 586
Telemetry [baseline] (8.333 ms) : 0, 8333
Telemetry [candidate] (8.243 ms) : 0, 8243
Flare Poller [baseline] (4.097 ms) : 0, 4097
Flare Poller [candidate] (4.143 ms) : 0, 4143
section profiling
crashtracking [baseline] (1.447 ms) : 0, 1447
crashtracking [candidate] (1.445 ms) : 0, 1445
BytebuddyAgent [baseline] (734.737 ms) : 0, 734737
BytebuddyAgent [candidate] (736.582 ms) : 0, 736582
GlobalTracer [baseline] (223.344 ms) : 0, 223344
GlobalTracer [candidate] (223.281 ms) : 0, 223281
AppSec [baseline] (32.515 ms) : 0, 32515
AppSec [candidate] (33.176 ms) : 0, 33176
Debugger [baseline] (9.084 ms) : 0, 9084
Debugger [candidate] (8.894 ms) : 0, 8894
Remote Config [baseline] (730.917 µs) : 0, 731
Remote Config [candidate] (677.821 µs) : 0, 678
Telemetry [baseline] (13.942 ms) : 0, 13942
Telemetry [candidate] (12.79 ms) : 0, 12790
Flare Poller [baseline] (4.193 ms) : 0, 4193
Flare Poller [candidate] (4.112 ms) : 0, 4112
ProfilingAgent [baseline] (110.819 ms) : 0, 110819
ProfilingAgent [candidate] (109.85 ms) : 0, 109850
Profiling [baseline] (111.506 ms) : 0, 111506
Profiling [candidate] (110.541 ms) : 0, 110541

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.56.0-SNAPSHOT~cb69d71194, baseline=1.56.0-SNAPSHOT~54da873ecc

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.055 s) : 0, 1054903
Total [baseline] (8.638 s) : 0, 8638214
Agent [candidate] (1.06 s) : 0, 1060189
Total [candidate] (8.666 s) : 0, 8666146
section iast
Agent [baseline] (1.181 s) : 0, 1180663
Total [baseline] (9.242 s) : 0, 9241756
Agent [candidate] (1.197 s) : 0, 1197435
Total [candidate] (9.265 s) : 0, 9264602

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.055 s	-
Agent	iast	1.181 s	125.76 ms (11.9%)
Total	tracing	8.638 s	-
Total	iast	9.242 s	603.542 ms (7.0%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.06 s	-
Agent	iast	1.197 s	137.247 ms (12.9%)
Total	tracing	8.666 s	-
Total	iast	9.265 s	598.456 ms (6.9%)

gantt
    title insecure-bank - break down per module: candidate=1.56.0-SNAPSHOT~cb69d71194, baseline=1.56.0-SNAPSHOT~54da873ecc

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.464 ms) : 0, 1464
crashtracking [candidate] (1.474 ms) : 0, 1474
BytebuddyAgent [baseline] (710.299 ms) : 0, 710299
BytebuddyAgent [candidate] (713.894 ms) : 0, 713894
GlobalTracer [baseline] (247.491 ms) : 0, 247491
GlobalTracer [candidate] (248.538 ms) : 0, 248538
AppSec [baseline] (32.681 ms) : 0, 32681
AppSec [candidate] (33.004 ms) : 0, 33004
Debugger [baseline] (6.464 ms) : 0, 6464
Debugger [candidate] (6.529 ms) : 0, 6529
Remote Config [baseline] (721.385 µs) : 0, 721
Remote Config [candidate] (701.452 µs) : 0, 701
Telemetry [baseline] (14.453 ms) : 0, 14453
Telemetry [candidate] (12.29 ms) : 0, 12290
Flare Poller [baseline] (6.556 ms) : 0, 6556
Flare Poller [candidate] (8.757 ms) : 0, 8757
section iast
crashtracking [baseline] (1.456 ms) : 0, 1456
crashtracking [candidate] (1.469 ms) : 0, 1469
BytebuddyAgent [baseline] (829.564 ms) : 0, 829564
BytebuddyAgent [candidate] (843.067 ms) : 0, 843067
GlobalTracer [baseline] (234.491 ms) : 0, 234491
GlobalTracer [candidate] (236.618 ms) : 0, 236618
IAST [baseline] (32.547 ms) : 0, 32547
IAST [candidate] (34.374 ms) : 0, 34374
AppSec [baseline] (28.619 ms) : 0, 28619
AppSec [candidate] (27.532 ms) : 0, 27532
Debugger [baseline] (6.037 ms) : 0, 6037
Debugger [candidate] (6.062 ms) : 0, 6062
Remote Config [baseline] (605.089 µs) : 0, 605
Remote Config [candidate] (604.884 µs) : 0, 605
Telemetry [baseline] (8.446 ms) : 0, 8446
Telemetry [candidate] (8.579 ms) : 0, 8579
Flare Poller [baseline] (4.101 ms) : 0, 4101
Flare Poller [candidate] (4.159 ms) : 0, 4159

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	zgu/profiler_nightly_test
git_commit_date	1762533227	1762534631
git_commit_sha	`54da873`	`cb69d71`
release_version	1.56.0-SNAPSHOT~54da873ecc	1.56.0-SNAPSHOT~cb69d71194

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1762537309	1762537309
ci_job_id	1222847157	1222847157
ci_pipeline_id	81621344	81621344
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-sv9p466s 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-sv9p466s 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 5 performance regressions! Performance is the same for 6 metrics, 12 unstable metrics.

scenario	Δ mean http_req_duration	Δ mean throughput	candidate mean http_req_duration	candidate mean throughput	baseline mean http_req_duration	baseline mean throughput
scenario:load:insecure-bank:iast_FULL:high_load	worse [+237.330µs; +365.835µs] or [+4.164%; +6.419%]	unstable [-113.895op/s; +33.832op/s] or [-14.045%; +4.172%]	6.001ms	770.906op/s	5.700ms	810.938op/s
scenario:load:insecure-bank:iast:high_load	worse [+117.993µs; +209.562µs] or [+3.794%; +6.739%]	unstable [-221.827op/s; +78.577op/s] or [-15.094%; +5.347%]	3.274ms	1398.000op/s	3.110ms	1469.625op/s
scenario:load:petclinic:profiling:high_load	worse [+777.610µs; +1193.882µs] or [+4.134%; +6.347%]	unstable [-37.113op/s; +12.550op/s] or [-14.955%; +5.057%]	19.795ms	235.875op/s	18.809ms	248.156op/s
scenario:load:petclinic:appsec:high_load	worse [+475.896µs; +893.856µs] or [+2.541%; +4.772%]	unstable [-33.904op/s; +16.342op/s] or [-13.604%; +6.557%]	19.415ms	240.438op/s	18.730ms	249.219op/s
scenario:load:petclinic:iast:high_load	worse [+790.745µs; +1191.015µs] or [+4.430%; +6.672%]	unstable [-40.015op/s; +12.640op/s] or [-15.306%; +4.835%]	18.842ms	247.750op/s	17.851ms	261.438op/s
scenario:load:petclinic:no_agent:high_load	better [-1077.131µs; -667.932µs] or [-5.656%; -3.507%]	unstable [-15.689op/s; +39.189op/s] or [-6.402%; +15.991%]	18.172ms	256.812op/s	19.045ms	245.062op/s

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.56.0-SNAPSHOT~cb69d71194, baseline=1.56.0-SNAPSHOT~54da873ecc
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.193 ms) : 1182, 1205
.   : milestone, 1193,
iast (3.11 ms) : 3071, 3149
.   : milestone, 3110,
iast_FULL (5.7 ms) : 5642, 5757
.   : milestone, 5700,
iast_GLOBAL (3.662 ms) : 3609, 3715
.   : milestone, 3662,
profiling (1.94 ms) : 1923, 1957
.   : milestone, 1940,
tracing (1.791 ms) : 1775, 1806
.   : milestone, 1791,
section candidate
no_agent (1.191 ms) : 1179, 1203
.   : milestone, 1191,
iast (3.274 ms) : 3228, 3320
.   : milestone, 3274,
iast_FULL (6.001 ms) : 5939, 6063
.   : milestone, 6001,
iast_GLOBAL (3.653 ms) : 3593, 3713
.   : milestone, 3653,
profiling (1.978 ms) : 1961, 1995
.   : milestone, 1978,
tracing (1.787 ms) : 1773, 1801
.   : milestone, 1787,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.193 ms [1.182 ms, 1.205 ms]	-
iast	3.11 ms [3.071 ms, 3.149 ms]	1.917 ms (160.6%)
iast_FULL	5.7 ms [5.642 ms, 5.757 ms]	4.506 ms (377.7%)
iast_GLOBAL	3.662 ms [3.609 ms, 3.715 ms]	2.469 ms (206.9%)
profiling	1.94 ms [1.923 ms, 1.957 ms]	746.948 µs (62.6%)
tracing	1.791 ms [1.775 ms, 1.806 ms]	597.375 µs (50.1%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.191 ms [1.179 ms, 1.203 ms]	-
iast	3.274 ms [3.228 ms, 3.32 ms]	2.082 ms (174.8%)
iast_FULL	6.001 ms [5.939 ms, 6.063 ms]	4.81 ms (403.7%)
iast_GLOBAL	3.653 ms [3.593 ms, 3.713 ms]	2.461 ms (206.6%)
profiling	1.978 ms [1.961 ms, 1.995 ms]	787.123 µs (66.1%)
tracing	1.787 ms [1.773 ms, 1.801 ms]	595.57 µs (50.0%)

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.56.0-SNAPSHOT~cb69d71194, baseline=1.56.0-SNAPSHOT~54da873ecc
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.045 ms) : 18848, 19242
.   : milestone, 19045,
appsec (18.73 ms) : 18542, 18918
.   : milestone, 18730,
code_origins (17.641 ms) : 17466, 17817
.   : milestone, 17641,
iast (17.851 ms) : 17675, 18027
.   : milestone, 17851,
profiling (18.809 ms) : 18618, 19000
.   : milestone, 18809,
tracing (17.732 ms) : 17554, 17909
.   : milestone, 17732,
section candidate
no_agent (18.172 ms) : 17990, 18355
.   : milestone, 18172,
appsec (19.415 ms) : 19215, 19615
.   : milestone, 19415,
code_origins (17.689 ms) : 17514, 17864
.   : milestone, 17689,
iast (18.842 ms) : 18646, 19037
.   : milestone, 18842,
profiling (19.795 ms) : 19599, 19991
.   : milestone, 19795,
tracing (17.692 ms) : 17515, 17870
.   : milestone, 17692,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	19.045 ms [18.848 ms, 19.242 ms]	-
appsec	18.73 ms [18.542 ms, 18.918 ms]	-315.005 µs (-1.7%)
code_origins	17.641 ms [17.466 ms, 17.817 ms]	-1.404 ms (-7.4%)
iast	17.851 ms [17.675 ms, 18.027 ms]	-1.194 ms (-6.3%)
profiling	18.809 ms [18.618 ms, 19.0 ms]	-235.96 µs (-1.2%)
tracing	17.732 ms [17.554 ms, 17.909 ms]	-1.313 ms (-6.9%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	18.172 ms [17.99 ms, 18.355 ms]	-
appsec	19.415 ms [19.215 ms, 19.615 ms]	1.242 ms (6.8%)
code_origins	17.689 ms [17.514 ms, 17.864 ms]	-483.278 µs (-2.7%)
iast	18.842 ms [18.646 ms, 19.037 ms]	669.226 µs (3.7%)
profiling	19.795 ms [19.599 ms, 19.991 ms]	1.622 ms (8.9%)
tracing	17.692 ms [17.515 ms, 17.87 ms]	-480.158 µs (-2.6%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	zgu/profiler_nightly_test
git_commit_date	1762533227	1762534631
git_commit_sha	`54da873`	`cb69d71`
release_version	1.56.0-SNAPSHOT~54da873ecc	1.56.0-SNAPSHOT~cb69d71194

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1762536955	1762536955
ci_job_id	1222847158	1222847158
ci_pipeline_id	81621344	81621344
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-2ij43ft9 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-2ij43ft9 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.56.0-SNAPSHOT~cb69d71194, baseline=1.56.0-SNAPSHOT~54da873ecc
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.471 ms) : 1460, 1483
.   : milestone, 1471,
appsec (3.702 ms) : 3484, 3920
.   : milestone, 3702,
iast (2.205 ms) : 2142, 2269
.   : milestone, 2205,
iast_GLOBAL (2.238 ms) : 2174, 2302
.   : milestone, 2238,
profiling (2.052 ms) : 2000, 2103
.   : milestone, 2052,
tracing (2.025 ms) : 1975, 2074
.   : milestone, 2025,
section candidate
no_agent (1.479 ms) : 1467, 1490
.   : milestone, 1479,
appsec (3.714 ms) : 3496, 3932
.   : milestone, 3714,
iast (2.202 ms) : 2138, 2265
.   : milestone, 2202,
iast_GLOBAL (2.247 ms) : 2183, 2310
.   : milestone, 2247,
profiling (2.053 ms) : 2002, 2104
.   : milestone, 2053,
tracing (2.026 ms) : 1976, 2076
.   : milestone, 2026,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.471 ms [1.46 ms, 1.483 ms]	-
appsec	3.702 ms [3.484 ms, 3.92 ms]	2.231 ms (151.6%)
iast	2.205 ms [2.142 ms, 2.269 ms]	734.044 µs (49.9%)
iast_GLOBAL	2.238 ms [2.174 ms, 2.302 ms]	766.477 µs (52.1%)
profiling	2.052 ms [2.0 ms, 2.103 ms]	580.62 µs (39.5%)
tracing	2.025 ms [1.975 ms, 2.074 ms]	553.366 µs (37.6%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.479 ms [1.467 ms, 1.49 ms]	-
appsec	3.714 ms [3.496 ms, 3.932 ms]	2.235 ms (151.2%)
iast	2.202 ms [2.138 ms, 2.265 ms]	723.136 µs (48.9%)
iast_GLOBAL	2.247 ms [2.183 ms, 2.31 ms]	768.141 µs (52.0%)
profiling	2.053 ms [2.002 ms, 2.104 ms]	574.41 µs (38.8%)
tracing	2.026 ms [1.976 ms, 2.076 ms]	547.632 µs (37.0%)

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.56.0-SNAPSHOT~cb69d71194, baseline=1.56.0-SNAPSHOT~54da873ecc
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.974 s) : 14974000, 14974000
.   : milestone, 14974000,
appsec (14.811 s) : 14811000, 14811000
.   : milestone, 14811000,
iast (18.563 s) : 18563000, 18563000
.   : milestone, 18563000,
iast_GLOBAL (18.007 s) : 18007000, 18007000
.   : milestone, 18007000,
profiling (14.951 s) : 14951000, 14951000
.   : milestone, 14951000,
tracing (14.731 s) : 14731000, 14731000
.   : milestone, 14731000,
section candidate
no_agent (14.9 s) : 14900000, 14900000
.   : milestone, 14900000,
appsec (14.944 s) : 14944000, 14944000
.   : milestone, 14944000,
iast (18.573 s) : 18573000, 18573000
.   : milestone, 18573000,
iast_GLOBAL (18.247 s) : 18247000, 18247000
.   : milestone, 18247000,
profiling (15.23 s) : 15230000, 15230000
.   : milestone, 15230000,
tracing (14.543 s) : 14543000, 14543000
.   : milestone, 14543000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.974 s [14.974 s, 14.974 s]	-
appsec	14.811 s [14.811 s, 14.811 s]	-163.0 ms (-1.1%)
iast	18.563 s [18.563 s, 18.563 s]	3.589 s (24.0%)
iast_GLOBAL	18.007 s [18.007 s, 18.007 s]	3.033 s (20.3%)
profiling	14.951 s [14.951 s, 14.951 s]	-23.0 ms (-0.2%)
tracing	14.731 s [14.731 s, 14.731 s]	-243.0 ms (-1.6%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.9 s [14.9 s, 14.9 s]	-
appsec	14.944 s [14.944 s, 14.944 s]	44.0 ms (0.3%)
iast	18.573 s [18.573 s, 18.573 s]	3.673 s (24.7%)
iast_GLOBAL	18.247 s [18.247 s, 18.247 s]	3.347 s (22.5%)
profiling	15.23 s [15.23 s, 15.23 s]	330.0 ms (2.2%)
tracing	14.543 s [14.543 s, 14.543 s]	-357.0 ms (-2.4%)

dd-java-agent/ddprof-lib/build.gradle

bric3 · 2025-11-08T11:14:08Z

dd-java-agent/ddprof-lib/build.gradle

 apply from: "$rootDir/gradle/java.gradle"

+configurations {
+  def nightly = register('nightlyTestImplementation') {


The variable here is not necessary.

Note however, that if this build file was written with the Kotlin dsl then the variable could have been reused.

dd-java-agent/ddprof-lib/build.gradle

jbachorik · 2025-11-10T14:34:41Z

One thing I'm not sure, is where the nightly gets published ?

Technically, it is not a nightly, but a snapshot built from 'main' after each integration.
And it is published in sonatype snapshots repo.

v0

cb69d71

AlexeyKuznetsov-DD reviewed Nov 7, 2025

View reviewed changes

dd-java-agent/ddprof-lib/build.gradle Show resolved Hide resolved

zhengyu123 requested a review from bric3 November 7, 2025 22:00

bric3 reviewed Nov 10, 2025

View reviewed changes

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Using ddprof nightly snapshot for nightly test #9919

Using ddprof nightly snapshot for nightly test #9919

zhengyu123 commented Nov 7, 2025 •

edited

Loading

Uh oh!

datadog-datadog-prod-us1 bot commented Nov 7, 2025 •

edited by datadog-official bot

Loading

Uh oh!

pr-commenter bot commented Nov 7, 2025

Uh oh!

Uh oh!

bric3 Nov 8, 2025

Uh oh!

Uh oh!

jbachorik commented Nov 10, 2025 •

edited

Loading

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

Using ddprof nightly snapshot for nightly test #9919

Are you sure you want to change the base?

Using ddprof nightly snapshot for nightly test #9919

Conversation

zhengyu123 commented Nov 7, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

datadog-datadog-prod-us1 bot commented Nov 7, 2025 • edited by datadog-official bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

pr-commenter bot commented Nov 7, 2025

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

Uh oh!

bric3 Nov 8, 2025

Choose a reason for hiding this comment

Uh oh!

Uh oh!

jbachorik commented Nov 10, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

zhengyu123 commented Nov 7, 2025 •

edited

Loading

datadog-datadog-prod-us1 bot commented Nov 7, 2025 •

edited by datadog-official bot

Loading

jbachorik commented Nov 10, 2025 •

edited

Loading