K8s Lib Injection tests new scenarios #8103

robertomonteromiguel · 2024-12-17T15:56:50Z

What Does This Do

Change the gitlab pipeline to introduce new scenarios for the k8s lib injection tests

Motivation

The changes are made on system-tests and in the one pipeline we need to adapt the tracers pipelines

Additional Notes

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the public documentation in case of new configuration flag or behavior

Jira ticket: [PROJ-IDENT]

pr-commenter · 2024-12-17T16:41:02Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	robertomonteromiguel/k8s_new_scenarios
git_commit_date	1734517793	1734537787
git_commit_sha	`a19f73a`	`6b6a960`
release_version	1.45.0-SNAPSHOT~a19f73a5ea	1.45.0-SNAPSHOT~6b6a960601

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1734540255	1734540255
ci_job_id	744134616	744134616
ci_pipeline_id	51464662	51464662
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module	Agent	Agent
parent	None	None
variant	iast	iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 52 metrics, 11 unstable metrics.

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.45.0-SNAPSHOT~6b6a960601, baseline=1.45.0-SNAPSHOT~a19f73a5ea

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.09 s) : 0, 1090039
Total [baseline] (8.624 s) : 0, 8623794
Agent [candidate] (1.088 s) : 0, 1088434
Total [candidate] (8.634 s) : 0, 8634320
section iast
Agent [baseline] (1.219 s) : 0, 1218739
Total [baseline] (9.173 s) : 0, 9173083
Agent [candidate] (1.23 s) : 0, 1230022
Total [candidate] (9.227 s) : 0, 9226850
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.229 s) : 0, 1228913
Total [baseline] (9.16 s) : 0, 9159986
Agent [candidate] (1.22 s) : 0, 1219661
Total [candidate] (9.163 s) : 0, 9162621
section iast_TELEMETRY_OFF
Agent [baseline] (1.219 s) : 0, 1219367
Total [baseline] (9.217 s) : 0, 9217231
Agent [candidate] (1.216 s) : 0, 1215715
Total [candidate] (9.152 s) : 0, 9152311

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.09 s	-
Agent	iast	1.219 s	128.699 ms (11.8%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.229 s	138.874 ms (12.7%)
Agent	iast_TELEMETRY_OFF	1.219 s	129.328 ms (11.9%)
Total	tracing	8.624 s	-
Total	iast	9.173 s	549.289 ms (6.4%)
Total	iast_HARDCODED_SECRET_DISABLED	9.16 s	536.191 ms (6.2%)
Total	iast_TELEMETRY_OFF	9.217 s	593.437 ms (6.9%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.088 s	-
Agent	iast	1.23 s	141.588 ms (13.0%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.22 s	131.227 ms (12.1%)
Agent	iast_TELEMETRY_OFF	1.216 s	127.281 ms (11.7%)
Total	tracing	8.634 s	-
Total	iast	9.227 s	592.529 ms (6.9%)
Total	iast_HARDCODED_SECRET_DISABLED	9.163 s	528.301 ms (6.1%)
Total	iast_TELEMETRY_OFF	9.152 s	517.991 ms (6.0%)

gantt
    title insecure-bank - break down per module: candidate=1.45.0-SNAPSHOT~6b6a960601, baseline=1.45.0-SNAPSHOT~a19f73a5ea

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (695.041 ms) : 0, 695041
BytebuddyAgent [candidate] (693.206 ms) : 0, 693206
GlobalTracer [baseline] (316.66 ms) : 0, 316660
GlobalTracer [candidate] (315.362 ms) : 0, 315362
AppSec [baseline] (54.711 ms) : 0, 54711
AppSec [candidate] (54.839 ms) : 0, 54839
Remote Config [baseline] (680.636 µs) : 0, 681
Remote Config [candidate] (694.352 µs) : 0, 694
Telemetry [baseline] (9.244 ms) : 0, 9244
Telemetry [candidate] (10.686 ms) : 0, 10686
section iast
BytebuddyAgent [baseline] (812.048 ms) : 0, 812048
BytebuddyAgent [candidate] (820.352 ms) : 0, 820352
GlobalTracer [baseline] (305.956 ms) : 0, 305956
GlobalTracer [candidate] (307.81 ms) : 0, 307810
AppSec [baseline] (56.672 ms) : 0, 56672
AppSec [candidate] (56.929 ms) : 0, 56929
Remote Config [baseline] (605.675 µs) : 0, 606
Remote Config [candidate] (603.137 µs) : 0, 603
Telemetry [baseline] (7.362 ms) : 0, 7362
Telemetry [candidate] (7.525 ms) : 0, 7525
IAST [baseline] (22.442 ms) : 0, 22442
IAST [candidate] (22.898 ms) : 0, 22898
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (819.529 ms) : 0, 819529
BytebuddyAgent [candidate] (813.052 ms) : 0, 813052
GlobalTracer [baseline] (307.723 ms) : 0, 307723
GlobalTracer [candidate] (305.454 ms) : 0, 305454
AppSec [baseline] (57.554 ms) : 0, 57554
AppSec [candidate] (58.014 ms) : 0, 58014
Remote Config [baseline] (615.106 µs) : 0, 615
Remote Config [candidate] (622.502 µs) : 0, 623
Telemetry [baseline] (7.456 ms) : 0, 7456
Telemetry [candidate] (7.532 ms) : 0, 7532
IAST [baseline] (22.168 ms) : 0, 22168
IAST [candidate] (21.268 ms) : 0, 21268
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (811.275 ms) : 0, 811275
BytebuddyAgent [candidate] (810.225 ms) : 0, 810225
GlobalTracer [baseline] (307.289 ms) : 0, 307289
GlobalTracer [candidate] (305.304 ms) : 0, 305304
AppSec [baseline] (56.649 ms) : 0, 56649
AppSec [candidate] (57.019 ms) : 0, 57019
Remote Config [baseline] (606.264 µs) : 0, 606
Remote Config [candidate] (632.916 µs) : 0, 633
Telemetry [baseline] (7.385 ms) : 0, 7385
Telemetry [candidate] (7.355 ms) : 0, 7355
IAST [baseline] (22.459 ms) : 0, 22459
IAST [candidate] (21.435 ms) : 0, 21435

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.45.0-SNAPSHOT~6b6a960601, baseline=1.45.0-SNAPSHOT~a19f73a5ea

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.095 s) : 0, 1095043
Total [baseline] (10.444 s) : 0, 10444045
Agent [candidate] (1.09 s) : 0, 1090199
Total [candidate] (10.392 s) : 0, 10392315
section appsec
Agent [baseline] (1.223 s) : 0, 1223247
Total [baseline] (10.687 s) : 0, 10687253
Agent [candidate] (1.228 s) : 0, 1227706
Total [candidate] (10.669 s) : 0, 10669419
section iast
Agent [baseline] (1.221 s) : 0, 1221117
Total [baseline] (10.938 s) : 0, 10938279
Agent [candidate] (1.22 s) : 0, 1219841
Total [candidate] (11.012 s) : 0, 11012144
section profiling
Agent [baseline] (1.311 s) : 0, 1311434
Total [baseline] (10.768 s) : 0, 10768164
Agent [candidate] (1.317 s) : 0, 1317209
Total [candidate] (10.828 s) : 0, 10828342

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.095 s	-
Agent	appsec	1.223 s	128.204 ms (11.7%)
Agent	iast	1.221 s	126.074 ms (11.5%)
Agent	profiling	1.311 s	216.391 ms (19.8%)
Total	tracing	10.444 s	-
Total	appsec	10.687 s	243.208 ms (2.3%)
Total	iast	10.938 s	494.233 ms (4.7%)
Total	profiling	10.768 s	324.119 ms (3.1%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.09 s	-
Agent	appsec	1.228 s	137.507 ms (12.6%)
Agent	iast	1.22 s	129.642 ms (11.9%)
Agent	profiling	1.317 s	227.011 ms (20.8%)
Total	tracing	10.392 s	-
Total	appsec	10.669 s	277.104 ms (2.7%)
Total	iast	11.012 s	619.829 ms (6.0%)
Total	profiling	10.828 s	436.027 ms (4.2%)

gantt
    title petclinic - break down per module: candidate=1.45.0-SNAPSHOT~6b6a960601, baseline=1.45.0-SNAPSHOT~a19f73a5ea

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (697.202 ms) : 0, 697202
BytebuddyAgent [candidate] (694.762 ms) : 0, 694762
GlobalTracer [baseline] (318.025 ms) : 0, 318025
GlobalTracer [candidate] (316.442 ms) : 0, 316442
AppSec [baseline] (54.822 ms) : 0, 54822
AppSec [candidate] (54.609 ms) : 0, 54609
Remote Config [baseline] (659.341 µs) : 0, 659
Remote Config [candidate] (672.838 µs) : 0, 673
Telemetry [baseline] (10.668 ms) : 0, 10668
Telemetry [candidate] (10.003 ms) : 0, 10003
section appsec
BytebuddyAgent [baseline] (711.684 ms) : 0, 711684
BytebuddyAgent [candidate] (714.451 ms) : 0, 714451
GlobalTracer [baseline] (313.566 ms) : 0, 313566
GlobalTracer [candidate] (314.437 ms) : 0, 314437
AppSec [baseline] (165.596 ms) : 0, 165596
AppSec [candidate] (166.006 ms) : 0, 166006
Remote Config [baseline] (649.572 µs) : 0, 650
Remote Config [candidate] (656.74 µs) : 0, 657
Telemetry [baseline] (7.816 ms) : 0, 7816
Telemetry [candidate] (8.549 ms) : 0, 8549
IAST [baseline] (20.524 ms) : 0, 20524
IAST [candidate] (19.705 ms) : 0, 19705
section iast
BytebuddyAgent [baseline] (814.052 ms) : 0, 814052
BytebuddyAgent [candidate] (814.1 ms) : 0, 814100
GlobalTracer [baseline] (306.502 ms) : 0, 306502
GlobalTracer [candidate] (305.627 ms) : 0, 305627
AppSec [baseline] (57.132 ms) : 0, 57132
AppSec [candidate] (57.677 ms) : 0, 57677
Remote Config [baseline] (621.483 µs) : 0, 621
Remote Config [candidate] (606.829 µs) : 0, 607
Telemetry [baseline] (7.376 ms) : 0, 7376
Telemetry [candidate] (7.325 ms) : 0, 7325
IAST [baseline] (21.722 ms) : 0, 21722
IAST [candidate] (20.774 ms) : 0, 20774
section profiling
BytebuddyAgent [baseline] (687.473 ms) : 0, 687473
BytebuddyAgent [candidate] (690.096 ms) : 0, 690096
GlobalTracer [baseline] (430.397 ms) : 0, 430397
GlobalTracer [candidate] (432.465 ms) : 0, 432465
AppSec [baseline] (53.308 ms) : 0, 53308
AppSec [candidate] (53.668 ms) : 0, 53668
Remote Config [baseline] (653.304 µs) : 0, 653
Remote Config [candidate] (675.024 µs) : 0, 675
Telemetry [baseline] (7.65 ms) : 0, 7650
Telemetry [candidate] (7.843 ms) : 0, 7843
ProfilingAgent [baseline] (92.938 ms) : 0, 92938
ProfilingAgent [candidate] (93.286 ms) : 0, 93286
Profiling [baseline] (92.962 ms) : 0, 92962
Profiling [candidate] (93.309 ms) : 0, 93309

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
end_time	2024-12-18T16:14:26	2024-12-18T16:21:27
git_branch	master	robertomonteromiguel/k8s_new_scenarios
git_commit_date	1734517793	1734537787
git_commit_sha	`a19f73a`	`6b6a960`
release_version	1.45.0-SNAPSHOT~a19f73a5ea	1.45.0-SNAPSHOT~6b6a960601
start_time	2024-12-18T16:14:13	2024-12-18T16:21:13

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1734539241	1734539241
ci_job_id	744134617	744134617
ci_pipeline_id	51464662	51464662
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant	iast	iast

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 15 unstable metrics.

scenario	Δ mean http_req_duration	Δ mean throughput	candidate mean http_req_duration	candidate mean throughput	baseline mean http_req_duration	baseline mean throughput
scenario:load:petclinic:profiling	better [-92.712µs; -39.562µs] or [-5.888%; -2.513%]	unstable [-439.182op/s; +667.102op/s] or [-14.822%; +22.515%]	1.508ms	3076.923op/s	1.575ms	2962.963op/s

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.45.0-SNAPSHOT~6b6a960601, baseline=1.45.0-SNAPSHOT~a19f73a5ea
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.36 ms) : 1340, 1379
.   : milestone, 1360,
appsec (1.75 ms) : 1728, 1772
.   : milestone, 1750,
appsec_no_iast (1.766 ms) : 1741, 1791
.   : milestone, 1766,
iast (1.484 ms) : 1461, 1508
.   : milestone, 1484,
profiling (1.575 ms) : 1548, 1601
.   : milestone, 1575,
tracing (1.503 ms) : 1480, 1527
.   : milestone, 1503,
section candidate
no_agent (1.373 ms) : 1353, 1392
.   : milestone, 1373,
appsec (1.75 ms) : 1726, 1773
.   : milestone, 1750,
appsec_no_iast (1.743 ms) : 1717, 1769
.   : milestone, 1743,
iast (1.516 ms) : 1493, 1539
.   : milestone, 1516,
profiling (1.508 ms) : 1485, 1531
.   : milestone, 1508,
tracing (1.501 ms) : 1477, 1525
.   : milestone, 1501,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.36 ms [1.34 ms, 1.379 ms]	-
appsec	1.75 ms [1.728 ms, 1.772 ms]	390.045 µs (28.7%)
appsec_no_iast	1.766 ms [1.741 ms, 1.791 ms]	406.102 µs (29.9%)
iast	1.484 ms [1.461 ms, 1.508 ms]	124.452 µs (9.2%)
profiling	1.575 ms [1.548 ms, 1.601 ms]	214.617 µs (15.8%)
tracing	1.503 ms [1.48 ms, 1.527 ms]	143.347 µs (10.5%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.373 ms [1.353 ms, 1.392 ms]	-
appsec	1.75 ms [1.726 ms, 1.773 ms]	376.965 µs (27.5%)
appsec_no_iast	1.743 ms [1.717 ms, 1.769 ms]	369.973 µs (26.9%)
iast	1.516 ms [1.493 ms, 1.539 ms]	142.938 µs (10.4%)
profiling	1.508 ms [1.485 ms, 1.531 ms]	135.568 µs (9.9%)
tracing	1.501 ms [1.477 ms, 1.525 ms]	128.177 µs (9.3%)

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.45.0-SNAPSHOT~6b6a960601, baseline=1.45.0-SNAPSHOT~a19f73a5ea
    dateFormat X
    axisFormat %s
section baseline
no_agent (371.181 µs) : 351, 391
.   : milestone, 371,
iast (498.721 µs) : 477, 520
.   : milestone, 499,
iast_FULL (650.519 µs) : 629, 672
.   : milestone, 651,
iast_GLOBAL (519.908 µs) : 499, 541
.   : milestone, 520,
iast_HARDCODED_SECRET_DISABLED (497.732 µs) : 476, 520
.   : milestone, 498,
iast_INACTIVE (462.174 µs) : 441, 484
.   : milestone, 462,
iast_TELEMETRY_OFF (490.922 µs) : 469, 513
.   : milestone, 491,
tracing (458.835 µs) : 437, 480
.   : milestone, 459,
section candidate
no_agent (380.528 µs) : 359, 402
.   : milestone, 381,
iast (503.532 µs) : 482, 525
.   : milestone, 504,
iast_FULL (660.719 µs) : 639, 683
.   : milestone, 661,
iast_GLOBAL (524.904 µs) : 503, 547
.   : milestone, 525,
iast_HARDCODED_SECRET_DISABLED (499.979 µs) : 478, 522
.   : milestone, 500,
iast_INACTIVE (460.854 µs) : 439, 482
.   : milestone, 461,
iast_TELEMETRY_OFF (494.979 µs) : 473, 517
.   : milestone, 495,
tracing (452.329 µs) : 431, 473
.   : milestone, 452,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	371.181 µs [350.965 µs, 391.398 µs]	-
iast	498.721 µs [477.387 µs, 520.054 µs]	127.54 µs (34.4%)
iast_FULL	650.519 µs [628.931 µs, 672.107 µs]	279.338 µs (75.3%)
iast_GLOBAL	519.908 µs [498.593 µs, 541.223 µs]	148.727 µs (40.1%)
iast_HARDCODED_SECRET_DISABLED	497.732 µs [475.701 µs, 519.764 µs]	126.551 µs (34.1%)
iast_INACTIVE	462.174 µs [440.725 µs, 483.623 µs]	90.993 µs (24.5%)
iast_TELEMETRY_OFF	490.922 µs [469.263 µs, 512.581 µs]	119.74 µs (32.3%)
tracing	458.835 µs [437.244 µs, 480.425 µs]	87.653 µs (23.6%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	380.528 µs [359.236 µs, 401.82 µs]	-
iast	503.532 µs [481.596 µs, 525.467 µs]	123.003 µs (32.3%)
iast_FULL	660.719 µs [638.936 µs, 682.503 µs]	280.191 µs (73.6%)
iast_GLOBAL	524.904 µs [502.966 µs, 546.842 µs]	144.376 µs (37.9%)
iast_HARDCODED_SECRET_DISABLED	499.979 µs [478.178 µs, 521.78 µs]	119.45 µs (31.4%)
iast_INACTIVE	460.854 µs [439.396 µs, 482.313 µs]	80.326 µs (21.1%)
iast_TELEMETRY_OFF	494.979 µs [472.751 µs, 517.207 µs]	114.45 µs (30.1%)
tracing	452.329 µs [431.418 µs, 473.239 µs]	71.8 µs (18.9%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	robertomonteromiguel/k8s_new_scenarios
git_commit_date	1734517793	1734537787
git_commit_sha	`a19f73a`	`6b6a960`
release_version	1.45.0-SNAPSHOT~a19f73a5ea	1.45.0-SNAPSHOT~6b6a960601

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1734539787	1734539787
ci_job_id	744134618	744134618
ci_pipeline_id	51464662	51464662
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant	appsec	appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.45.0-SNAPSHOT~6b6a960601, baseline=1.45.0-SNAPSHOT~a19f73a5ea
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.465 ms) : 1454, 1476
.   : milestone, 1465,
appsec (2.339 ms) : 2297, 2380
.   : milestone, 2339,
iast (2.093 ms) : 2040, 2146
.   : milestone, 2093,
iast_GLOBAL (2.136 ms) : 2082, 2189
.   : milestone, 2136,
profiling (1.946 ms) : 1904, 1989
.   : milestone, 1946,
tracing (1.921 ms) : 1880, 1961
.   : milestone, 1921,
section candidate
no_agent (1.464 ms) : 1453, 1476
.   : milestone, 1464,
appsec (2.346 ms) : 2305, 2388
.   : milestone, 2346,
iast (2.089 ms) : 2037, 2142
.   : milestone, 2089,
iast_GLOBAL (2.136 ms) : 2082, 2189
.   : milestone, 2136,
profiling (1.955 ms) : 1913, 1998
.   : milestone, 1955,
tracing (1.927 ms) : 1886, 1968
.   : milestone, 1927,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.465 ms [1.454 ms, 1.476 ms]	-
appsec	2.339 ms [2.297 ms, 2.38 ms]	873.713 µs (59.6%)
iast	2.093 ms [2.04 ms, 2.146 ms]	628.152 µs (42.9%)
iast_GLOBAL	2.136 ms [2.082 ms, 2.189 ms]	670.65 µs (45.8%)
profiling	1.946 ms [1.904 ms, 1.989 ms]	481.213 µs (32.8%)
tracing	1.921 ms [1.88 ms, 1.961 ms]	455.893 µs (31.1%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.464 ms [1.453 ms, 1.476 ms]	-
appsec	2.346 ms [2.305 ms, 2.388 ms]	882.19 µs (60.3%)
iast	2.089 ms [2.037 ms, 2.142 ms]	625.331 µs (42.7%)
iast_GLOBAL	2.136 ms [2.082 ms, 2.189 ms]	671.741 µs (45.9%)
profiling	1.955 ms [1.913 ms, 1.998 ms]	491.298 µs (33.6%)
tracing	1.927 ms [1.886 ms, 1.968 ms]	462.906 µs (31.6%)

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.45.0-SNAPSHOT~6b6a960601, baseline=1.45.0-SNAPSHOT~a19f73a5ea
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.946 s) : 14946000, 14946000
.   : milestone, 14946000,
appsec (15.092 s) : 15092000, 15092000
.   : milestone, 15092000,
iast (18.923 s) : 18923000, 18923000
.   : milestone, 18923000,
iast_GLOBAL (18.151 s) : 18151000, 18151000
.   : milestone, 18151000,
profiling (14.889 s) : 14889000, 14889000
.   : milestone, 14889000,
tracing (15.084 s) : 15084000, 15084000
.   : milestone, 15084000,
section candidate
no_agent (15.626 s) : 15626000, 15626000
.   : milestone, 15626000,
appsec (14.766 s) : 14766000, 14766000
.   : milestone, 14766000,
iast (18.627 s) : 18627000, 18627000
.   : milestone, 18627000,
iast_GLOBAL (18.0 s) : 18000000, 18000000
.   : milestone, 18000000,
profiling (14.776 s) : 14776000, 14776000
.   : milestone, 14776000,
tracing (15.04 s) : 15040000, 15040000
.   : milestone, 15040000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.946 s [14.946 s, 14.946 s]	-
appsec	15.092 s [15.092 s, 15.092 s]	146.0 ms (1.0%)
iast	18.923 s [18.923 s, 18.923 s]	3.977 s (26.6%)
iast_GLOBAL	18.151 s [18.151 s, 18.151 s]	3.205 s (21.4%)
profiling	14.889 s [14.889 s, 14.889 s]	-57.0 ms (-0.4%)
tracing	15.084 s [15.084 s, 15.084 s]	138.0 ms (0.9%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.626 s [15.626 s, 15.626 s]	-
appsec	14.766 s [14.766 s, 14.766 s]	-860.0 ms (-5.5%)
iast	18.627 s [18.627 s, 18.627 s]	3.001 s (19.2%)
iast_GLOBAL	18.0 s [18.0 s, 18.0 s]	2.374 s (15.2%)
profiling	14.776 s [14.776 s, 14.776 s]	-850.0 ms (-5.4%)
tracing	15.04 s [15.04 s, 15.04 s]	-586.0 ms (-3.8%)

henryvo117 · 2024-12-18T14:13:40Z

/gitlab trigger-ci

dd-devflow · 2024-12-18T14:13:57Z

Devflow running: `/gitlab trigger-ci`

View all feedbacks in Devflow UI.

2024-12-18 14:13:57 UTC ℹ️ Branch synced on Gitlab

Branch robertomonteromiguel/k8s_new_scenarios was out-of-sync on Gitlab - it has been resynced

If you need support, contact us on Slack #devflow!

2024-12-18 14:15:47 UTC 🚨 Devflow

POST https://gitlab.ddbuild.io/api/v4/projects/DataDog/apm-reliability/dd-trace-java/pipeline: 500 {message: 500 Internal Server Error}

Details

child workflow execution error (type: devflow.Devflow_TriggerCiFromPr, workflowID: 5d768b7b-6a62-44db-af1e-fa1ba1e7628f_26, runID: 4efa1949-58cd-4c0f-8111-a0bc6bb08f17, initiatedEventID: 26, startedEventID: 27): child workflow execution error (type: devflow.Devflow_TriggerCi, workflowID: 4efa1949-58cd-4c0f-8111-a0bc6bb08f17_14, runID: bcf13e47-1eb3-477f-bf3c-7892e7bed366, initiatedEventID: 14, startedEventID: 15): activity error (type: gitlab.GitlabService_CreatePipeline, scheduledEventID: 55, startedEventID: 56, identity: 1@gitlab-worker-5969dc8fcb-p5srn@): POST https://gitlab.ddbuild.io/api/v4/projects/DataDog/apm-reliability/dd-trace-java/pipeline: 500 {message: 500 Internal Server Error} (type: ErrorResponse, retryable: true)

If you need support, contact us on Slack #devflow with those details!

henryvo117 · 2024-12-18T14:19:20Z

/gitlab trigger-ci

dd-devflow · 2024-12-18T14:19:37Z

Devflow running: `/gitlab trigger-ci`

View all feedbacks in Devflow UI.

2024-12-18 14:19:36 UTC ℹ️ Branch synced on Gitlab

Branch robertomonteromiguel/k8s_new_scenarios was out-of-sync on Gitlab - it has been resynced

If you need support, contact us on Slack #devflow!

2024-12-18 14:21:29 UTC 🚨 Devflow

POST https://gitlab.ddbuild.io/api/v4/projects/DataDog/apm-reliability/dd-trace-java/pipeline: 500 {message: 500 Internal Server Error}

Details

child workflow execution error (type: devflow.Devflow_TriggerCiFromPr, workflowID: fb237ae3-782f-4480-8619-d706010f4f51_26, runID: 78a4cd9b-9ca6-46a8-a1c5-0016e4649bac, initiatedEventID: 26, startedEventID: 27): child workflow execution error (type: devflow.Devflow_TriggerCi, workflowID: 78a4cd9b-9ca6-46a8-a1c5-0016e4649bac_14, runID: f039fb70-5010-4cc2-8115-e6b851e0f246, initiatedEventID: 14, startedEventID: 15): activity error (type: gitlab.GitlabService_CreatePipeline, scheduledEventID: 55, startedEventID: 56, identity: 1@gitlab-worker-5969dc8fcb-p5srn@): POST https://gitlab.ddbuild.io/api/v4/projects/DataDog/apm-reliability/dd-trace-java/pipeline: 500 {message: 500 Internal Server Error} (type: ErrorResponse, retryable: true)

If you need support, contact us on Slack #devflow with those details!

robertomonteromiguel added 2 commits December 17, 2024 16:55

K8s Lib Injection tests new scenarios

fe3af0a

all new k8s scenarios added

b004a17

robertomonteromiguel added 2 commits December 18, 2024 13:07

fix spark app name

65391f5

Restore gitlab to test onepipeline

dd35259

restore ci

6b6a960

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

K8s Lib Injection tests new scenarios #8103

K8s Lib Injection tests new scenarios #8103

robertomonteromiguel commented Dec 17, 2024

pr-commenter bot commented Dec 17, 2024 •

edited

Loading

henryvo117 commented Dec 18, 2024

dd-devflow bot commented Dec 18, 2024 •

edited

Loading

henryvo117 commented Dec 18, 2024

dd-devflow bot commented Dec 18, 2024 •

edited

Loading

K8s Lib Injection tests new scenarios #8103

Are you sure you want to change the base?

K8s Lib Injection tests new scenarios #8103

Conversation

robertomonteromiguel commented Dec 17, 2024

What Does This Do

Motivation

Additional Notes

Contributor Checklist

pr-commenter bot commented Dec 17, 2024 • edited Loading

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

henryvo117 commented Dec 18, 2024

dd-devflow bot commented Dec 18, 2024 • edited Loading

Devflow running: /gitlab trigger-ci

henryvo117 commented Dec 18, 2024

dd-devflow bot commented Dec 18, 2024 • edited Loading

Devflow running: /gitlab trigger-ci

pr-commenter bot commented Dec 17, 2024 •

edited

Loading

dd-devflow bot commented Dec 18, 2024 •

edited

Loading

Devflow running: `/gitlab trigger-ci`

dd-devflow bot commented Dec 18, 2024 •

edited

Loading

Devflow running: `/gitlab trigger-ci`