Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Revert "Check logs for errors at smoke tests cleanup (#8111)" #8125

Open
wants to merge 1 commit into
base: master
Choose a base branch
from
Open

Revert "Check logs for errors at smoke tests cleanup (#8111)" #8125

wants to merge 1 commit into from

Conversation

smola
Copy link
Member

@smola smola commented Dec 20, 2024 •
edited
Loading

What Does This Do

This reverts commit ab205f6.

Motivation

This led to an increase of failures in master, in particular for variants that we do not run in PRs such as IBM8.
I will bring back this PR together with tweaks from #8123
but at the moment, I'll revert to keep master more stable.

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@smola smola added comp: testing Testing tag: no release notes Changes to exclude from release notes run-tests: all Run all tests labels Dec 20, 2024
@smola smola marked this pull request as ready for review December 20, 2024 16:49
@smola smola requested review from a team as code owners December 20, 2024 16:49
@pr-commenter
Copy link

pr-commenter bot commented Dec 20, 2024

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/revert-check-error-logs
git_commit_date 1734694675 1734712585
git_commit_sha a3e9bda 8c7b630
release_version 1.45.0-SNAPSHOT~a3e9bda406 1.45.0-SNAPSHOT~8c7b630ed0
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1734714958 1734714958
ci_job_id 747254354 747254354
ci_pipeline_id 51666283 51666283
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 58 metrics, 5 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.45.0-SNAPSHOT~8c7b630ed0, baseline=1.45.0-SNAPSHOT~a3e9bda406

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.052 s) : 0, 1052318
Total [baseline] (10.494 s) : 0, 10494419
Agent [candidate] (1.06 s) : 0, 1059670
Total [candidate] (10.398 s) : 0, 10397720
section appsec
Agent [baseline] (1.187 s) : 0, 1186654
Total [baseline] (10.749 s) : 0, 10749304
Agent [candidate] (1.189 s) : 0, 1188929
Total [candidate] (10.721 s) : 0, 10720530
section iast
Agent [baseline] (1.179 s) : 0, 1179056
Total [baseline] (10.98 s) : 0, 10979931
Agent [candidate] (1.175 s) : 0, 1174951
Total [candidate] (10.957 s) : 0, 10957060
section profiling
Agent [baseline] (1.275 s) : 0, 1275137
Total [baseline] (10.862 s) : 0, 10862013
Agent [candidate] (1.297 s) : 0, 1296893
Total [candidate] (10.967 s) : 0, 10967468
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.052 s -
Agent appsec 1.187 s 134.336 ms (12.8%)
Agent iast 1.179 s 126.739 ms (12.0%)
Agent profiling 1.275 s 222.82 ms (21.2%)
Total tracing 10.494 s -
Total appsec 10.749 s 254.885 ms (2.4%)
Total iast 10.98 s 485.512 ms (4.6%)
Total profiling 10.862 s 367.594 ms (3.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.06 s -
Agent appsec 1.189 s 129.259 ms (12.2%)
Agent iast 1.175 s 115.281 ms (10.9%)
Agent profiling 1.297 s 237.223 ms (22.4%)
Total tracing 10.398 s -
Total appsec 10.721 s 322.811 ms (3.1%)
Total iast 10.957 s 559.341 ms (5.4%)
Total profiling 10.967 s 569.748 ms (5.5%) 
gantt
    title petclinic - break down per module: candidate=1.45.0-SNAPSHOT~8c7b630ed0, baseline=1.45.0-SNAPSHOT~a3e9bda406

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (710.477 ms) : 0, 710477
BytebuddyAgent [candidate] (715.769 ms) : 0, 715769
GlobalTracer [baseline] (255.797 ms) : 0, 255797
GlobalTracer [candidate] (257.287 ms) : 0, 257287
AppSec [baseline] (57.983 ms) : 0, 57983
AppSec [candidate] (58.115 ms) : 0, 58115
Remote Config [baseline] (697.24 µs) : 0, 697
Remote Config [candidate] (701.733 µs) : 0, 702
Telemetry [baseline] (12.474 ms) : 0, 12474
Telemetry [candidate] (12.641 ms) : 0, 12641
section appsec
BytebuddyAgent [baseline] (729.219 ms) : 0, 729219
BytebuddyAgent [candidate] (730.389 ms) : 0, 730389
GlobalTracer [baseline] (253.127 ms) : 0, 253127
GlobalTracer [candidate] (253.186 ms) : 0, 253186
AppSec [baseline] (171.123 ms) : 0, 171123
AppSec [candidate] (171.833 ms) : 0, 171833
Remote Config [baseline] (660.677 µs) : 0, 661
Remote Config [candidate] (668.87 µs) : 0, 669
Telemetry [baseline] (7.995 ms) : 0, 7995
Telemetry [candidate] (8.062 ms) : 0, 8062
IAST [baseline] (19.202 ms) : 0, 19202
IAST [candidate] (19.712 ms) : 0, 19712
section iast
BytebuddyAgent [baseline] (829.389 ms) : 0, 829389
BytebuddyAgent [candidate] (826.314 ms) : 0, 826314
GlobalTracer [baseline] (246.868 ms) : 0, 246868
GlobalTracer [candidate] (245.561 ms) : 0, 245561
AppSec [baseline] (57.811 ms) : 0, 57811
AppSec [candidate] (57.945 ms) : 0, 57945
Remote Config [baseline] (667.584 µs) : 0, 668
Remote Config [candidate] (655.129 µs) : 0, 655
Telemetry [baseline] (8.487 ms) : 0, 8487
Telemetry [candidate] (8.427 ms) : 0, 8427
IAST [baseline] (20.975 ms) : 0, 20975
IAST [candidate] (21.14 ms) : 0, 21140
section profiling
ProfilingAgent [baseline] (95.606 ms) : 0, 95606
ProfilingAgent [candidate] (99.19 ms) : 0, 99190
BytebuddyAgent [baseline] (702.591 ms) : 0, 702591
BytebuddyAgent [candidate] (711.571 ms) : 0, 711571
GlobalTracer [baseline] (372.271 ms) : 0, 372271
GlobalTracer [candidate] (379.725 ms) : 0, 379725
AppSec [baseline] (54.067 ms) : 0, 54067
AppSec [candidate] (55.266 ms) : 0, 55266
Remote Config [baseline] (661.28 µs) : 0, 661
Remote Config [candidate] (702.125 µs) : 0, 702
Telemetry [baseline] (7.948 ms) : 0, 7948
Telemetry [candidate] (8.031 ms) : 0, 8031
Profiling [baseline] (95.63 ms) : 0, 95630
Profiling [candidate] (99.216 ms) : 0, 99216
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.45.0-SNAPSHOT~8c7b630ed0, baseline=1.45.0-SNAPSHOT~a3e9bda406

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.049 s) : 0, 1049206
Total [baseline] (8.63 s) : 0, 8630493
Agent [candidate] (1.059 s) : 0, 1059038
Total [candidate] (8.674 s) : 0, 8674243
section iast
Agent [baseline] (1.175 s) : 0, 1175358
Total [baseline] (9.255 s) : 0, 9254540
Agent [candidate] (1.18 s) : 0, 1180062
Total [candidate] (9.252 s) : 0, 9252320
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.177 s) : 0, 1177217
Total [baseline] (9.19 s) : 0, 9189939
Agent [candidate] (1.192 s) : 0, 1191564
Total [candidate] (9.242 s) : 0, 9241772
section iast_TELEMETRY_OFF
Agent [baseline] (1.18 s) : 0, 1179574
Total [baseline] (9.23 s) : 0, 9229562
Agent [candidate] (1.173 s) : 0, 1173174
Total [candidate] (9.179 s) : 0, 9178896
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.049 s -
Agent iast 1.175 s 126.152 ms (12.0%)
Agent iast_HARDCODED_SECRET_DISABLED 1.177 s 128.012 ms (12.2%)
Agent iast_TELEMETRY_OFF 1.18 s 130.368 ms (12.4%)
Total tracing 8.63 s -
Total iast 9.255 s 624.048 ms (7.2%)
Total iast_HARDCODED_SECRET_DISABLED 9.19 s 559.446 ms (6.5%)
Total iast_TELEMETRY_OFF 9.23 s 599.069 ms (6.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.059 s -
Agent iast 1.18 s 121.024 ms (11.4%)
Agent iast_HARDCODED_SECRET_DISABLED 1.192 s 132.526 ms (12.5%)
Agent iast_TELEMETRY_OFF 1.173 s 114.136 ms (10.8%)
Total tracing 8.674 s -
Total iast 9.252 s 578.076 ms (6.7%)
Total iast_HARDCODED_SECRET_DISABLED 9.242 s 567.529 ms (6.5%)
Total iast_TELEMETRY_OFF 9.179 s 504.652 ms (5.8%) 
gantt
    title insecure-bank - break down per module: candidate=1.45.0-SNAPSHOT~8c7b630ed0, baseline=1.45.0-SNAPSHOT~a3e9bda406

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (710.748 ms) : 0, 710748
BytebuddyAgent [candidate] (715.847 ms) : 0, 715847
GlobalTracer [baseline] (255.273 ms) : 0, 255273
GlobalTracer [candidate] (256.938 ms) : 0, 256938
AppSec [baseline] (57.847 ms) : 0, 57847
AppSec [candidate] (57.657 ms) : 0, 57657
Remote Config [baseline] (692.164 µs) : 0, 692
Remote Config [candidate] (698.707 µs) : 0, 699
Telemetry [baseline] (9.772 ms) : 0, 9772
Telemetry [candidate] (12.821 ms) : 0, 12821
section iast
BytebuddyAgent [baseline] (827.3 ms) : 0, 827300
BytebuddyAgent [candidate] (828.798 ms) : 0, 828798
GlobalTracer [baseline] (245.533 ms) : 0, 245533
GlobalTracer [candidate] (248.138 ms) : 0, 248138
AppSec [baseline] (57.426 ms) : 0, 57426
AppSec [candidate] (57.776 ms) : 0, 57776
IAST [baseline] (21.079 ms) : 0, 21079
IAST [candidate] (21.248 ms) : 0, 21248
Remote Config [baseline] (662.306 µs) : 0, 662
Remote Config [candidate] (684.249 µs) : 0, 684
Telemetry [baseline] (8.475 ms) : 0, 8475
Telemetry [candidate] (8.539 ms) : 0, 8539
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (827.505 ms) : 0, 827505
BytebuddyAgent [candidate] (838.699 ms) : 0, 838699
GlobalTracer [baseline] (246.543 ms) : 0, 246543
GlobalTracer [candidate] (248.833 ms) : 0, 248833
AppSec [baseline] (57.823 ms) : 0, 57823
AppSec [candidate] (58.215 ms) : 0, 58215
IAST [baseline] (21.257 ms) : 0, 21257
IAST [candidate] (21.513 ms) : 0, 21513
Remote Config [baseline] (662.342 µs) : 0, 662
Remote Config [candidate] (665.574 µs) : 0, 666
Telemetry [baseline] (8.507 ms) : 0, 8507
Telemetry [candidate] (8.552 ms) : 0, 8552
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (829.309 ms) : 0, 829309
BytebuddyAgent [candidate] (824.573 ms) : 0, 824573
GlobalTracer [baseline] (247.487 ms) : 0, 247487
GlobalTracer [candidate] (246.282 ms) : 0, 246282
AppSec [baseline] (57.789 ms) : 0, 57789
AppSec [candidate] (57.677 ms) : 0, 57677
IAST [baseline] (20.986 ms) : 0, 20986
IAST [candidate] (20.734 ms) : 0, 20734
Remote Config [baseline] (659.091 µs) : 0, 659
Remote Config [candidate] (653.543 µs) : 0, 654
Telemetry [baseline] (8.374 ms) : 0, 8374
Telemetry [candidate] (8.334 ms) : 0, 8334
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-12-20T16:48:13 2024-12-20T16:55:13
git_branch master smola/revert-check-error-logs
git_commit_date 1734694675 1734712585
git_commit_sha a3e9bda 8c7b630
release_version 1.45.0-SNAPSHOT~a3e9bda406 1.45.0-SNAPSHOT~8c7b630ed0
start_time 2024-12-20T16:47:59 2024-12-20T16:54:59
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1734714066 1734714066
ci_job_id 747254355 747254355
ci_pipeline_id 51666283 51666283
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 16 unstable metrics.

Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.45.0-SNAPSHOT~8c7b630ed0, baseline=1.45.0-SNAPSHOT~a3e9bda406
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.353 ms) : 1332, 1374
.   : milestone, 1353,
appsec (1.762 ms) : 1737, 1788
.   : milestone, 1762,
appsec_no_iast (1.786 ms) : 1761, 1810
.   : milestone, 1786,
iast (1.489 ms) : 1466, 1512
.   : milestone, 1489,
profiling (1.528 ms) : 1505, 1552
.   : milestone, 1528,
tracing (1.499 ms) : 1475, 1523
.   : milestone, 1499,
section candidate
no_agent (1.341 ms) : 1322, 1361
.   : milestone, 1341,
appsec (1.75 ms) : 1727, 1774
.   : milestone, 1750,
appsec_no_iast (1.749 ms) : 1723, 1774
.   : milestone, 1749,
iast (1.502 ms) : 1478, 1525
.   : milestone, 1502,
profiling (1.535 ms) : 1511, 1559
.   : milestone, 1535,
tracing (1.506 ms) : 1480, 1531
.   : milestone, 1506,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.353 ms [1.332 ms, 1.374 ms] -
appsec 1.762 ms [1.737 ms, 1.788 ms] 409.258 µs (30.2%)
appsec_no_iast 1.786 ms [1.761 ms, 1.81 ms] 432.712 µs (32.0%)
iast 1.489 ms [1.466 ms, 1.512 ms] 135.875 µs (10.0%)
profiling 1.528 ms [1.505 ms, 1.552 ms] 175.257 µs (13.0%)
tracing 1.499 ms [1.475 ms, 1.523 ms] 146.153 µs (10.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.341 ms [1.322 ms, 1.361 ms] -
appsec 1.75 ms [1.727 ms, 1.774 ms] 409.058 µs (30.5%)
appsec_no_iast 1.749 ms [1.723 ms, 1.774 ms] 407.151 µs (30.4%)
iast 1.502 ms [1.478 ms, 1.525 ms] 160.347 µs (12.0%)
profiling 1.535 ms [1.511 ms, 1.559 ms] 193.732 µs (14.4%)
tracing 1.506 ms [1.48 ms, 1.531 ms] 164.211 µs (12.2%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.45.0-SNAPSHOT~8c7b630ed0, baseline=1.45.0-SNAPSHOT~a3e9bda406
    dateFormat X
    axisFormat %s
section baseline
no_agent (380.902 µs) : 361, 400
.   : milestone, 381,
iast (492.915 µs) : 471, 515
.   : milestone, 493,
iast_FULL (656.226 µs) : 634, 678
.   : milestone, 656,
iast_GLOBAL (520.716 µs) : 499, 542
.   : milestone, 521,
iast_HARDCODED_SECRET_DISABLED (494.24 µs) : 473, 516
.   : milestone, 494,
iast_INACTIVE (458.142 µs) : 436, 480
.   : milestone, 458,
iast_TELEMETRY_OFF (482.373 µs) : 461, 504
.   : milestone, 482,
tracing (458.624 µs) : 438, 480
.   : milestone, 459,
section candidate
no_agent (373.069 µs) : 353, 393
.   : milestone, 373,
iast (501.746 µs) : 479, 525
.   : milestone, 502,
iast_FULL (660.811 µs) : 639, 682
.   : milestone, 661,
iast_GLOBAL (525.889 µs) : 504, 547
.   : milestone, 526,
iast_HARDCODED_SECRET_DISABLED (498.058 µs) : 477, 520
.   : milestone, 498,
iast_INACTIVE (453.483 µs) : 432, 475
.   : milestone, 453,
iast_TELEMETRY_OFF (486.25 µs) : 465, 508
.   : milestone, 486,
tracing (460.07 µs) : 439, 481
.   : milestone, 460,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 380.902 µs [361.322 µs, 400.482 µs] -
iast 492.915 µs [471.038 µs, 514.791 µs] 112.013 µs (29.4%)
iast_FULL 656.226 µs [634.419 µs, 678.033 µs] 275.324 µs (72.3%)
iast_GLOBAL 520.716 µs [499.231 µs, 542.202 µs] 139.814 µs (36.7%)
iast_HARDCODED_SECRET_DISABLED 494.24 µs [472.679 µs, 515.801 µs] 113.338 µs (29.8%)
iast_INACTIVE 458.142 µs [436.485 µs, 479.798 µs] 77.24 µs (20.3%)
iast_TELEMETRY_OFF 482.373 µs [460.771 µs, 503.975 µs] 101.471 µs (26.6%)
tracing 458.624 µs [437.637 µs, 479.612 µs] 77.722 µs (20.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 373.069 µs [353.173 µs, 392.965 µs] -
iast 501.746 µs [478.804 µs, 524.689 µs] 128.677 µs (34.5%)
iast_FULL 660.811 µs [639.181 µs, 682.44 µs] 287.741 µs (77.1%)
iast_GLOBAL 525.889 µs [504.463 µs, 547.316 µs] 152.82 µs (41.0%)
iast_HARDCODED_SECRET_DISABLED 498.058 µs [476.581 µs, 519.535 µs] 124.989 µs (33.5%)
iast_INACTIVE 453.483 µs [432.394 µs, 474.572 µs] 80.414 µs (21.6%)
iast_TELEMETRY_OFF 486.25 µs [464.877 µs, 507.624 µs] 113.181 µs (30.3%)
tracing 460.07 µs [439.044 µs, 481.096 µs] 87.001 µs (23.3%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/revert-check-error-logs
git_commit_date 1734694675 1734712585
git_commit_sha a3e9bda 8c7b630
release_version 1.45.0-SNAPSHOT~a3e9bda406 1.45.0-SNAPSHOT~8c7b630ed0
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1734714618 1734714618
ci_job_id 747254356 747254356
ci_pipeline_id 51666283 51666283
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.45.0-SNAPSHOT~8c7b630ed0, baseline=1.45.0-SNAPSHOT~a3e9bda406
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.479 ms) : 1468, 1491
.   : milestone, 1479,
appsec (2.365 ms) : 2324, 2407
.   : milestone, 2365,
iast (2.112 ms) : 2059, 2165
.   : milestone, 2112,
iast_GLOBAL (2.141 ms) : 2088, 2195
.   : milestone, 2141,
profiling (1.965 ms) : 1923, 2007
.   : milestone, 1965,
tracing (1.937 ms) : 1896, 1977
.   : milestone, 1937,
section candidate
no_agent (1.48 ms) : 1468, 1491
.   : milestone, 1480,
appsec (2.365 ms) : 2323, 2406
.   : milestone, 2365,
iast (2.099 ms) : 2046, 2152
.   : milestone, 2099,
iast_GLOBAL (2.138 ms) : 2085, 2191
.   : milestone, 2138,
profiling (1.961 ms) : 1919, 2003
.   : milestone, 1961,
tracing (1.947 ms) : 1906, 1987
.   : milestone, 1947,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.479 ms [1.468 ms, 1.491 ms] -
appsec 2.365 ms [2.324 ms, 2.407 ms] 886.389 µs (59.9%)
iast 2.112 ms [2.059 ms, 2.165 ms] 632.587 µs (42.8%)
iast_GLOBAL 2.141 ms [2.088 ms, 2.195 ms] 662.289 µs (44.8%)
profiling 1.965 ms [1.923 ms, 2.007 ms] 486.216 µs (32.9%)
tracing 1.937 ms [1.896 ms, 1.977 ms] 457.726 µs (30.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.48 ms [1.468 ms, 1.491 ms] -
appsec 2.365 ms [2.323 ms, 2.406 ms] 884.975 µs (59.8%)
iast 2.099 ms [2.046 ms, 2.152 ms] 619.167 µs (41.8%)
iast_GLOBAL 2.138 ms [2.085 ms, 2.191 ms] 657.979 µs (44.5%)
profiling 1.961 ms [1.919 ms, 2.003 ms] 481.425 µs (32.5%)
tracing 1.947 ms [1.906 ms, 1.987 ms] 466.926 µs (31.6%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.45.0-SNAPSHOT~8c7b630ed0, baseline=1.45.0-SNAPSHOT~a3e9bda406
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.279 s) : 15279000, 15279000
.   : milestone, 15279000,
appsec (14.83 s) : 14830000, 14830000
.   : milestone, 14830000,
iast (18.874 s) : 18874000, 18874000
.   : milestone, 18874000,
iast_GLOBAL (17.951 s) : 17951000, 17951000
.   : milestone, 17951000,
profiling (15.041 s) : 15041000, 15041000
.   : milestone, 15041000,
tracing (14.867 s) : 14867000, 14867000
.   : milestone, 14867000,
section candidate
no_agent (14.911 s) : 14911000, 14911000
.   : milestone, 14911000,
appsec (15.162 s) : 15162000, 15162000
.   : milestone, 15162000,
iast (18.68 s) : 18680000, 18680000
.   : milestone, 18680000,
iast_GLOBAL (18.156 s) : 18156000, 18156000
.   : milestone, 18156000,
profiling (15.443 s) : 15443000, 15443000
.   : milestone, 15443000,
tracing (15.281 s) : 15281000, 15281000
.   : milestone, 15281000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.279 s [15.279 s, 15.279 s] -
appsec 14.83 s [14.83 s, 14.83 s] -449.0 ms (-2.9%)
iast 18.874 s [18.874 s, 18.874 s] 3.595 s (23.5%)
iast_GLOBAL 17.951 s [17.951 s, 17.951 s] 2.672 s (17.5%)
profiling 15.041 s [15.041 s, 15.041 s] -238.0 ms (-1.6%)
tracing 14.867 s [14.867 s, 14.867 s] -412.0 ms (-2.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.911 s [14.911 s, 14.911 s] -
appsec 15.162 s [15.162 s, 15.162 s] 251.0 ms (1.7%)
iast 18.68 s [18.68 s, 18.68 s] 3.769 s (25.3%)
iast_GLOBAL 18.156 s [18.156 s, 18.156 s] 3.245 s (21.8%)
profiling 15.443 s [15.443 s, 15.443 s] 532.0 ms (3.6%)
tracing 15.281 s [15.281 s, 15.281 s] 370.0 ms (2.5%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@ValentinZakharov ValentinZakharov Awaiting requested review from ValentinZakharov ValentinZakharov is a code owner automatically assigned from DataDog/asm-java

@Mariovido Mariovido Awaiting requested review from Mariovido Mariovido is a code owner automatically assigned from DataDog/asm-java

@dougqh dougqh Awaiting requested review from dougqh dougqh is a code owner automatically assigned from DataDog/apm-java

At least 1 approving review is required to merge this pull request.

Assignees
No one assigned
Labels
comp: testing Testing run-tests: all Run all tests tag: no release notes Changes to exclude from release notes
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@smola