-
Notifications
You must be signed in to change notification settings - Fork 291
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[WIP] Add file attribute to JUnit reports #8085
base: master
Are you sure you want to change the base?
Conversation
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 57 metrics, 6 unstable metrics. Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.45.0-SNAPSHOT~5f361b69f8, baseline=1.45.0-SNAPSHOT~a3e9bda406
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.059 s) : 0, 1058533
Total [baseline] (8.57 s) : 0, 8570192
Agent [candidate] (1.06 s) : 0, 1059629
Total [candidate] (8.626 s) : 0, 8626383
section iast
Agent [baseline] (1.184 s) : 0, 1183788
Total [baseline] (9.177 s) : 0, 9177269
Agent [candidate] (1.177 s) : 0, 1177401
Total [candidate] (9.162 s) : 0, 9162234
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.173 s) : 0, 1172892
Total [baseline] (9.144 s) : 0, 9143769
Agent [candidate] (1.185 s) : 0, 1185469
Total [candidate] (9.193 s) : 0, 9192573
section iast_TELEMETRY_OFF
Agent [baseline] (1.172 s) : 0, 1171946
Total [baseline] (9.165 s) : 0, 9164690
Agent [candidate] (1.17 s) : 0, 1170058
Total [candidate] (9.171 s) : 0, 9170897
gantt
title insecure-bank - break down per module: candidate=1.45.0-SNAPSHOT~5f361b69f8, baseline=1.45.0-SNAPSHOT~a3e9bda406
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (715.101 ms) : 0, 715101
BytebuddyAgent [candidate] (715.488 ms) : 0, 715488
GlobalTracer [baseline] (256.334 ms) : 0, 256334
GlobalTracer [candidate] (257.123 ms) : 0, 257123
AppSec [baseline] (58.111 ms) : 0, 58111
AppSec [candidate] (58.291 ms) : 0, 58291
Remote Config [baseline] (689.098 µs) : 0, 689
Remote Config [candidate] (698.74 µs) : 0, 699
Telemetry [baseline] (13.313 ms) : 0, 13313
Telemetry [candidate] (12.984 ms) : 0, 12984
section iast
BytebuddyAgent [baseline] (834.023 ms) : 0, 834023
BytebuddyAgent [candidate] (828.692 ms) : 0, 828692
GlobalTracer [baseline] (247.154 ms) : 0, 247154
GlobalTracer [candidate] (246.235 ms) : 0, 246235
AppSec [baseline] (57.361 ms) : 0, 57361
AppSec [candidate] (57.673 ms) : 0, 57673
IAST [baseline] (21.124 ms) : 0, 21124
IAST [candidate] (20.93 ms) : 0, 20930
Remote Config [baseline] (651.617 µs) : 0, 652
Remote Config [candidate] (639.682 µs) : 0, 640
Telemetry [baseline] (8.533 ms) : 0, 8533
Telemetry [candidate] (8.389 ms) : 0, 8389
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (823.981 ms) : 0, 823981
BytebuddyAgent [candidate] (833.72 ms) : 0, 833720
GlobalTracer [baseline] (245.808 ms) : 0, 245808
GlobalTracer [candidate] (247.906 ms) : 0, 247906
AppSec [baseline] (57.897 ms) : 0, 57897
AppSec [candidate] (58.481 ms) : 0, 58481
IAST [baseline] (21.337 ms) : 0, 21337
IAST [candidate] (21.178 ms) : 0, 21178
Remote Config [baseline] (662.287 µs) : 0, 662
Remote Config [candidate] (654.269 µs) : 0, 654
Telemetry [baseline] (8.413 ms) : 0, 8413
Telemetry [candidate] (8.472 ms) : 0, 8472
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (823.855 ms) : 0, 823855
BytebuddyAgent [candidate] (822.247 ms) : 0, 822247
GlobalTracer [baseline] (245.931 ms) : 0, 245931
GlobalTracer [candidate] (245.837 ms) : 0, 245837
AppSec [baseline] (57.715 ms) : 0, 57715
AppSec [candidate] (57.523 ms) : 0, 57523
IAST [baseline] (20.662 ms) : 0, 20662
IAST [candidate] (20.642 ms) : 0, 20642
Remote Config [baseline] (643.193 µs) : 0, 643
Remote Config [candidate] (639.788 µs) : 0, 640
Telemetry [baseline] (8.305 ms) : 0, 8305
Telemetry [candidate] (8.314 ms) : 0, 8314
Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.45.0-SNAPSHOT~5f361b69f8, baseline=1.45.0-SNAPSHOT~a3e9bda406
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.05 s) : 0, 1050429
Total [baseline] (10.346 s) : 0, 10345659
Agent [candidate] (1.051 s) : 0, 1051085
Total [candidate] (10.358 s) : 0, 10357740
section appsec
Agent [baseline] (1.185 s) : 0, 1184618
Total [baseline] (10.69 s) : 0, 10690026
Agent [candidate] (1.199 s) : 0, 1199197
Total [candidate] (10.717 s) : 0, 10716576
section iast
Agent [baseline] (1.175 s) : 0, 1174984
Total [baseline] (10.948 s) : 0, 10948241
Agent [candidate] (1.176 s) : 0, 1176115
Total [candidate] (10.909 s) : 0, 10908507
section profiling
Agent [baseline] (1.277 s) : 0, 1276984
Total [baseline] (10.808 s) : 0, 10807628
Agent [candidate] (1.274 s) : 0, 1273917
Total [candidate] (10.772 s) : 0, 10772112
gantt
title petclinic - break down per module: candidate=1.45.0-SNAPSHOT~5f361b69f8, baseline=1.45.0-SNAPSHOT~a3e9bda406
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (710.072 ms) : 0, 710072
BytebuddyAgent [candidate] (710.627 ms) : 0, 710627
GlobalTracer [baseline] (255.766 ms) : 0, 255766
GlobalTracer [candidate] (255.776 ms) : 0, 255776
AppSec [baseline] (57.809 ms) : 0, 57809
AppSec [candidate] (58.52 ms) : 0, 58520
Remote Config [baseline] (680.764 µs) : 0, 681
Remote Config [candidate] (689.112 µs) : 0, 689
Telemetry [baseline] (11.132 ms) : 0, 11132
Telemetry [candidate] (10.54 ms) : 0, 10540
section appsec
BytebuddyAgent [baseline] (728.124 ms) : 0, 728124
BytebuddyAgent [candidate] (738.722 ms) : 0, 738722
GlobalTracer [baseline] (252.427 ms) : 0, 252427
GlobalTracer [candidate] (255.491 ms) : 0, 255491
AppSec [baseline] (170.582 ms) : 0, 170582
AppSec [candidate] (171.17 ms) : 0, 171170
IAST [baseline] (19.349 ms) : 0, 19349
IAST [candidate] (19.336 ms) : 0, 19336
Remote Config [baseline] (653.319 µs) : 0, 653
Remote Config [candidate] (663.197 µs) : 0, 663
Telemetry [baseline] (8.297 ms) : 0, 8297
Telemetry [candidate] (8.365 ms) : 0, 8365
section iast
BytebuddyAgent [baseline] (826.942 ms) : 0, 826942
BytebuddyAgent [candidate] (827.245 ms) : 0, 827245
GlobalTracer [baseline] (245.564 ms) : 0, 245564
GlobalTracer [candidate] (246.238 ms) : 0, 246238
AppSec [baseline] (57.486 ms) : 0, 57486
AppSec [candidate] (57.463 ms) : 0, 57463
IAST [baseline] (21.097 ms) : 0, 21097
IAST [candidate] (21.145 ms) : 0, 21145
Remote Config [baseline] (646.694 µs) : 0, 647
Remote Config [candidate] (652.672 µs) : 0, 653
Telemetry [baseline] (8.369 ms) : 0, 8369
Telemetry [candidate] (8.465 ms) : 0, 8465
section profiling
BytebuddyAgent [baseline] (703.311 ms) : 0, 703311
BytebuddyAgent [candidate] (700.556 ms) : 0, 700556
GlobalTracer [baseline] (372.609 ms) : 0, 372609
GlobalTracer [candidate] (373.261 ms) : 0, 373261
AppSec [baseline] (54.169 ms) : 0, 54169
AppSec [candidate] (54.314 ms) : 0, 54314
Remote Config [baseline] (654.872 µs) : 0, 655
Remote Config [candidate] (656.049 µs) : 0, 656
Telemetry [baseline] (7.951 ms) : 0, 7951
Telemetry [candidate] (7.886 ms) : 0, 7886
ProfilingAgent [baseline] (96.461 ms) : 0, 96461
ProfilingAgent [candidate] (95.535 ms) : 0, 95535
Profiling [baseline] (96.484 ms) : 0, 96484
Profiling [candidate] (95.558 ms) : 0, 95558
LoadParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 13 metrics, 15 unstable metrics. Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.45.0-SNAPSHOT~5f361b69f8, baseline=1.45.0-SNAPSHOT~e8e9292d06
dateFormat X
axisFormat %s
section baseline
no_agent (1.345 ms) : 1326, 1365
. : milestone, 1345,
appsec (1.737 ms) : 1713, 1761
. : milestone, 1737,
appsec_no_iast (1.773 ms) : 1748, 1798
. : milestone, 1773,
iast (1.488 ms) : 1464, 1512
. : milestone, 1488,
profiling (1.512 ms) : 1487, 1536
. : milestone, 1512,
tracing (1.454 ms) : 1430, 1479
. : milestone, 1454,
section candidate
no_agent (1.336 ms) : 1317, 1356
. : milestone, 1336,
appsec (1.753 ms) : 1730, 1777
. : milestone, 1753,
appsec_no_iast (1.738 ms) : 1714, 1763
. : milestone, 1738,
iast (1.508 ms) : 1485, 1530
. : milestone, 1508,
profiling (1.503 ms) : 1480, 1527
. : milestone, 1503,
tracing (1.477 ms) : 1452, 1502
. : milestone, 1477,
Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.45.0-SNAPSHOT~5f361b69f8, baseline=1.45.0-SNAPSHOT~e8e9292d06
dateFormat X
axisFormat %s
section baseline
no_agent (370.974 µs) : 351, 391
. : milestone, 371,
iast (490.884 µs) : 469, 513
. : milestone, 491,
iast_FULL (647.229 µs) : 626, 669
. : milestone, 647,
iast_GLOBAL (521.838 µs) : 500, 544
. : milestone, 522,
iast_HARDCODED_SECRET_DISABLED (488.569 µs) : 467, 510
. : milestone, 489,
iast_INACTIVE (450.484 µs) : 429, 472
. : milestone, 450,
iast_TELEMETRY_OFF (479.466 µs) : 457, 502
. : milestone, 479,
tracing (444.233 µs) : 424, 465
. : milestone, 444,
section candidate
no_agent (367.26 µs) : 348, 387
. : milestone, 367,
iast (491.553 µs) : 469, 514
. : milestone, 492,
iast_FULL (650.384 µs) : 629, 672
. : milestone, 650,
iast_GLOBAL (514.763 µs) : 493, 536
. : milestone, 515,
iast_HARDCODED_SECRET_DISABLED (485.641 µs) : 464, 507
. : milestone, 486,
iast_INACTIVE (450.321 µs) : 430, 471
. : milestone, 450,
iast_TELEMETRY_OFF (476.9 µs) : 455, 498
. : milestone, 477,
tracing (439.047 µs) : 419, 459
. : milestone, 439,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics. Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.45.0-SNAPSHOT~5f361b69f8, baseline=1.45.0-SNAPSHOT~e8e9292d06
dateFormat X
axisFormat %s
section baseline
no_agent (14.672 s) : 14672000, 14672000
. : milestone, 14672000,
appsec (14.958 s) : 14958000, 14958000
. : milestone, 14958000,
iast (18.45 s) : 18450000, 18450000
. : milestone, 18450000,
iast_GLOBAL (17.736 s) : 17736000, 17736000
. : milestone, 17736000,
profiling (15.011 s) : 15011000, 15011000
. : milestone, 15011000,
tracing (14.732 s) : 14732000, 14732000
. : milestone, 14732000,
section candidate
no_agent (14.934 s) : 14934000, 14934000
. : milestone, 14934000,
appsec (15.227 s) : 15227000, 15227000
. : milestone, 15227000,
iast (18.464 s) : 18464000, 18464000
. : milestone, 18464000,
iast_GLOBAL (17.708 s) : 17708000, 17708000
. : milestone, 17708000,
profiling (14.744 s) : 14744000, 14744000
. : milestone, 14744000,
tracing (14.793 s) : 14793000, 14793000
. : milestone, 14793000,
Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.45.0-SNAPSHOT~5f361b69f8, baseline=1.45.0-SNAPSHOT~e8e9292d06
dateFormat X
axisFormat %s
section baseline
no_agent (1.47 ms) : 1458, 1481
. : milestone, 1470,
appsec (2.354 ms) : 2312, 2396
. : milestone, 2354,
iast (2.089 ms) : 2036, 2142
. : milestone, 2089,
iast_GLOBAL (2.136 ms) : 2082, 2189
. : milestone, 2136,
profiling (1.965 ms) : 1922, 2008
. : milestone, 1965,
tracing (1.942 ms) : 1901, 1983
. : milestone, 1942,
section candidate
no_agent (1.472 ms) : 1460, 1483
. : milestone, 1472,
appsec (2.349 ms) : 2307, 2390
. : milestone, 2349,
iast (2.09 ms) : 2038, 2143
. : milestone, 2090,
iast_GLOBAL (2.133 ms) : 2080, 2186
. : milestone, 2133,
profiling (1.967 ms) : 1924, 2009
. : milestone, 1967,
tracing (1.935 ms) : 1894, 1976
. : milestone, 1935,
|
72901ad
to
f44c08c
Compare
Hi! 👋 Looks like you updated a Git Submodule.
|
f44c08c
to
5f361b6
Compare
Hi! 👋 Looks like you updated a Git Submodule.
|
@@ -872,6 +876,7 @@ class JDBCInstrumentationV0Test extends JDBCInstrumentationTest { | |||
} | |||
} | |||
|
|||
TestSourceFileExtension |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
this should be inside extendwith?
What Does This Do
This PR adds a script that appends a
file
attribute to each XML file that is uploaded to CI.Motivation
The motivation behind this PR is to eventually add the codeowners tag to our tests. This PR would be step 2 under "Using the Github Integration" in this doc.
Additional Notes
Contributor Checklist
type:
and (comp:
orinst:
) labels in addition to any usefull labelsclose
,fix
or any linking keywords when referencing an issue.Use
solves
instead, and assign the PR milestone to the issueLANGPLAT-80