Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ci: update docker/bake-action #967

Merged
merged 1 commit into from
Mar 25, 2025
Merged

ci: update docker/bake-action #967

merged 1 commit into from
Mar 25, 2025

Conversation

morrisonlevi
Copy link
Contributor

What does this PR do?

A brief description of the change being made with this pull request.

Motivation

What inspired you to submit this pull request?

Additional Notes

Anything else we should know when reviewing?

How to test the change?

Describe here in detail how the change can be validated.

@pr-commenter
Copy link

pr-commenter bot commented Mar 24, 2025

Benchmarks

Comparison

Benchmark execution time: 2025-03-24 19:15:18

Comparing candidate commit 92c1f2e in PR branch levi/fix-bake-action with baseline commit ffd213b in branch main.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 52 metrics, 2 unstable metrics.

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 92c1f2e 1742842862 levi/fix-bake-action
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.892µs 3.914µs ± 0.004µs 3.914µs ± 0.002µs 3.916µs 3.921µs 3.922µs 3.923µs 0.23% -0.661 4.507 0.10% 0.000µs 1 200
credit_card/is_card_number/ throughput 254911128.167op/s 255490512.815op/s ± 246408.200op/s 255496345.140op/s ± 128893.086op/s 255610543.942op/s 255867456.997op/s 255933702.872op/s 256904767.935op/s 0.55% 0.678 4.599 0.10% 17423.691op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 81.967µs 82.676µs ± 0.360µs 82.613µs ± 0.235µs 82.874µs 83.288µs 83.772µs 83.961µs 1.63% 0.939 0.902 0.43% 0.025µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 11910318.647op/s 12095673.953op/s ± 52425.586op/s 12104658.479op/s ± 34452.027op/s 12136388.535op/s 12160463.038op/s 12177149.637op/s 12200079.694op/s 0.79% -0.913 0.829 0.43% 3707.049op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 76.466µs 77.099µs ± 0.411µs 77.025µs ± 0.248µs 77.341µs 77.742µs 78.736µs 78.976µs 2.53% 1.505 4.071 0.53% 0.029µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 12662070.854op/s 12970644.415op/s ± 68651.108op/s 12982796.497op/s ± 41951.831op/s 13018315.509op/s 13054336.348op/s 13071388.010op/s 13077660.378op/s 0.73% -1.446 3.779 0.53% 4854.366op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.895µs 3.915µs ± 0.007µs 3.914µs ± 0.002µs 3.916µs 3.920µs 3.922µs 3.976µs 1.60% 6.701 58.655 0.17% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 251481710.363op/s 255450797.834op/s ± 426363.513op/s 255496817.612op/s ± 98990.531op/s 255585604.149op/s 255785048.008op/s 255935403.623op/s 256761408.881op/s 0.49% -6.622 57.815 0.17% 30148.453op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 72.789µs 73.689µs ± 0.397µs 73.636µs ± 0.306µs 73.976µs 74.340µs 74.653µs 74.979µs 1.82% 0.340 -0.260 0.54% 0.028µs 1 200
credit_card/is_card_number/378282246310005 throughput 13337147.496op/s 13570879.254op/s ± 73044.798op/s 13580309.231op/s ± 56638.034op/s 13629490.811op/s 13673860.262op/s 13706633.716op/s 13738334.033op/s 1.16% -0.314 -0.297 0.54% 5165.047op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 51.825µs 52.132µs ± 0.099µs 52.148µs ± 0.066µs 52.197µs 52.283µs 52.324µs 52.354µs 0.39% -0.444 0.037 0.19% 0.007µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 19100799.995op/s 19182101.523op/s ± 36326.959op/s 19176025.175op/s ± 24266.828op/s 19207141.215op/s 19250693.831op/s 19273523.168op/s 19295536.058op/s 0.62% 0.454 0.050 0.19% 2568.704op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.432µs 6.523µs ± 0.071µs 6.516µs ± 0.047µs 6.565µs 6.643µs 6.718µs 6.775µs 3.96% 0.804 0.343 1.09% 0.005µs 1 200
credit_card/is_card_number/x371413321323331 throughput 147612033.263op/s 153318837.550op/s ± 1655215.554op/s 153457524.083op/s ± 1107900.146op/s 154477682.068op/s 155360988.306op/s 155448346.209op/s 155469124.762op/s 1.31% -0.750 0.192 1.08% 117041.414op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.893µs 3.914µs ± 0.003µs 3.914µs ± 0.001µs 3.916µs 3.918µs 3.921µs 3.923µs 0.23% -1.752 11.625 0.08% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 254910746.832op/s 255494383.209op/s ± 193543.869op/s 255499282.189op/s ± 89446.352op/s 255569453.061op/s 255803213.970op/s 255936568.165op/s 256863537.427op/s 0.53% 1.776 11.808 0.08% 13685.618op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 63.407µs 63.878µs ± 0.200µs 63.851µs ± 0.103µs 63.968µs 64.193µs 64.493µs 64.885µs 1.62% 1.200 3.656 0.31% 0.014µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15411849.278op/s 15655011.766op/s ± 48953.460op/s 15661514.962op/s ± 25241.494op/s 15679511.583op/s 15727118.666op/s 15749351.866op/s 15771187.988op/s 0.70% -1.160 3.498 0.31% 3461.532op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 57.377µs 57.539µs ± 0.077µs 57.524µs ± 0.040µs 57.574µs 57.668µs 57.767µs 57.982µs 0.80% 1.924 7.834 0.13% 0.005µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 17246608.663op/s 17379398.508op/s ± 23339.668op/s 17383974.583op/s ± 12207.825op/s 17393226.213op/s 17410233.653op/s 17419655.992op/s 17428591.605op/s 0.26% -1.899 7.678 0.13% 1650.364op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.895µs 3.913µs ± 0.003µs 3.914µs ± 0.001µs 3.915µs 3.918µs 3.919µs 3.922µs 0.21% -1.983 10.613 0.08% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 254990241.835op/s 255526617.285op/s ± 197510.149op/s 255518898.302op/s ± 84218.954op/s 255591444.076op/s 255828587.970op/s 255995400.960op/s 256755554.047op/s 0.48% 2.003 10.744 0.08% 13966.077op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 54.552µs 54.730µs ± 0.199µs 54.676µs ± 0.041µs 54.723µs 55.155µs 55.604µs 56.047µs 2.51% 3.474 14.613 0.36% 0.014µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 17842149.045op/s 18271676.274op/s ± 65534.440op/s 18289583.170op/s ± 13822.179op/s 18301851.690op/s 18318816.907op/s 18328238.115op/s 18331295.187op/s 0.23% -3.425 14.161 0.36% 4633.985op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 51.854µs 52.147µs ± 0.101µs 52.153µs ± 0.068µs 52.219µs 52.303µs 52.356µs 52.450µs 0.57% -0.084 -0.191 0.19% 0.007µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 19065792.076op/s 19176556.817op/s ± 37031.000op/s 19174365.790op/s ± 25124.159op/s 19202745.032op/s 19237503.706op/s 19256897.024op/s 19284744.883op/s 0.58% 0.095 -0.191 0.19% 2618.487op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.427µs 6.530µs ± 0.076µs 6.517µs ± 0.048µs 6.579µs 6.670µs 6.749µs 6.757µs 3.69% 0.683 -0.104 1.17% 0.005µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 147988977.493op/s 153163667.068op/s ± 1777804.540op/s 153449436.776op/s ± 1123684.474op/s 154489306.766op/s 155459153.077op/s 155534367.738op/s 155588105.672op/s 1.39% -0.634 -0.212 1.16% 125709.765op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.914µs; 3.915µs] or [-0.013%; +0.013%] None None None
credit_card/is_card_number/ throughput [255456363.008op/s; 255524662.622op/s] or [-0.013%; +0.013%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [82.626µs; 82.726µs] or [-0.060%; +0.060%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12088408.271op/s; 12102939.635op/s] or [-0.060%; +0.060%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [77.042µs; 77.156µs] or [-0.074%; +0.074%] None None None
credit_card/is_card_number/ 378282246310005 throughput [12961130.032op/s; 12980158.798op/s] or [-0.073%; +0.073%] None None None
credit_card/is_card_number/37828224631 execution_time [3.914µs; 3.916µs] or [-0.023%; +0.023%] None None None
credit_card/is_card_number/37828224631 throughput [255391707.952op/s; 255509887.716op/s] or [-0.023%; +0.023%] None None None
credit_card/is_card_number/378282246310005 execution_time [73.634µs; 73.744µs] or [-0.075%; +0.075%] None None None
credit_card/is_card_number/378282246310005 throughput [13560755.947op/s; 13581002.560op/s] or [-0.075%; +0.075%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [52.118µs; 52.146µs] or [-0.026%; +0.026%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [19177066.956op/s; 19187136.090op/s] or [-0.026%; +0.026%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.513µs; 6.533µs] or [-0.151%; +0.151%] None None None
credit_card/is_card_number/x371413321323331 throughput [153089440.593op/s; 153548234.506op/s] or [-0.150%; +0.150%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.914µs; 3.914µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ throughput [255467559.890op/s; 255521206.527op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [63.850µs; 63.906µs] or [-0.043%; +0.043%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15648227.287op/s; 15661796.245op/s] or [-0.043%; +0.043%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [57.529µs; 57.550µs] or [-0.019%; +0.019%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [17376163.855op/s; 17382633.162op/s] or [-0.019%; +0.019%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.913µs; 3.914µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255499244.278op/s; 255553990.292op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [54.703µs; 54.758µs] or [-0.050%; +0.050%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [18262593.831op/s; 18280758.717op/s] or [-0.050%; +0.050%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [52.133µs; 52.161µs] or [-0.027%; +0.027%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [19171424.677op/s; 19181688.958op/s] or [-0.027%; +0.027%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.519µs; 6.540µs] or [-0.162%; +0.162%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [152917280.456op/s; 153410053.679op/s] or [-0.161%; +0.161%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 92c1f2e 1742842862 levi/fix-bake-action
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 65.789µs 66.020µs ± 0.303µs 65.967µs ± 0.066µs 66.053µs 66.198µs 67.227µs 68.809µs 4.31% 7.285 60.299 0.46% 0.021µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [65.978µs; 66.062µs] or [-0.064%; +0.064%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 92c1f2e 1742842862 levi/fix-bake-action
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 53.941ms 54.198ms ± 0.218ms 54.147ms ± 0.063ms 54.214ms 54.618ms 55.020ms 55.913ms 3.26% 3.902 21.690 0.40% 0.015ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [54.168ms; 54.228ms] or [-0.056%; +0.056%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 92c1f2e 1742842862 levi/fix-bake-action
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 246.209ns 254.967ns ± 10.683ns 250.354ns ± 2.885ns 256.910ns 280.443ns 282.201ns 285.925ns 14.21% 1.439 0.737 4.18% 0.755ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [253.486ns; 256.447ns] or [-0.581%; +0.581%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 92c1f2e 1742842862 levi/fix-bake-action
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.466µs 24.812µs ± 10.142µs 17.612µs ± 0.112µs 33.400µs 42.020µs 43.923µs 85.281µs 384.23% 1.746 5.676 40.77% 0.717µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [23.406µs; 26.218µs] or [-5.665%; +5.665%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 92c1f2e 1742842862 levi/fix-bake-action
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 504.542µs 505.681µs ± 0.613µs 505.670µs ± 0.236µs 505.903µs 506.272µs 507.085µs 511.808µs 1.21% 5.034 48.473 0.12% 0.043µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1953856.000op/s 1977535.030op/s ± 2382.539op/s 1977574.090op/s ± 924.685op/s 1978488.662op/s 1980665.448op/s 1981411.094op/s 1981995.334op/s 0.22% -4.943 47.316 0.12% 168.471op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 452.549µs 453.338µs ± 0.321µs 453.346µs ± 0.199µs 453.539µs 453.813µs 454.050µs 454.531µs 0.26% 0.155 0.411 0.07% 0.023µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2200067.542op/s 2205862.935op/s ± 1559.418op/s 2205821.085op/s ± 966.320op/s 2206802.922op/s 2208503.245op/s 2209326.209op/s 2209705.957op/s 0.18% -0.150 0.404 0.07% 110.268op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 175.161µs 176.099µs ± 0.399µs 176.155µs ± 0.235µs 176.360µs 176.692µs 176.887µs 176.934µs 0.44% -0.350 -0.347 0.23% 0.028µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5651839.777op/s 5678652.055op/s ± 12884.034op/s 5676823.820op/s ± 7568.331op/s 5686789.001op/s 5702918.229op/s 5706335.874op/s 5709033.404op/s 0.57% 0.360 -0.342 0.23% 911.039op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 37.575µs 37.715µs ± 0.054µs 37.715µs ± 0.035µs 37.750µs 37.804µs 37.846µs 37.853µs 0.37% 0.064 -0.152 0.14% 0.004µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 26417844.170op/s 26515026.514op/s ± 37903.109op/s 26514381.142op/s ± 24256.102op/s 26538688.854op/s 26576348.062op/s 26598634.939op/s 26613689.528op/s 0.37% -0.056 -0.154 0.14% 2680.155op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 48.214µs 48.322µs ± 0.115µs 48.308µs ± 0.024µs 48.337µs 48.379µs 48.458µs 49.608µs 2.69% 8.732 87.956 0.24% 0.008µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 20157983.615op/s 20694639.456op/s ± 48269.926op/s 20700527.005op/s ± 10425.493op/s 20708967.989op/s 20727830.934op/s 20738874.340op/s 20740873.426op/s 0.19% -8.634 86.402 0.23% 3413.199op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [505.596µs; 505.766µs] or [-0.017%; +0.017%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1977204.833op/s; 1977865.227op/s] or [-0.017%; +0.017%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [453.293µs; 453.382µs] or [-0.010%; +0.010%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2205646.814op/s; 2206079.055op/s] or [-0.010%; +0.010%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [176.044µs; 176.154µs] or [-0.031%; +0.031%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5676866.452op/s; 5680437.658op/s] or [-0.031%; +0.031%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [37.707µs; 37.722µs] or [-0.020%; +0.020%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [26509773.507op/s; 26520279.520op/s] or [-0.020%; +0.020%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [48.306µs; 48.338µs] or [-0.033%; +0.033%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [20687949.708op/s; 20701329.203op/s] or [-0.032%; +0.032%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 92c1f2e 1742842862 levi/fix-bake-action
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.211µs 3.178µs ± 1.421µs 2.982µs ± 0.029µs 3.013µs 3.642µs 13.850µs 14.872µs 398.65% 7.388 55.571 44.61% 0.101µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [2.981µs; 3.375µs] or [-6.198%; +6.198%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 92c1f2e 1742842862 levi/fix-bake-action
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.285µs 2.372µs ± 0.024µs 2.371µs ± 0.014µs 2.391µs 2.403µs 2.406µs 2.416µs 1.88% -0.990 1.555 1.00% 0.002µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.369µs; 2.375µs] or [-0.138%; +0.138%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 92c1f2e 1742842862 levi/fix-bake-action
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 6.029ms 6.042ms ± 0.009ms 6.041ms ± 0.003ms 6.044ms 6.052ms 6.076ms 6.122ms 1.35% 5.085 38.362 0.15% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [6.041ms; 6.043ms] or [-0.020%; +0.020%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 92c1f2e 1742842862 levi/fix-bake-action
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 4.916µs 4.987µs ± 0.033µs 4.988µs ± 0.025µs 5.005µs 5.047µs 5.054µs 5.094µs 2.14% 0.327 -0.367 0.66% 0.002µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [4.983µs; 4.992µs] or [-0.092%; +0.092%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 92c1f2e 1742842862 levi/fix-bake-action
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 146.532µs 147.330µs ± 0.365µs 147.299µs ± 0.163µs 147.466µs 147.948µs 148.308µs 150.175µs 1.95% 2.902 18.781 0.25% 0.026µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [147.280µs; 147.381µs] or [-0.034%; +0.034%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 92c1f2e 1742842862 levi/fix-bake-action
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 31.796µs 32.717µs ± 1.282µs 31.917µs ± 0.072µs 34.380µs 35.039µs 35.251µs 35.305µs 10.61% 0.958 -0.968 3.91% 0.091µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [32.540µs; 32.895µs] or [-0.543%; +0.543%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 92c1f2e 1742842862 levi/fix-bake-action
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 208.582µs 209.044µs ± 0.166µs 209.039µs ± 0.108µs 209.149µs 209.307µs 209.421µs 209.772µs 0.35% 0.385 1.810 0.08% 0.012µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 4767076.662op/s 4783694.686op/s ± 3798.527op/s 4783796.008op/s ± 2481.056op/s 4786247.993op/s 4789459.550op/s 4792692.334op/s 4794283.935op/s 0.22% -0.376 1.789 0.08% 268.596op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 18.246µs 18.333µs ± 0.057µs 18.333µs ± 0.042µs 18.369µs 18.408µs 18.445µs 18.723µs 2.12% 1.541 9.134 0.31% 0.004µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 53411179.005op/s 54546391.908op/s ± 169866.332op/s 54545921.267op/s ± 123740.751op/s 54677894.936op/s 54793713.189op/s 54804990.718op/s 54807365.926op/s 0.48% -1.461 8.493 0.31% 12011.363op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.698µs 10.753µs ± 0.025µs 10.750µs ± 0.015µs 10.771µs 10.794µs 10.819µs 10.837µs 0.80% 0.325 0.208 0.24% 0.002µs 1 200
normalization/normalize_name/normalize_name/good throughput 92278032.292op/s 92997081.493op/s ± 219991.262op/s 93020360.381op/s ± 131141.222op/s 93137236.464op/s 93363406.093op/s 93458687.703op/s 93475617.604op/s 0.49% -0.310 0.192 0.24% 15555.731op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [209.021µs; 209.067µs] or [-0.011%; +0.011%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [4783168.247op/s; 4784221.125op/s] or [-0.011%; +0.011%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [18.325µs; 18.341µs] or [-0.043%; +0.043%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [54522850.068op/s; 54569933.748op/s] or [-0.043%; +0.043%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.750µs; 10.757µs] or [-0.033%; +0.033%] None None None
normalization/normalize_name/normalize_name/good throughput [92966592.820op/s; 93027570.166op/s] or [-0.033%; +0.033%] None None None

Baseline

Omitted due to size.

@r1viollet
Copy link
Contributor

Artifact Size Benchmark Report

aarch64-alpine-linux-musl
Artifact Baseline Commit Change
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.so 7.69 MB 7.69 MB 0% (0 B) 👌
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.so.debug 23.83 MB 23.83 MB 0% (0 B) 👌
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.a 77.23 MB 77.23 MB 0% (0 B) 👌
aarch64-unknown-linux-gnu
Artifact Baseline Commit Change
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so 7.62 MB 7.62 MB 0% (0 B) 👌
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.a 71.54 MB 71.54 MB 0% (0 B) 👌
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so.debug 22.42 MB 22.42 MB 0% (0 B) 👌
i686-alpine-linux-musl
Artifact Baseline Commit Change
/i686-alpine-linux-musl/lib/libdatadog_profiling.a 66.56 MB 66.56 MB 0% (0 B) 👌
/i686-alpine-linux-musl/lib/libdatadog_profiling.so 8.19 MB 8.19 MB 0% (0 B) 👌
/i686-alpine-linux-musl/lib/libdatadog_profiling.so.debug 23.01 MB 23.01 MB 0% (0 B) 👌
i686-unknown-linux-gnu
Artifact Baseline Commit Change
/i686-unknown-linux-gnu/lib/libdatadog_profiling.a 67.45 MB 67.45 MB 0% (0 B) 👌
/i686-unknown-linux-gnu/lib/libdatadog_profiling.so 8.07 MB 8.07 MB 0% (0 B) 👌
/i686-unknown-linux-gnu/lib/libdatadog_profiling.so.debug 20.62 MB 20.62 MB 0% (0 B) 👌
libdatadog-x64-windows
Artifact Baseline Commit Change
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.dll 16.59 MB 16.59 MB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.lib 55.10 KB 55.10 KB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.pdb 111.21 MB 111.20 MB -0% (-8.00 KB) 👌
/libdatadog-x64-windows/debug/static/datadog_profiling_ffi.lib 625.62 MB 625.62 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.dll 4.99 MB 4.99 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.lib 55.10 KB 55.10 KB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.pdb 15.85 MB 15.85 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/static/datadog_profiling_ffi.lib 26.38 MB 26.38 MB 0% (0 B) 👌
libdatadog-x86-windows
Artifact Baseline Commit Change
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.dll 14.03 MB 14.03 MB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.lib 55.94 KB 55.94 KB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.pdb 113.19 MB 113.19 MB 0% (0 B) 👌
/libdatadog-x86-windows/debug/static/datadog_profiling_ffi.lib 618.14 MB 618.14 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.dll 3.78 MB 3.78 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.lib 55.94 KB 55.94 KB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.pdb 16.51 MB 16.51 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/static/datadog_profiling_ffi.lib 24.36 MB 24.36 MB 0% (0 B) 👌
x86_64-alpine-linux-musl
Artifact Baseline Commit Change
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.a 66.56 MB 66.56 MB 0% (0 B) 👌
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.so 8.19 MB 8.19 MB 0% (0 B) 👌
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.so.debug 23.01 MB 23.01 MB 0% (0 B) 👌
x86_64-unknown-linux-gnu
Artifact Baseline Commit Change
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.a 67.45 MB 67.45 MB 0% (0 B) 👌
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so 8.07 MB 8.07 MB 0% (0 B) 👌
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so.debug 20.62 MB 20.62 MB 0% (0 B) 👌

@morrisonlevi morrisonlevi marked this pull request as ready for review March 25, 2025 02:36
@morrisonlevi morrisonlevi requested a review from a team as a code owner March 25, 2025 02:36
@danielsn danielsn merged commit c0f1e51 into main Mar 25, 2025
33 checks passed
@danielsn danielsn deleted the levi/fix-bake-action branch March 25, 2025 13:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants