Skip to content

Conversation

gyuheon0h
Copy link
Contributor

@gyuheon0h gyuheon0h commented Sep 17, 2025

This is a POC for Python runtime stack collection

Checklist

  • PR author has checked that all the criteria below are met
  • The PR description includes an overview of the change
  • The PR description articulates the motivation for the change
  • The change includes tests OR the PR description describes a testing strategy
  • The PR description notes risks associated with the change, if any
  • Newly-added code is easy to change
  • The change follows the library release note guidelines
  • The change includes or references documentation updates if necessary
  • Backport labels are set (if applicable)

Reviewer Checklist

  • Reviewer has checked that all the criteria below are met
  • Title is accurate
  • All changes are related to the pull request's stated goal
  • Avoids breaking API changes
  • Testing strategy adequately addresses listed risks
  • Newly-added code is easy to change
  • Release note makes sense to a user of the library
  • If necessary, author has acknowledged and discussed the performance implications of this PR as reported in the benchmarks PR comment
  • Backport labels are set in a manner that is consistent with the release branch maintenance policy

Copy link
Contributor

github-actions bot commented Sep 17, 2025

CODEOWNERS have been resolved as:

experimental_debug.json                                                 @DataDog/apm-core-python
ddtrace/internal/core/crashtracking.py                                  @DataDog/apm-core-python
src/native/Cargo.lock                                                   @DataDog/apm-core-python
src/native/Cargo.toml                                                   @DataDog/apm-core-python
src/native/crashtracker.rs                                              @DataDog/apm-core-python
src/native/lib.rs                                                       @DataDog/apm-core-python
tests/internal/crashtracker/test_crashtracker.py                        @DataDog/apm-core-python

Copy link
Contributor

github-actions bot commented Sep 17, 2025

Bootstrap import analysis

Comparison of import times between this PR and base.

Summary

The average import time from this PR is: 271 ± 4 ms.

The average import time from base is: 271 ± 3 ms.

The import time difference between this PR and base is: -0.4 ± 0.2 ms.

The difference is not statistically significant (z = -2.36).

Import time breakdown

The following import paths have shrunk:

ddtrace.auto 1.879 ms (0.69%)
ddtrace.bootstrap.sitecustomize 1.210 ms (0.45%)
ddtrace.bootstrap.preload 1.210 ms (0.45%)
ddtrace.internal.remoteconfig.client 0.615 ms (0.23%)
ddtrace 0.669 ms (0.25%)
ddtrace.internal._unpatched 0.028 ms (0.01%)
json 0.028 ms (0.01%)
json.decoder 0.028 ms (0.01%)
re 0.028 ms (0.01%)
enum 0.028 ms (0.01%)
types 0.028 ms (0.01%)

@pr-commenter
Copy link

pr-commenter bot commented Sep 18, 2025

Performance SLOs

Comparing candidate gyuheon0h/runtime-stack-exp (4f4c920) with baseline main (33c9c44)

📈 Performance Regressions (2 suites)
📈 iastaspects - 118/118

✅ add_aspect

Time: ✅ 0.400µs (SLO: <10.000µs 📉 -96.0%) vs baseline: -0.3%

Memory: ✅ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +5.8%


✅ add_inplace_aspect

Time: ✅ 0.407µs (SLO: <10.000µs 📉 -95.9%) vs baseline: +0.6%

Memory: ✅ 37.532MB (SLO: <39.000MB -3.8%) vs baseline: +5.6%


✅ add_inplace_noaspect

Time: ✅ 0.317µs (SLO: <10.000µs 📉 -96.8%) vs baseline: +0.1%

Memory: ✅ 37.552MB (SLO: <39.000MB -3.7%) vs baseline: +5.6%


✅ add_noaspect

Time: ✅ 0.274µs (SLO: <10.000µs 📉 -97.3%) vs baseline: -1.4%

Memory: ✅ 37.591MB (SLO: <39.000MB -3.6%) vs baseline: +5.8%


✅ bytearray_aspect

Time: ✅ 1.374µs (SLO: <10.000µs 📉 -86.3%) vs baseline: +3.8%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +6.0%


✅ bytearray_extend_aspect

Time: ✅ 1.496µs (SLO: <10.000µs 📉 -85.0%) vs baseline: +2.1%

Memory: ✅ 37.591MB (SLO: <39.000MB -3.6%) vs baseline: +5.7%


✅ bytearray_extend_noaspect

Time: ✅ 0.613µs (SLO: <10.000µs 📉 -93.9%) vs baseline: +0.3%

Memory: ✅ 37.532MB (SLO: <39.000MB -3.8%) vs baseline: +5.7%


✅ bytearray_noaspect

Time: ✅ 0.484µs (SLO: <10.000µs 📉 -95.2%) vs baseline: +0.6%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +6.0%


✅ bytes_aspect

Time: ✅ 1.305µs (SLO: <10.000µs 📉 -87.0%) vs baseline: +1.2%

Memory: ✅ 37.552MB (SLO: <39.000MB -3.7%) vs baseline: +5.8%


✅ bytes_noaspect

Time: ✅ 0.491µs (SLO: <10.000µs 📉 -95.1%) vs baseline: -0.7%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +5.9%


✅ bytesio_aspect

Time: ✅ 1.341µs (SLO: <10.000µs 📉 -86.6%) vs baseline: ~same

Memory: ✅ 37.572MB (SLO: <39.000MB -3.7%) vs baseline: +5.6%


✅ bytesio_noaspect

Time: ✅ 0.493µs (SLO: <10.000µs 📉 -95.1%) vs baseline: ~same

Memory: ✅ 37.591MB (SLO: <39.000MB -3.6%) vs baseline: +5.8%


✅ capitalize_aspect

Time: ✅ 0.731µs (SLO: <10.000µs 📉 -92.7%) vs baseline: -1.8%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +6.0%


✅ capitalize_noaspect

Time: ✅ 0.435µs (SLO: <10.000µs 📉 -95.6%) vs baseline: ~same

Memory: ✅ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +5.7%


✅ casefold_aspect

Time: ✅ 0.740µs (SLO: <10.000µs 📉 -92.6%) vs baseline: +0.8%

Memory: ✅ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +5.9%


✅ casefold_noaspect

Time: ✅ 0.366µs (SLO: <10.000µs 📉 -96.3%) vs baseline: -1.4%

Memory: ✅ 37.572MB (SLO: <39.000MB -3.7%) vs baseline: +5.7%


✅ decode_aspect

Time: ✅ 0.726µs (SLO: <10.000µs 📉 -92.7%) vs baseline: -0.3%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +5.8%


✅ decode_noaspect

Time: ✅ 0.414µs (SLO: <10.000µs 📉 -95.9%) vs baseline: -1.3%

Memory: ✅ 37.572MB (SLO: <39.000MB -3.7%) vs baseline: +5.6%


✅ encode_aspect

Time: ✅ 0.714µs (SLO: <10.000µs 📉 -92.9%) vs baseline: +1.2%

Memory: ✅ 37.572MB (SLO: <39.000MB -3.7%) vs baseline: +5.8%


✅ encode_noaspect

Time: ✅ 0.397µs (SLO: <10.000µs 📉 -96.0%) vs baseline: -0.4%

Memory: ✅ 37.591MB (SLO: <39.000MB -3.6%) vs baseline: +5.7%


✅ format_aspect

Time: ✅ 3.429µs (SLO: <10.000µs 📉 -65.7%) vs baseline: +0.6%

Memory: ✅ 37.552MB (SLO: <39.000MB -3.7%) vs baseline: +5.7%


✅ format_map_aspect

Time: ✅ 3.603µs (SLO: <10.000µs 📉 -64.0%) vs baseline: +2.8%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +6.1%


✅ format_map_noaspect

Time: ✅ 0.778µs (SLO: <10.000µs 📉 -92.2%) vs baseline: +1.0%

Memory: ✅ 37.591MB (SLO: <39.000MB -3.6%) vs baseline: +5.6%


✅ format_noaspect

Time: ✅ 0.595µs (SLO: <10.000µs 📉 -94.1%) vs baseline: +0.4%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +5.9%


✅ index_aspect

Time: ✅ 0.356µs (SLO: <10.000µs 📉 -96.4%) vs baseline: +0.7%

Memory: ✅ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +6.0%


✅ index_noaspect

Time: ✅ 0.275µs (SLO: <10.000µs 📉 -97.2%) vs baseline: +0.6%

Memory: ✅ 37.591MB (SLO: <39.000MB -3.6%) vs baseline: +5.6%


✅ join_aspect

Time: ✅ 1.336µs (SLO: <10.000µs 📉 -86.6%) vs baseline: +1.1%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +5.9%


✅ join_noaspect

Time: ✅ 0.489µs (SLO: <10.000µs 📉 -95.1%) vs baseline: -1.4%

Memory: ✅ 37.552MB (SLO: <39.000MB -3.7%) vs baseline: +5.7%


✅ ljust_aspect

Time: ✅ 2.621µs (SLO: <20.000µs 📉 -86.9%) vs baseline: +0.9%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +6.0%


✅ ljust_noaspect

Time: ✅ 0.407µs (SLO: <10.000µs 📉 -95.9%) vs baseline: +1.1%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +5.9%


✅ lower_aspect

Time: ✅ 2.302µs (SLO: <10.000µs 📉 -77.0%) vs baseline: +1.1%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +6.0%


✅ lower_noaspect

Time: ✅ 0.368µs (SLO: <10.000µs 📉 -96.3%) vs baseline: +0.5%

Memory: ✅ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +5.8%


✅ lstrip_aspect

Time: ✅ 2.531µs (SLO: <20.000µs 📉 -87.3%) vs baseline: 📈 +14.1%

Memory: ✅ 37.552MB (SLO: <39.000MB -3.7%) vs baseline: +5.6%


✅ lstrip_noaspect

Time: ✅ 0.384µs (SLO: <10.000µs 📉 -96.2%) vs baseline: +1.2%

Memory: ✅ 37.572MB (SLO: <39.000MB -3.7%) vs baseline: +5.7%


✅ modulo_aspect

Time: ✅ 0.990µs (SLO: <10.000µs 📉 -90.1%) vs baseline: -1.0%

Memory: ✅ 37.591MB (SLO: <39.000MB -3.6%) vs baseline: +5.7%


✅ modulo_aspect_for_bytearray_bytearray

Time: ✅ 1.670µs (SLO: <10.000µs 📉 -83.3%) vs baseline: +8.5%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +5.9%


✅ modulo_aspect_for_bytes

Time: ✅ 0.969µs (SLO: <10.000µs 📉 -90.3%) vs baseline: -0.9%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +6.0%


✅ modulo_aspect_for_bytes_bytearray

Time: ✅ 1.254µs (SLO: <10.000µs 📉 -87.5%) vs baseline: +4.9%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +5.9%


✅ modulo_noaspect

Time: ✅ 0.622µs (SLO: <10.000µs 📉 -93.8%) vs baseline: -0.9%

Memory: ✅ 37.572MB (SLO: <39.000MB -3.7%) vs baseline: +5.7%


✅ replace_aspect

Time: ✅ 5.481µs (SLO: <10.000µs 📉 -45.2%) vs baseline: 📈 +11.4%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +6.0%


✅ replace_noaspect

Time: ✅ 0.459µs (SLO: <10.000µs 📉 -95.4%) vs baseline: -0.1%

Memory: ✅ 37.552MB (SLO: <39.000MB -3.7%) vs baseline: +5.7%


✅ repr_aspect

Time: ✅ 0.909µs (SLO: <10.000µs 📉 -90.9%) vs baseline: +0.7%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +5.9%


✅ repr_noaspect

Time: ✅ 0.414µs (SLO: <10.000µs 📉 -95.9%) vs baseline: -0.7%

Memory: ✅ 37.591MB (SLO: <39.000MB -3.6%) vs baseline: +5.7%


✅ rstrip_aspect

Time: ✅ 2.073µs (SLO: <20.000µs 📉 -89.6%) vs baseline: +7.4%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +6.0%


✅ rstrip_noaspect

Time: ✅ 0.379µs (SLO: <10.000µs 📉 -96.2%) vs baseline: +0.3%

Memory: ✅ 37.572MB (SLO: <39.000MB -3.7%) vs baseline: +5.6%


✅ slice_aspect

Time: ✅ 0.489µs (SLO: <10.000µs 📉 -95.1%) vs baseline: -0.4%

Memory: ✅ 37.591MB (SLO: <39.000MB -3.6%) vs baseline: +5.7%


✅ slice_noaspect

Time: ✅ 0.449µs (SLO: <10.000µs 📉 -95.5%) vs baseline: ~same

Memory: ✅ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +5.7%


✅ stringio_aspect

Time: ✅ 1.739µs (SLO: <10.000µs 📉 -82.6%) vs baseline: 📈 +12.5%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +6.0%


✅ stringio_noaspect

Time: ✅ 0.723µs (SLO: <10.000µs 📉 -92.8%) vs baseline: -0.8%

Memory: ✅ 37.591MB (SLO: <39.000MB -3.6%) vs baseline: +5.7%


✅ strip_aspect

Time: ✅ 2.249µs (SLO: <20.000µs 📉 -88.8%) vs baseline: ~same

Memory: ✅ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +5.7%


✅ strip_noaspect

Time: ✅ 0.381µs (SLO: <10.000µs 📉 -96.2%) vs baseline: -1.4%

Memory: ✅ 37.591MB (SLO: <39.000MB -3.6%) vs baseline: +5.7%


✅ swapcase_aspect

Time: ✅ 2.654µs (SLO: <10.000µs 📉 -73.5%) vs baseline: +4.9%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +6.0%


✅ swapcase_noaspect

Time: ✅ 0.536µs (SLO: <10.000µs 📉 -94.6%) vs baseline: -1.3%

Memory: ✅ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +5.8%


✅ title_aspect

Time: ✅ 2.377µs (SLO: <10.000µs 📉 -76.2%) vs baseline: -1.9%

Memory: ✅ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +5.9%


✅ title_noaspect

Time: ✅ 0.506µs (SLO: <10.000µs 📉 -94.9%) vs baseline: +0.4%

Memory: ✅ 37.513MB (SLO: <39.000MB -3.8%) vs baseline: +5.6%


✅ translate_aspect

Time: ✅ 3.248µs (SLO: <10.000µs 📉 -67.5%) vs baseline: -4.2%

Memory: ✅ 37.572MB (SLO: <39.000MB -3.7%) vs baseline: +6.0%


✅ translate_noaspect

Time: ✅ 1.041µs (SLO: <10.000µs 📉 -89.6%) vs baseline: ~same

Memory: ✅ 37.572MB (SLO: <39.000MB -3.7%) vs baseline: +5.9%


✅ upper_aspect

Time: ✅ 2.259µs (SLO: <10.000µs 📉 -77.4%) vs baseline: -4.1%

Memory: ✅ 37.552MB (SLO: <39.000MB -3.7%) vs baseline: +5.6%


✅ upper_noaspect

Time: ✅ 0.372µs (SLO: <10.000µs 📉 -96.3%) vs baseline: -0.8%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +5.8%


📈 telemetryaddmetric - 30/30

✅ 1-count-metric-1-times

Time: ✅ 3.240µs (SLO: <20.000µs 📉 -83.8%) vs baseline: +1.0%

Memory: ✅ 31.556MB (SLO: <34.000MB -7.2%) vs baseline: +5.7%


✅ 1-count-metrics-100-times

Time: ✅ 215.862µs (SLO: <250.000µs 📉 -13.7%) vs baseline: -1.4%

Memory: ✅ 31.634MB (SLO: <34.000MB -7.0%) vs baseline: +5.8%


✅ 1-distribution-metric-1-times

Time: ✅ 3.436µs (SLO: <20.000µs 📉 -82.8%) vs baseline: 📈 +14.0%

Memory: ✅ 31.556MB (SLO: <34.000MB -7.2%) vs baseline: +5.7%


✅ 1-distribution-metrics-100-times

Time: ✅ 202.487µs (SLO: <220.000µs -8.0%) vs baseline: +2.8%

Memory: ✅ 31.536MB (SLO: <34.000MB -7.2%) vs baseline: +5.6%


✅ 1-gauge-metric-1-times

Time: ✅ 2.243µs (SLO: <20.000µs 📉 -88.8%) vs baseline: +7.1%

Memory: ✅ 31.634MB (SLO: <34.000MB -7.0%) vs baseline: +6.1%


✅ 1-gauge-metrics-100-times

Time: ✅ 125.729µs (SLO: <150.000µs 📉 -16.2%) vs baseline: -0.3%

Memory: ✅ 31.634MB (SLO: <34.000MB -7.0%) vs baseline: +5.9%


✅ 1-rate-metric-1-times

Time: ✅ 3.171µs (SLO: <20.000µs 📉 -84.1%) vs baseline: -0.3%

Memory: ✅ 31.536MB (SLO: <34.000MB -7.2%) vs baseline: +5.7%


✅ 1-rate-metrics-100-times

Time: ✅ 216.915µs (SLO: <250.000µs 📉 -13.2%) vs baseline: +0.6%

Memory: ✅ 31.516MB (SLO: <34.000MB -7.3%) vs baseline: +5.6%


✅ 100-count-metrics-100-times

Time: ✅ 21.867ms (SLO: <23.500ms -7.0%) vs baseline: -1.0%

Memory: ✅ 31.615MB (SLO: <34.000MB -7.0%) vs baseline: +6.0%


✅ 100-distribution-metrics-100-times

Time: ✅ 2.076ms (SLO: <2.250ms -7.7%) vs baseline: +3.1%

Memory: ✅ 31.733MB (SLO: <34.000MB -6.7%) vs baseline: +6.3%


✅ 100-gauge-metrics-100-times

Time: ✅ 1.294ms (SLO: <1.550ms 📉 -16.5%) vs baseline: ~same

Memory: ✅ 31.516MB (SLO: <34.000MB -7.3%) vs baseline: +5.3%


✅ 100-rate-metrics-100-times

Time: ✅ 2.204ms (SLO: <2.550ms 📉 -13.6%) vs baseline: -2.1%

Memory: ✅ 31.595MB (SLO: <34.000MB -7.1%) vs baseline: +5.9%


✅ flush-1-metric

Time: ✅ 4.474µs (SLO: <20.000µs 📉 -77.6%) vs baseline: +4.4%

Memory: ✅ 32.067MB (SLO: <34.000MB -5.7%) vs baseline: +6.4%


✅ flush-100-metrics

Time: ✅ 185.305µs (SLO: <250.000µs 📉 -25.9%) vs baseline: +0.1%

Memory: ✅ 32.027MB (SLO: <34.000MB -5.8%) vs baseline: +5.9%


✅ flush-1000-metrics

Time: ✅ 2.246ms (SLO: <2.500ms 📉 -10.1%) vs baseline: +0.6%

Memory: ✅ 32.755MB (SLO: <34.500MB -5.1%) vs baseline: +5.6%

🟡 Near SLO Breach (6 suites)
🟡 djangosimple - 26/26

✅ appsec

Time: ✅ 20.524ms (SLO: <22.300ms -8.0%) vs baseline: -0.3%

Memory: ✅ 64.527MB (SLO: <66.000MB -2.2%) vs baseline: +4.9%


✅ exception-replay-enabled

Time: ✅ 1.349ms (SLO: <1.450ms -6.9%) vs baseline: +0.4%

Memory: ✅ 63.776MB (SLO: <66.000MB -3.4%) vs baseline: +5.3%


✅ iast

Time: ✅ 20.539ms (SLO: <22.250ms -7.7%) vs baseline: +0.3%

Memory: ✅ 64.546MB (SLO: <66.000MB -2.2%) vs baseline: +5.0%


✅ profiler

Time: ✅ 15.212ms (SLO: <16.550ms -8.1%) vs baseline: -0.2%

Memory: ✅ 53.064MB (SLO: <53.500MB 🟡 -0.8%) vs baseline: +5.2%


✅ span-code-origin

Time: ✅ 26.120ms (SLO: <28.200ms -7.4%) vs baseline: ~same

Memory: ✅ 66.746MB (SLO: <68.500MB -2.6%) vs baseline: +5.0%


✅ tracer

Time: ✅ 20.492ms (SLO: <21.750ms -5.8%) vs baseline: +0.2%

Memory: ✅ 64.507MB (SLO: <66.000MB -2.3%) vs baseline: +4.9%


✅ tracer-and-profiler

Time: ✅ 22.082ms (SLO: <23.500ms -6.0%) vs baseline: ~same

Memory: ✅ 65.946MB (SLO: <67.000MB 🟡 -1.6%) vs baseline: +5.4%


✅ tracer-dont-create-db-spans

Time: ✅ 19.278ms (SLO: <21.500ms 📉 -10.3%) vs baseline: ~same

Memory: ✅ 64.527MB (SLO: <66.000MB -2.2%) vs baseline: +5.0%


✅ tracer-native

Time: ✅ 20.511ms (SLO: <21.750ms -5.7%) vs baseline: +0.4%

Memory: ✅ 65.706MB (SLO: <66.000MB 🟡 -0.4%) vs baseline: +4.9%


✅ tracer-no-caches

Time: ✅ 18.442ms (SLO: <19.650ms -6.1%) vs baseline: -0.6%

Memory: ✅ 64.546MB (SLO: <66.000MB -2.2%) vs baseline: +5.0%


✅ tracer-no-databases

Time: ✅ 18.797ms (SLO: <20.100ms -6.5%) vs baseline: ~same

Memory: ✅ 64.566MB (SLO: <66.000MB -2.2%) vs baseline: +5.0%


✅ tracer-no-middleware

Time: ✅ 20.205ms (SLO: <21.500ms -6.0%) vs baseline: ~same

Memory: ✅ 64.566MB (SLO: <66.000MB -2.2%) vs baseline: +5.1%


✅ tracer-no-templates

Time: ✅ 20.355ms (SLO: <22.000ms -7.5%) vs baseline: +0.2%

Memory: ✅ 64.546MB (SLO: <66.000MB -2.2%) vs baseline: +5.1%


🟡 errortrackingdjangosimple - 6/6

✅ errortracking-enabled-all

Time: ✅ 18.038ms (SLO: <19.850ms -9.1%) vs baseline: ~same

Memory: ✅ 64.546MB (SLO: <65.500MB 🟡 -1.5%) vs baseline: +5.0%


✅ errortracking-enabled-user

Time: ✅ 18.075ms (SLO: <19.400ms -6.8%) vs baseline: +0.7%

Memory: ✅ 64.487MB (SLO: <65.500MB 🟡 -1.5%) vs baseline: +5.0%


✅ tracer-enabled

Time: ✅ 18.063ms (SLO: <19.450ms -7.1%) vs baseline: ~same

Memory: ✅ 64.507MB (SLO: <65.500MB 🟡 -1.5%) vs baseline: +5.0%


🟡 flasksimple - 17/17

✅ appsec-get

Time: ✅ 4.591ms (SLO: <4.750ms -3.3%) vs baseline: +0.4%

Memory: ✅ 62.423MB (SLO: <64.500MB -3.2%) vs baseline: +5.0%


✅ appsec-post

Time: ✅ 6.569ms (SLO: <6.750ms -2.7%) vs baseline: -0.3%

Memory: ✅ 62.482MB (SLO: <64.500MB -3.1%) vs baseline: +5.1%


✅ appsec-telemetry

Time: ✅ 4.586ms (SLO: <4.750ms -3.5%) vs baseline: -0.5%

Memory: ✅ 62.443MB (SLO: <64.500MB -3.2%) vs baseline: +5.1%


✅ debugger

Time: ✅ 1.857ms (SLO: <2.000ms -7.1%) vs baseline: -0.2%

Memory: ✅ 44.866MB (SLO: <45.000MB 🟡 -0.3%) vs baseline: +5.3%


✅ iast-get

Time: ✅ 1.854ms (SLO: <2.000ms -7.3%) vs baseline: +0.1%

Memory: ✅ 41.799MB (SLO: <49.000MB 📉 -14.7%) vs baseline: +5.4%


✅ profiler

Time: ✅ 1.919ms (SLO: <2.100ms -8.6%) vs baseline: ~same

Memory: ✅ 44.433MB (SLO: <46.500MB -4.4%) vs baseline: +5.0%


✅ tracer

Time: ✅ 3.380ms (SLO: <3.650ms -7.4%) vs baseline: -0.4%

Memory: ✅ 51.492MB (SLO: <53.500MB -3.8%) vs baseline: +4.9%


✅ tracer-native

Time: ✅ 3.376ms (SLO: <3.650ms -7.5%) vs baseline: -0.4%

Memory: ✅ 52.809MB (SLO: <53.500MB 🟡 -1.3%) vs baseline: +5.2%


🟡 flasksqli - 6/6

✅ appsec-enabled

Time: ✅ 3.939ms (SLO: <4.200ms -6.2%) vs baseline: -0.8%

Memory: ✅ 62.711MB (SLO: <66.000MB -5.0%) vs baseline: +5.0%


✅ iast-enabled

Time: ✅ 2.449ms (SLO: <2.800ms 📉 -12.5%) vs baseline: -1.0%

Memory: ✅ 58.346MB (SLO: <59.000MB 🟡 -1.1%) vs baseline: +5.3%


✅ tracer-enabled

Time: ✅ 2.080ms (SLO: <2.250ms -7.6%) vs baseline: -0.4%

Memory: ✅ 51.249MB (SLO: <53.500MB -4.2%) vs baseline: +5.0%


🟡 iastpropagation - 8/8

✅ no-propagation

Time: ✅ 48.758µs (SLO: <60.000µs 📉 -18.7%) vs baseline: ~same

Memory: ✅ 37.159MB (SLO: <39.000MB -4.7%) vs baseline: +5.7%


✅ propagation_enabled

Time: ✅ 165.760µs (SLO: <190.000µs 📉 -12.8%) vs baseline: ~same

Memory: ✅ 37.179MB (SLO: <39.000MB -4.7%) vs baseline: +5.6%


✅ propagation_enabled_100

Time: ✅ 1.869ms (SLO: <1.900ms 🟡 -1.6%) vs baseline: +1.7%

Memory: ✅ 37.218MB (SLO: <39.000MB -4.6%) vs baseline: +5.8%


✅ propagation_enabled_1000

Time: ✅ 32.660ms (SLO: <35.550ms -8.1%) vs baseline: +2.9%

Memory: ✅ 37.198MB (SLO: <39.000MB -4.6%) vs baseline: +5.8%


🟡 otelspan - 22/22

✅ add-event

Time: ✅ 44.993ms (SLO: <47.150ms -4.6%) vs baseline: -0.5%

Memory: ✅ 44.783MB (SLO: <46.500MB -3.7%) vs baseline: +5.6%


✅ add-metrics

Time: ✅ 320.996ms (SLO: <344.800ms -6.9%) vs baseline: -0.4%

Memory: ✅ 554.029MB (SLO: <562.000MB 🟡 -1.4%) vs baseline: +4.9%


✅ add-tags

Time: ✅ 292.922ms (SLO: <314.000ms -6.7%) vs baseline: +0.2%

Memory: ✅ 554.963MB (SLO: <563.500MB 🟡 -1.5%) vs baseline: +5.0%


✅ get-context

Time: ✅ 82.641ms (SLO: <92.350ms 📉 -10.5%) vs baseline: ~same

Memory: ✅ 39.915MB (SLO: <46.500MB 📉 -14.2%) vs baseline: +5.5%


✅ is-recording

Time: ✅ 42.849ms (SLO: <44.500ms -3.7%) vs baseline: ~same

Memory: ✅ 44.254MB (SLO: <46.500MB -4.8%) vs baseline: +5.8%


✅ record-exception

Time: ✅ 61.870ms (SLO: <67.650ms -8.5%) vs baseline: +0.6%

Memory: ✅ 40.240MB (SLO: <46.500MB 📉 -13.5%) vs baseline: +5.8%


✅ set-status

Time: ✅ 48.844ms (SLO: <50.400ms -3.1%) vs baseline: ~same

Memory: ✅ 44.182MB (SLO: <46.500MB -5.0%) vs baseline: +5.8%


✅ start

Time: ✅ 42.698ms (SLO: <43.450ms 🟡 -1.7%) vs baseline: +0.7%

Memory: ✅ 44.188MB (SLO: <46.500MB -5.0%) vs baseline: +5.6%


✅ start-finish

Time: ✅ 84.576ms (SLO: <88.000ms -3.9%) vs baseline: +1.2%

Memory: ✅ 34.053MB (SLO: <46.500MB 📉 -26.8%) vs baseline: +5.5%


✅ start-finish-telemetry

Time: ✅ 84.339ms (SLO: <89.000ms -5.2%) vs baseline: -0.3%

Memory: ✅ 34.053MB (SLO: <46.500MB 📉 -26.8%) vs baseline: +5.8%


✅ update-name

Time: ✅ 44.106ms (SLO: <45.150ms -2.3%) vs baseline: -0.4%

Memory: ✅ 44.561MB (SLO: <46.500MB -4.2%) vs baseline: +5.5%

⚠️ Unstable Tests (1 suite)
⚠️ coreapiscenario - 12/12 (2 unstable)

⚠️ context_with_data_listeners

Time: ⚠️ 13.394µs (SLO: <20.000µs 📉 -33.0%) vs baseline: ~same

Memory: ✅ 31.575MB (SLO: <33.500MB -5.7%) vs baseline: +6.0%


✅ context_with_data_no_listeners

Time: ✅ 3.392µs (SLO: <10.000µs 📉 -66.1%) vs baseline: -0.4%

Memory: ✅ 31.536MB (SLO: <33.500MB -5.9%) vs baseline: +5.6%


⚠️ context_with_data_only_all_listeners

Time: ⚠️ 13.425µs (SLO: <20.000µs 📉 -32.9%) vs baseline: ~same

Memory: ✅ 31.556MB (SLO: <33.500MB -5.8%) vs baseline: +5.5%


✅ get_item_exists

Time: ✅ 0.583µs (SLO: <10.000µs 📉 -94.2%) vs baseline: -0.2%

Memory: ✅ 31.556MB (SLO: <33.500MB -5.8%) vs baseline: +5.8%


✅ get_item_missing

Time: ✅ 0.635µs (SLO: <10.000µs 📉 -93.7%) vs baseline: -0.4%

Memory: ✅ 31.575MB (SLO: <33.500MB -5.7%) vs baseline: +5.7%


✅ set_item

Time: ✅ 24.341µs (SLO: <30.000µs 📉 -18.9%) vs baseline: -0.7%

Memory: ✅ 31.536MB (SLO: <33.500MB -5.9%) vs baseline: +5.4%

✅ All Tests Passing (15 suites)
errortrackingflasksqli - 6/6

✅ errortracking-enabled-all

Time: ✅ 2.092ms (SLO: <2.300ms -9.0%) vs baseline: -0.2%

Memory: ✅ 51.293MB (SLO: <53.500MB -4.1%) vs baseline: +5.2%


✅ errortracking-enabled-user

Time: ✅ 2.093ms (SLO: <2.250ms -7.0%) vs baseline: +0.1%

Memory: ✅ 51.172MB (SLO: <53.500MB -4.4%) vs baseline: +4.8%


✅ tracer-enabled

Time: ✅ 2.104ms (SLO: <2.300ms -8.5%) vs baseline: +0.2%

Memory: ✅ 51.300MB (SLO: <53.500MB -4.1%) vs baseline: +5.0%


httppropagationextract - 60/60

✅ all_styles_all_headers

Time: ✅ 81.663µs (SLO: <100.000µs 📉 -18.3%) vs baseline: +0.8%

Memory: ✅ 31.733MB (SLO: <33.500MB -5.3%) vs baseline: +5.6%


✅ b3_headers

Time: ✅ 14.268µs (SLO: <20.000µs 📉 -28.7%) vs baseline: ~same

Memory: ✅ 31.713MB (SLO: <33.500MB -5.3%) vs baseline: +5.7%


✅ b3_single_headers

Time: ✅ 13.498µs (SLO: <20.000µs 📉 -32.5%) vs baseline: +1.7%

Memory: ✅ 31.595MB (SLO: <33.500MB -5.7%) vs baseline: +5.4%


✅ datadog_tracecontext_tracestate_not_propagated_on_trace_id_no_match

Time: ✅ 65.713µs (SLO: <80.000µs 📉 -17.9%) vs baseline: +3.8%

Memory: ✅ 31.693MB (SLO: <33.500MB -5.4%) vs baseline: +5.8%


✅ datadog_tracecontext_tracestate_propagated_on_trace_id_match

Time: ✅ 66.260µs (SLO: <80.000µs 📉 -17.2%) vs baseline: +0.8%

Memory: ✅ 31.654MB (SLO: <33.500MB -5.5%) vs baseline: +5.7%


✅ empty_headers

Time: ✅ 1.597µs (SLO: <10.000µs 📉 -84.0%) vs baseline: +0.5%

Memory: ✅ 31.713MB (SLO: <33.500MB -5.3%) vs baseline: +5.8%


✅ full_t_id_datadog_headers

Time: ✅ 22.928µs (SLO: <30.000µs 📉 -23.6%) vs baseline: +0.9%

Memory: ✅ 31.733MB (SLO: <33.500MB -5.3%) vs baseline: +6.1%


✅ invalid_priority_header

Time: ✅ 6.481µs (SLO: <10.000µs 📉 -35.2%) vs baseline: -0.5%

Memory: ✅ 31.733MB (SLO: <33.500MB -5.3%) vs baseline: +5.9%


✅ invalid_span_id_header

Time: ✅ 6.530µs (SLO: <10.000µs 📉 -34.7%) vs baseline: -0.1%

Memory: ✅ 31.752MB (SLO: <33.500MB -5.2%) vs baseline: +5.9%


✅ invalid_tags_header

Time: ✅ 6.491µs (SLO: <10.000µs 📉 -35.1%) vs baseline: +0.2%

Memory: ✅ 31.654MB (SLO: <33.500MB -5.5%) vs baseline: +5.6%


✅ invalid_trace_id_header

Time: ✅ 6.502µs (SLO: <10.000µs 📉 -35.0%) vs baseline: -0.4%

Memory: ✅ 31.752MB (SLO: <33.500MB -5.2%) vs baseline: +6.1%


✅ large_header_no_matches

Time: ✅ 27.598µs (SLO: <30.000µs -8.0%) vs baseline: ~same

Memory: ✅ 31.713MB (SLO: <33.500MB -5.3%) vs baseline: +5.9%


✅ large_valid_headers_all

Time: ✅ 28.603µs (SLO: <40.000µs 📉 -28.5%) vs baseline: -0.2%

Memory: ✅ 31.634MB (SLO: <33.500MB -5.6%) vs baseline: +5.4%


✅ medium_header_no_matches

Time: ✅ 9.827µs (SLO: <20.000µs 📉 -50.9%) vs baseline: -0.3%

Memory: ✅ 31.634MB (SLO: <33.500MB -5.6%) vs baseline: +5.6%


✅ medium_valid_headers_all

Time: ✅ 11.231µs (SLO: <20.000µs 📉 -43.8%) vs baseline: ~same

Memory: ✅ 31.654MB (SLO: <33.500MB -5.5%) vs baseline: +5.6%


✅ none_propagation_style

Time: ✅ 1.678µs (SLO: <10.000µs 📉 -83.2%) vs baseline: -2.2%

Memory: ✅ 31.752MB (SLO: <33.500MB -5.2%) vs baseline: +6.0%


✅ tracecontext_headers

Time: ✅ 35.981µs (SLO: <40.000µs 📉 -10.0%) vs baseline: +5.1%

Memory: ✅ 31.713MB (SLO: <33.500MB -5.3%) vs baseline: +5.8%


✅ valid_headers_all

Time: ✅ 6.527µs (SLO: <10.000µs 📉 -34.7%) vs baseline: +0.3%

Memory: ✅ 31.634MB (SLO: <33.500MB -5.6%) vs baseline: +5.4%


✅ valid_headers_basic

Time: ✅ 6.049µs (SLO: <10.000µs 📉 -39.5%) vs baseline: -0.9%

Memory: ✅ 31.654MB (SLO: <33.500MB -5.5%) vs baseline: +5.6%


✅ wsgi_empty_headers

Time: ✅ 1.589µs (SLO: <10.000µs 📉 -84.1%) vs baseline: -0.9%

Memory: ✅ 31.693MB (SLO: <33.500MB -5.4%) vs baseline: +5.8%


✅ wsgi_invalid_priority_header

Time: ✅ 6.530µs (SLO: <10.000µs 📉 -34.7%) vs baseline: -1.0%

Memory: ✅ 31.674MB (SLO: <33.500MB -5.5%) vs baseline: +5.6%


✅ wsgi_invalid_span_id_header

Time: ✅ 1.595µs (SLO: <10.000µs 📉 -84.1%) vs baseline: +0.4%

Memory: ✅ 31.634MB (SLO: <33.500MB -5.6%) vs baseline: +5.6%


✅ wsgi_invalid_tags_header

Time: ✅ 6.633µs (SLO: <10.000µs 📉 -33.7%) vs baseline: +0.9%

Memory: ✅ 31.674MB (SLO: <33.500MB -5.5%) vs baseline: +5.5%


✅ wsgi_invalid_trace_id_header

Time: ✅ 6.576µs (SLO: <10.000µs 📉 -34.2%) vs baseline: ~same

Memory: ✅ 31.693MB (SLO: <33.500MB -5.4%) vs baseline: +5.6%


✅ wsgi_large_header_no_matches

Time: ✅ 28.814µs (SLO: <40.000µs 📉 -28.0%) vs baseline: +0.7%

Memory: ✅ 31.634MB (SLO: <33.500MB -5.6%) vs baseline: +5.5%


✅ wsgi_large_valid_headers_all

Time: ✅ 29.846µs (SLO: <40.000µs 📉 -25.4%) vs baseline: ~same

Memory: ✅ 31.674MB (SLO: <33.500MB -5.5%) vs baseline: +5.8%


✅ wsgi_medium_header_no_matches

Time: ✅ 10.062µs (SLO: <20.000µs 📉 -49.7%) vs baseline: ~same

Memory: ✅ 31.654MB (SLO: <33.500MB -5.5%) vs baseline: +5.7%


✅ wsgi_medium_valid_headers_all

Time: ✅ 11.490µs (SLO: <20.000µs 📉 -42.6%) vs baseline: -0.4%

Memory: ✅ 31.693MB (SLO: <33.500MB -5.4%) vs baseline: +5.8%


✅ wsgi_valid_headers_all

Time: ✅ 6.575µs (SLO: <10.000µs 📉 -34.3%) vs baseline: ~same

Memory: ✅ 31.674MB (SLO: <33.500MB -5.5%) vs baseline: +5.8%


✅ wsgi_valid_headers_basic

Time: ✅ 6.109µs (SLO: <10.000µs 📉 -38.9%) vs baseline: -0.8%

Memory: ✅ 31.674MB (SLO: <33.500MB -5.5%) vs baseline: +5.5%


httppropagationinject - 16/16

✅ ids_only

Time: ✅ 21.982µs (SLO: <30.000µs 📉 -26.7%) vs baseline: +1.1%

Memory: ✅ 31.654MB (SLO: <33.500MB -5.5%) vs baseline: +5.6%


✅ with_all

Time: ✅ 29.445µs (SLO: <40.000µs 📉 -26.4%) vs baseline: +1.3%

Memory: ✅ 31.634MB (SLO: <33.500MB -5.6%) vs baseline: +5.4%


✅ with_dd_origin

Time: ✅ 25.742µs (SLO: <30.000µs 📉 -14.2%) vs baseline: +0.7%

Memory: ✅ 31.693MB (SLO: <33.500MB -5.4%) vs baseline: +5.8%


✅ with_priority_and_origin

Time: ✅ 25.076µs (SLO: <40.000µs 📉 -37.3%) vs baseline: +0.2%

Memory: ✅ 31.615MB (SLO: <33.500MB -5.6%) vs baseline: +5.3%


✅ with_sampling_priority

Time: ✅ 21.872µs (SLO: <30.000µs 📉 -27.1%) vs baseline: ~same

Memory: ✅ 31.733MB (SLO: <33.500MB -5.3%) vs baseline: +6.0%


✅ with_tags

Time: ✅ 27.552µs (SLO: <40.000µs 📉 -31.1%) vs baseline: +0.7%

Memory: ✅ 31.693MB (SLO: <33.500MB -5.4%) vs baseline: +5.7%


✅ with_tags_invalid

Time: ✅ 29.167µs (SLO: <40.000µs 📉 -27.1%) vs baseline: +1.6%

Memory: ✅ 31.674MB (SLO: <33.500MB -5.5%) vs baseline: +5.8%


✅ with_tags_max_size

Time: ✅ 28.289µs (SLO: <40.000µs 📉 -29.3%) vs baseline: +1.3%

Memory: ✅ 31.674MB (SLO: <33.500MB -5.5%) vs baseline: +5.8%


iast_aspects - 40/40

✅ re_expand_aspect

Time: ✅ 32.300µs (SLO: <40.000µs 📉 -19.3%) vs baseline: +0.2%

Memory: ✅ 37.591MB (SLO: <39.000MB -3.6%) vs baseline: +5.6%


✅ re_expand_noaspect

Time: ✅ 28.586µs (SLO: <40.000µs 📉 -28.5%) vs baseline: +0.8%

Memory: ✅ 37.591MB (SLO: <39.000MB -3.6%) vs baseline: +5.7%


✅ re_findall_aspect

Time: ✅ 2.946µs (SLO: <10.000µs 📉 -70.5%) vs baseline: +0.8%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +5.8%


✅ re_findall_noaspect

Time: ✅ 1.420µs (SLO: <10.000µs 📉 -85.8%) vs baseline: +0.1%

Memory: ✅ 37.572MB (SLO: <39.000MB -3.7%) vs baseline: +5.8%


✅ re_finditer_aspect

Time: ✅ 4.449µs (SLO: <10.000µs 📉 -55.5%) vs baseline: -0.7%

Memory: ✅ 37.572MB (SLO: <39.000MB -3.7%) vs baseline: +5.6%


✅ re_finditer_noaspect

Time: ✅ 1.393µs (SLO: <10.000µs 📉 -86.1%) vs baseline: -1.2%

Memory: ✅ 37.572MB (SLO: <39.000MB -3.7%) vs baseline: +5.6%


✅ re_fullmatch_aspect

Time: ✅ 2.761µs (SLO: <10.000µs 📉 -72.4%) vs baseline: +3.6%

Memory: ✅ 37.591MB (SLO: <39.000MB -3.6%) vs baseline: +6.0%


✅ re_fullmatch_noaspect

Time: ✅ 1.285µs (SLO: <10.000µs 📉 -87.1%) vs baseline: -0.4%

Memory: ✅ 37.591MB (SLO: <39.000MB -3.6%) vs baseline: +5.7%


✅ re_group_aspect

Time: ✅ 3.029µs (SLO: <10.000µs 📉 -69.7%) vs baseline: +2.7%

Memory: ✅ 37.552MB (SLO: <39.000MB -3.7%) vs baseline: +5.6%


✅ re_group_noaspect

Time: ✅ 1.583µs (SLO: <10.000µs 📉 -84.2%) vs baseline: -1.1%

Memory: ✅ 37.572MB (SLO: <39.000MB -3.7%) vs baseline: +5.6%


✅ re_groups_aspect

Time: ✅ 3.095µs (SLO: <10.000µs 📉 -69.0%) vs baseline: +1.1%

Memory: ✅ 37.532MB (SLO: <39.000MB -3.8%) vs baseline: +5.6%


✅ re_groups_noaspect

Time: ✅ 1.722µs (SLO: <10.000µs 📉 -82.8%) vs baseline: +1.3%

Memory: ✅ 37.572MB (SLO: <39.000MB -3.7%) vs baseline: +5.6%


✅ re_match_aspect

Time: ✅ 2.701µs (SLO: <10.000µs 📉 -73.0%) vs baseline: -0.4%

Memory: ✅ 37.572MB (SLO: <39.000MB -3.7%) vs baseline: +5.7%


✅ re_match_noaspect

Time: ✅ 1.310µs (SLO: <10.000µs 📉 -86.9%) vs baseline: +0.5%

Memory: ✅ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +5.9%


✅ re_search_aspect

Time: ✅ 2.706µs (SLO: <10.000µs 📉 -72.9%) vs baseline: +5.8%

Memory: ✅ 37.532MB (SLO: <39.000MB -3.8%) vs baseline: +5.7%


✅ re_search_noaspect

Time: ✅ 1.212µs (SLO: <10.000µs 📉 -87.9%) vs baseline: +0.6%

Memory: ✅ 37.591MB (SLO: <39.000MB -3.6%) vs baseline: +5.9%


✅ re_sub_aspect

Time: ✅ 3.455µs (SLO: <10.000µs 📉 -65.5%) vs baseline: -0.3%

Memory: ✅ 37.572MB (SLO: <39.000MB -3.7%) vs baseline: +5.6%


✅ re_sub_noaspect

Time: ✅ 1.516µs (SLO: <10.000µs 📉 -84.8%) vs baseline: -1.1%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +6.0%


✅ re_subn_aspect

Time: ✅ 3.753µs (SLO: <10.000µs 📉 -62.5%) vs baseline: +1.4%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +6.1%


✅ re_subn_noaspect

Time: ✅ 1.605µs (SLO: <10.000µs 📉 -84.0%) vs baseline: -0.2%

Memory: ✅ 37.572MB (SLO: <39.000MB -3.7%) vs baseline: +5.6%


iastaspectsospath - 24/24

✅ ospathbasename_aspect

Time: ✅ 4.291µs (SLO: <10.000µs 📉 -57.1%) vs baseline: -1.6%

Memory: ✅ 37.552MB (SLO: <39.000MB -3.7%) vs baseline: +5.5%


✅ ospathbasename_noaspect

Time: ✅ 1.085µs (SLO: <10.000µs 📉 -89.1%) vs baseline: -0.6%

Memory: ✅ 37.552MB (SLO: <39.000MB -3.7%) vs baseline: +5.5%


✅ ospathjoin_aspect

Time: ✅ 6.210µs (SLO: <10.000µs 📉 -37.9%) vs baseline: -2.1%

Memory: ✅ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +5.7%


✅ ospathjoin_noaspect

Time: ✅ 2.300µs (SLO: <10.000µs 📉 -77.0%) vs baseline: +0.4%

Memory: ✅ 37.572MB (SLO: <39.000MB -3.7%) vs baseline: +5.7%


✅ ospathnormcase_aspect

Time: ✅ 3.461µs (SLO: <10.000µs 📉 -65.4%) vs baseline: -6.1%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +5.8%


✅ ospathnormcase_noaspect

Time: ✅ 0.568µs (SLO: <10.000µs 📉 -94.3%) vs baseline: +0.1%

Memory: ✅ 37.552MB (SLO: <39.000MB -3.7%) vs baseline: +5.7%


✅ ospathsplit_aspect

Time: ✅ 4.961µs (SLO: <10.000µs 📉 -50.4%) vs baseline: -0.4%

Memory: ✅ 37.572MB (SLO: <39.000MB -3.7%) vs baseline: +5.6%


✅ ospathsplit_noaspect

Time: ✅ 1.591µs (SLO: <10.000µs 📉 -84.1%) vs baseline: -0.4%

Memory: ✅ 37.572MB (SLO: <39.000MB -3.7%) vs baseline: +5.7%


✅ ospathsplitdrive_aspect

Time: ✅ 3.717µs (SLO: <10.000µs 📉 -62.8%) vs baseline: -4.2%

Memory: ✅ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +5.7%


✅ ospathsplitdrive_noaspect

Time: ✅ 0.693µs (SLO: <10.000µs 📉 -93.1%) vs baseline: -1.3%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +6.0%


✅ ospathsplitext_aspect

Time: ✅ 4.736µs (SLO: <10.000µs 📉 -52.6%) vs baseline: ~same

Memory: ✅ 37.572MB (SLO: <39.000MB -3.7%) vs baseline: +5.9%


✅ ospathsplitext_noaspect

Time: ✅ 1.375µs (SLO: <10.000µs 📉 -86.3%) vs baseline: -1.0%

Memory: ✅ 37.591MB (SLO: <39.000MB -3.6%) vs baseline: +5.7%


iastaspectssplit - 12/12

✅ rsplit_aspect

Time: ✅ 1.552µs (SLO: <10.000µs 📉 -84.5%) vs baseline: +9.9%

Memory: ✅ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +5.9%


✅ rsplit_noaspect

Time: ✅ 0.576µs (SLO: <10.000µs 📉 -94.2%) vs baseline: -1.2%

Memory: ✅ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +5.9%


✅ split_aspect

Time: ✅ 1.421µs (SLO: <10.000µs 📉 -85.8%) vs baseline: +1.7%

Memory: ✅ 37.591MB (SLO: <39.000MB -3.6%) vs baseline: +5.8%


✅ split_noaspect

Time: ✅ 0.571µs (SLO: <10.000µs 📉 -94.3%) vs baseline: +0.5%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +5.9%


✅ splitlines_aspect

Time: ✅ 1.463µs (SLO: <10.000µs 📉 -85.4%) vs baseline: +6.7%

Memory: ✅ 37.572MB (SLO: <39.000MB -3.7%) vs baseline: +5.8%


✅ splitlines_noaspect

Time: ✅ 0.584µs (SLO: <10.000µs 📉 -94.2%) vs baseline: ~same

Memory: ✅ 37.591MB (SLO: <39.000MB -3.6%) vs baseline: +6.1%


otelsdkspan - 24/24

✅ add-event

Time: ✅ 40.359ms (SLO: <42.000ms -3.9%) vs baseline: -1.0%

Memory: ✅ 34.387MB (SLO: <39.000MB 📉 -11.8%) vs baseline: +5.6%


✅ add-link

Time: ✅ 36.409ms (SLO: <38.550ms -5.6%) vs baseline: ~same

Memory: ✅ 34.288MB (SLO: <39.000MB 📉 -12.1%) vs baseline: +5.1%


✅ add-metrics

Time: ✅ 220.668ms (SLO: <232.000ms -4.9%) vs baseline: +0.9%

Memory: ✅ 34.367MB (SLO: <39.000MB 📉 -11.9%) vs baseline: +5.5%


✅ add-tags

Time: ✅ 213.248ms (SLO: <221.600ms -3.8%) vs baseline: +0.9%

Memory: ✅ 34.387MB (SLO: <39.000MB 📉 -11.8%) vs baseline: +5.5%


✅ get-context

Time: ✅ 29.193ms (SLO: <31.300ms -6.7%) vs baseline: +0.2%

Memory: ✅ 34.485MB (SLO: <39.000MB 📉 -11.6%) vs baseline: +5.8%


✅ is-recording

Time: ✅ 29.216ms (SLO: <31.000ms -5.8%) vs baseline: -0.4%

Memory: ✅ 34.347MB (SLO: <39.000MB 📉 -11.9%) vs baseline: +5.5%


✅ record-exception

Time: ✅ 63.385ms (SLO: <65.850ms -3.7%) vs baseline: -0.7%

Memory: ✅ 34.387MB (SLO: <39.000MB 📉 -11.8%) vs baseline: +5.4%


✅ set-status

Time: ✅ 32.140ms (SLO: <34.150ms -5.9%) vs baseline: +0.6%

Memory: ✅ 34.387MB (SLO: <39.000MB 📉 -11.8%) vs baseline: +5.5%


✅ start

Time: ✅ 28.966ms (SLO: <30.150ms -3.9%) vs baseline: -0.3%

Memory: ✅ 34.328MB (SLO: <39.000MB 📉 -12.0%) vs baseline: +5.3%


✅ start-finish

Time: ✅ 34.047ms (SLO: <35.350ms -3.7%) vs baseline: -0.2%

Memory: ✅ 34.426MB (SLO: <39.000MB 📉 -11.7%) vs baseline: +5.7%


✅ start-finish-telemetry

Time: ✅ 33.927ms (SLO: <35.450ms -4.3%) vs baseline: -0.1%

Memory: ✅ 34.347MB (SLO: <39.000MB 📉 -11.9%) vs baseline: +5.4%


✅ update-name

Time: ✅ 31.463ms (SLO: <33.400ms -5.8%) vs baseline: +0.8%

Memory: ✅ 34.446MB (SLO: <39.000MB 📉 -11.7%) vs baseline: +5.6%


packagespackageforrootmodulemapping - 4/4

✅ cache_off

Time: ✅ 340.002ms (SLO: <354.300ms -4.0%) vs baseline: -0.8%

Memory: ✅ 37.765MB (SLO: <40.000MB -5.6%) vs baseline: +5.3%


✅ cache_on

Time: ✅ 0.386µs (SLO: <10.000µs 📉 -96.1%) vs baseline: -0.3%

Memory: ✅ 37.350MB (SLO: <39.000MB -4.2%) vs baseline: +7.6%


packagesupdateimporteddependencies - 24/24

✅ import_many

Time: ✅ 154.901µs (SLO: <170.000µs -8.9%) vs baseline: -0.3%

Memory: ✅ 36.347MB (SLO: <38.500MB -5.6%) vs baseline: +5.1%


✅ import_many_cached

Time: ✅ 121.239µs (SLO: <130.000µs -6.7%) vs baseline: +0.5%

Memory: ✅ 36.498MB (SLO: <38.500MB -5.2%) vs baseline: +5.4%


✅ import_many_stdlib

Time: ✅ 1.616ms (SLO: <1.750ms -7.6%) vs baseline: -0.4%

Memory: ✅ 36.703MB (SLO: <38.500MB -4.7%) vs baseline: +5.5%


✅ import_many_stdlib_cached

Time: ✅ 0.963ms (SLO: <1.100ms 📉 -12.4%) vs baseline: -0.4%

Memory: ✅ 36.798MB (SLO: <38.500MB -4.4%) vs baseline: +5.9%


✅ import_many_unknown

Time: ✅ 836.367µs (SLO: <890.000µs -6.0%) vs baseline: +0.8%

Memory: ✅ 36.651MB (SLO: <38.500MB -4.8%) vs baseline: +5.5%


✅ import_many_unknown_cached

Time: ✅ 796.324µs (SLO: <870.000µs -8.5%) vs baseline: -0.3%

Memory: ✅ 36.721MB (SLO: <38.500MB -4.6%) vs baseline: +5.7%


✅ import_one

Time: ✅ 19.855µs (SLO: <30.000µs 📉 -33.8%) vs baseline: +0.3%

Memory: ✅ 36.591MB (SLO: <39.000MB -6.2%) vs baseline: +5.8%


✅ import_one_cache

Time: ✅ 6.267µs (SLO: <10.000µs 📉 -37.3%) vs baseline: -0.2%

Memory: ✅ 36.671MB (SLO: <38.500MB -4.8%) vs baseline: +5.7%


✅ import_one_stdlib

Time: ✅ 18.739µs (SLO: <20.000µs -6.3%) vs baseline: -0.3%

Memory: ✅ 36.666MB (SLO: <38.500MB -4.8%) vs baseline: +5.7%


✅ import_one_stdlib_cache

Time: ✅ 6.259µs (SLO: <10.000µs 📉 -37.4%) vs baseline: +0.3%

Memory: ✅ 36.664MB (SLO: <38.500MB -4.8%) vs baseline: +6.2%


✅ import_one_unknown

Time: ✅ 45.498µs (SLO: <50.000µs -9.0%) vs baseline: +0.2%

Memory: ✅ 36.758MB (SLO: <38.500MB -4.5%) vs baseline: +6.3%


✅ import_one_unknown_cache

Time: ✅ 6.310µs (SLO: <10.000µs 📉 -36.9%) vs baseline: +0.3%

Memory: ✅ 36.658MB (SLO: <38.500MB -4.8%) vs baseline: +6.0%


ratelimiter - 12/12

✅ defaults

Time: ✅ 2.326µs (SLO: <10.000µs 📉 -76.7%) vs baseline: -1.0%

Memory: ✅ 31.123MB (SLO: <34.000MB -8.5%) vs baseline: +5.4%


✅ high_rate_limit

Time: ✅ 2.395µs (SLO: <10.000µs 📉 -76.1%) vs baseline: -0.5%

Memory: ✅ 31.123MB (SLO: <34.000MB -8.5%) vs baseline: +5.5%


✅ long_window

Time: ✅ 2.339µs (SLO: <10.000µs 📉 -76.6%) vs baseline: -1.9%

Memory: ✅ 31.123MB (SLO: <34.000MB -8.5%) vs baseline: +5.5%


✅ low_rate_limit

Time: ✅ 2.341µs (SLO: <10.000µs 📉 -76.6%) vs baseline: -1.2%

Memory: ✅ 31.241MB (SLO: <34.000MB -8.1%) vs baseline: +5.8%


✅ no_rate_limit

Time: ✅ 0.823µs (SLO: <10.000µs 📉 -91.8%) vs baseline: -0.7%

Memory: ✅ 31.202MB (SLO: <34.000MB -8.2%) vs baseline: +6.0%


✅ short_window

Time: ✅ 2.470µs (SLO: <10.000µs 📉 -75.3%) vs baseline: -0.7%

Memory: ✅ 31.182MB (SLO: <34.000MB -8.3%) vs baseline: +5.5%


recursivecomputation - 8/8

✅ deep

Time: ✅ 309.035ms (SLO: <320.950ms -3.7%) vs baseline: -0.1%

Memory: ✅ 32.735MB (SLO: <34.500MB -5.1%) vs baseline: +5.4%


✅ deep-profiled

Time: ✅ 327.378ms (SLO: <359.150ms -8.8%) vs baseline: -0.3%

Memory: ✅ 35.370MB (SLO: <39.000MB -9.3%) vs baseline: +5.2%


✅ medium

Time: ✅ 7.084ms (SLO: <7.400ms -4.3%) vs baseline: +0.3%

Memory: ✅ 31.477MB (SLO: <34.000MB -7.4%) vs baseline: +5.4%


✅ shallow

Time: ✅ 0.954ms (SLO: <1.050ms -9.1%) vs baseline: +0.2%

Memory: ✅ 31.575MB (SLO: <34.000MB -7.1%) vs baseline: +5.8%


samplingrules - 8/8

✅ average_match

Time: ✅ 148.657µs (SLO: <290.000µs 📉 -48.7%) vs baseline: +0.5%

Memory: ✅ 31.595MB (SLO: <34.000MB -7.1%) vs baseline: +5.6%


✅ high_match

Time: ✅ 194.542µs (SLO: <480.000µs 📉 -59.5%) vs baseline: -0.2%

Memory: ✅ 31.654MB (SLO: <34.000MB -6.9%) vs baseline: +6.1%


✅ low_match

Time: ✅ 99.384µs (SLO: <120.000µs 📉 -17.2%) vs baseline: -0.1%

Memory: ✅ 632.147MB (SLO: <700.000MB -9.7%) vs baseline: +4.9%


✅ very_low_match

Time: ✅ 2.900ms (SLO: <8.500ms 📉 -65.9%) vs baseline: +0.2%

Memory: ✅ 69.863MB (SLO: <75.000MB -6.8%) vs baseline: +5.1%


sethttpmeta - 32/32

✅ all-disabled

Time: ✅ 10.681µs (SLO: <20.000µs 📉 -46.6%) vs baseline: +0.7%

Memory: ✅ 32.008MB (SLO: <34.000MB -5.9%) vs baseline: +5.4%


✅ all-enabled

Time: ✅ 40.079µs (SLO: <50.000µs 📉 -19.8%) vs baseline: +0.4%

Memory: ✅ 32.401MB (SLO: <34.000MB -4.7%) vs baseline: +6.8%


✅ collectipvariant_exists

Time: ✅ 41.268µs (SLO: <50.000µs 📉 -17.5%) vs baseline: +1.8%

Memory: ✅ 32.480MB (SLO: <34.000MB -4.5%) vs baseline: +6.9%


✅ no-collectipvariant

Time: ✅ 39.743µs (SLO: <50.000µs 📉 -20.5%) vs baseline: -0.6%

Memory: ✅ 32.086MB (SLO: <34.000MB -5.6%) vs baseline: +5.8%


✅ no-useragentvariant

Time: ✅ 38.627µs (SLO: <50.000µs 📉 -22.7%) vs baseline: -0.4%

Memory: ✅ 32.381MB (SLO: <34.000MB -4.8%) vs baseline: +6.6%


✅ obfuscation-no-query

Time: ✅ 40.519µs (SLO: <50.000µs 📉 -19.0%) vs baseline: +0.4%

Memory: ✅ 32.283MB (SLO: <34.000MB -5.0%) vs baseline: +6.4%


✅ obfuscation-regular-case-explicit-query

Time: ✅ 75.666µs (SLO: <90.000µs 📉 -15.9%) vs baseline: +0.1%

Memory: ✅ 32.440MB (SLO: <34.000MB -4.6%) vs baseline: +5.6%


✅ obfuscation-regular-case-implicit-query

Time: ✅ 76.273µs (SLO: <90.000µs 📉 -15.3%) vs baseline: +0.1%

Memory: ✅ 32.480MB (SLO: <34.000MB -4.5%) vs baseline: +5.7%


✅ obfuscation-send-querystring-disabled

Time: ✅ 153.795µs (SLO: <170.000µs -9.5%) vs baseline: +0.3%

Memory: ✅ 32.480MB (SLO: <34.500MB -5.9%) vs baseline: +5.7%


✅ obfuscation-worst-case-explicit-query

Time: ✅ 147.905µs (SLO: <160.000µs -7.6%) vs baseline: -0.2%

Memory: ✅ 32.440MB (SLO: <34.500MB -6.0%) vs baseline: +5.6%


✅ obfuscation-worst-case-implicit-query

Time: ✅ 154.344µs (SLO: <170.000µs -9.2%) vs baseline: +0.1%

Memory: ✅ 32.440MB (SLO: <34.500MB -6.0%) vs baseline: +5.6%


✅ useragentvariant_exists_1

Time: ✅ 39.562µs (SLO: <50.000µs 📉 -20.9%) vs baseline: +0.5%

Memory: ✅ 32.460MB (SLO: <34.000MB -4.5%) vs baseline: +7.0%


✅ useragentvariant_exists_2

Time: ✅ 40.396µs (SLO: <50.000µs 📉 -19.2%) vs baseline: +0.4%

Memory: ✅ 32.440MB (SLO: <34.000MB -4.6%) vs baseline: +6.9%


✅ useragentvariant_exists_3

Time: ✅ 40.158µs (SLO: <50.000µs 📉 -19.7%) vs baseline: +1.1%

Memory: ✅ 32.342MB (SLO: <34.000MB -4.9%) vs baseline: +6.7%


✅ useragentvariant_not_exists_1

Time: ✅ 39.505µs (SLO: <50.000µs 📉 -21.0%) vs baseline: ~same

Memory: ✅ 32.185MB (SLO: <34.000MB -5.3%) vs baseline: +6.0%


✅ useragentvariant_not_exists_2

Time: ✅ 39.436µs (SLO: <50.000µs 📉 -21.1%) vs baseline: +0.5%

Memory: ✅ 32.244MB (SLO: <34.000MB -5.2%) vs baseline: +6.3%


span - 26/26

✅ add-event

Time: ✅ 24.334ms (SLO: <26.200ms -7.1%) vs baseline: +0.6%

Memory: ✅ 51.214MB (SLO: <53.000MB -3.4%) vs baseline: +5.4%


✅ add-metrics

Time: ✅ 94.047ms (SLO: <98.350ms -4.4%) vs baseline: +2.3%

Memory: ✅ 606.831MB (SLO: <961.000MB 📉 -36.9%) vs baseline: +4.8%


✅ add-tags

Time: ✅ 150.677ms (SLO: <168.550ms 📉 -10.6%) vs baseline: -0.9%

Memory: ✅ 608.069MB (SLO: <962.500MB 📉 -36.8%) vs baseline: +5.0%


✅ get-context

Time: ✅ 22.413ms (SLO: <23.700ms -5.4%) vs baseline: +0.2%

Memory: ✅ 50.133MB (SLO: <53.000MB -5.4%) vs baseline: +5.7%


✅ is-recording

Time: ✅ 22.534ms (SLO: <23.900ms -5.7%) vs baseline: -0.4%

Memory: ✅ 49.998MB (SLO: <53.000MB -5.7%) vs baseline: +5.4%


✅ record-exception

Time: ✅ 43.062ms (SLO: <44.500ms -3.2%) vs baseline: +1.3%

Memory: ✅ 42.853MB (SLO: <53.000MB 📉 -19.1%) vs baseline: +5.4%


✅ set-status

Time: ✅ 24.478ms (SLO: <26.000ms -5.9%) vs baseline: +0.8%

Memory: ✅ 50.163MB (SLO: <53.000MB -5.4%) vs baseline: +5.7%


✅ start

Time: ✅ 22.218ms (SLO: <23.500ms -5.5%) vs baseline: ~same

Memory: ✅ 50.079MB (SLO: <53.000MB -5.5%) vs baseline: +5.5%


✅ start-finish

Time: ✅ 52.594ms (SLO: <55.500ms -5.2%) vs baseline: +1.2%

Memory: ✅ 31.556MB (SLO: <34.000MB -7.2%) vs baseline: +5.4%


✅ start-finish-telemetry

Time: ✅ 54.217ms (SLO: <58.300ms -7.0%) vs baseline: +0.8%

Memory: ✅ 31.575MB (SLO: <34.000MB -7.1%) vs baseline: +5.7%


✅ start-finish-traceid128

Time: ✅ 55.775ms (SLO: <60.050ms -7.1%) vs baseline: +0.4%

Memory: ✅ 31.556MB (SLO: <34.000MB -7.2%) vs baseline: +5.6%


✅ start-traceid128

Time: ✅ 22.552ms (SLO: <24.600ms -8.3%) vs baseline: -0.4%

Memory: ✅ 50.086MB (SLO: <53.000MB -5.5%) vs baseline: +5.5%


✅ update-name

Time: ✅ 23.160ms (SLO: <24.100ms -3.9%) vs baseline: -0.3%

Memory: ✅ 50.695MB (SLO: <53.000MB -4.3%) vs baseline: +5.4%


tracer - 6/6

✅ large

Time: ✅ 30.631ms (SLO: <32.950ms -7.0%) vs baseline: +0.9%

Memory: ✅ 33.148MB (SLO: <34.500MB -3.9%) vs baseline: +5.8%


✅ medium

Time: ✅ 2.975ms (SLO: <3.200ms -7.0%) vs baseline: +0.3%

Memory: ✅ 31.595MB (SLO: <34.000MB -7.1%) vs baseline: +5.7%


✅ small

Time: ✅ 339.828µs (SLO: <370.000µs -8.2%) vs baseline: +0.5%

Memory: ✅ 31.556MB (SLO: <34.000MB -7.2%) vs baseline: +5.4%

ℹ️ Scenarios Missing SLO Configuration (14 scenarios)

The following scenarios exist in candidate data but have no SLO thresholds configured:

  • coreapiscenario-context_with_data_listeners_and_all_listeners
  • coreapiscenario-core_dispatch_listeners
  • coreapiscenario-core_dispatch_listeners_and_all_listeners
  • coreapiscenario-core_dispatch_no_listeners
  • coreapiscenario-core_dispatch_only_all_listeners
  • coreapiscenario-core_dispatch_with_results_listeners
  • coreapiscenario-core_dispatch_with_results_listeners_and_all_listeners
  • coreapiscenario-core_dispatch_with_results_no_listeners
  • coreapiscenario-core_dispatch_with_results_only_all_listeners
  • djangosimple-baseline
  • errortrackingdjangosimple-baseline
  • errortrackingflasksqli-baseline
  • flasksimple-baseline
  • flasksqli-baseline

@gyuheon0h gyuheon0h force-pushed the gyuheon0h/runtime-stack-exp branch from 67e7996 to 8f0e88c Compare September 19, 2025 13:03
@gyuheon0h gyuheon0h force-pushed the gyuheon0h/runtime-stack-exp branch from b6c913c to 4f4c920 Compare September 19, 2025 13:29
@gyuheon0h gyuheon0h added the changelog/no-changelog A changelog entry is not required for this PR. label Sep 19, 2025
@gyuheon0h gyuheon0h changed the title [Do not merge] Crashtracker runtime stack experiment [Do not merge] crashtracker runtime stack experiment Sep 19, 2025
@gyuheon0h gyuheon0h force-pushed the gyuheon0h/runtime-stack-exp branch from c8c071c to cddcbab Compare September 22, 2025 15:13
@gyuheon0h gyuheon0h force-pushed the gyuheon0h/runtime-stack-exp branch from cddcbab to c77224a Compare September 22, 2025 15:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
changelog/no-changelog A changelog entry is not required for this PR.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant