Skip to content

🤖 Update Benchmark Results#5843

Merged
thomhurst merged 1 commit intomainfrom
automated-benchmarks-update
May 7, 2026
Merged

🤖 Update Benchmark Results#5843
thomhurst merged 1 commit intomainfrom
automated-benchmarks-update

Conversation

@thomhurst
Copy link
Copy Markdown
Owner

Automated Benchmark Update

This PR updates the benchmark documentation with the latest results from the Speed Comparison workflow.

Benchmarks Produced

Individual benchmark artifacts are available for download:

  • benchmark-DataDrivenTests
  • benchmark-AsyncTests
  • benchmark-ScaleTests
  • benchmark-MatrixTests
  • benchmark-MassiveParallelTests
  • benchmark-SetupTeardownTests
  • benchmark-BuildTime
  • benchmark-summary (aggregated overview)

Runtime Benchmarks

  • AsyncTests
  • DataDrivenTests
  • MassiveParallelTests
  • MatrixTests
  • ScaleTests
  • SetupTeardownTests

Build Benchmarks

  • BuildTime
  • 2026-05-07
  • Ubuntu Latest • .NET SDK 10.0.203

Changes

  • Updated benchmark data in docs/static/benchmarks/latest.json
  • Updated historical trends in docs/static/benchmarks/historical.json
  • Regenerated benchmark documentation in docs/docs/benchmarks/index.md
  • Updated benchmark summary in docs/static/benchmarks/summary.json

Workflow Run

  • Run ID: 25469386160
  • Triggered: schedule
  • Date:

🤖 This PR was automatically created and will be merged automatically once CI checks pass.

@thomhurst thomhurst added automated benchmarks documentation Improvements or additions to documentation ignore-for-release labels May 7, 2026
@thomhurst thomhurst temporarily deployed to Pull Requests May 7, 2026 00:50 — with GitHub Actions Inactive
@thomhurst thomhurst temporarily deployed to Pull Requests May 7, 2026 00:50 — with GitHub Actions Inactive
@thomhurst thomhurst temporarily deployed to Pull Requests May 7, 2026 00:50 — with GitHub Actions Inactive
@thomhurst thomhurst merged commit b85334d into main May 7, 2026
13 checks passed
@thomhurst thomhurst deleted the automated-benchmarks-update branch May 7, 2026 00:50
@codacy-production
Copy link
Copy Markdown

Up to standards ✅

🟢 Issues 0 issues

Results:
0 new issues

View in Codacy

NEW Get contextual insights on your PRs based on Codacy's metrics, along with PR and Jira context, without leaving GitHub. Enable AI reviewer
TIP This summary will be updated as you push new changes.

Copy link
Copy Markdown
Contributor

@claude claude Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Automated Benchmark Update — Review

This is a routine automated PR generated by the Speed Comparison workflow (Run ID: 25469386160, 2026-05-07). No code changes are present — only benchmark data and documentation.

What changed

All modifications follow the expected pattern for this automation:

  • Dates bumped from 2026-05-062026-05-07
  • Performance numbers updated with today's CI run results
  • Chart Y-axis scales adjusted to match new maximums
  • Timestamps in footer lines updated

Notable benchmark observations

Category Direction Notes
AsyncTests TUnit slightly slower (502.8 → 524.5 ms) Normal run-to-run variance; AOT stays dominant at ~122 ms
DataDrivenTests TUnit faster (456 → 433 ms) Good improvement; competitors regressed slightly
MassiveParallelTests Essentially flat (651 → 654 ms) Stable
BuildTime TUnit faster (1.992 → 1.888 s) Consistent improvement trend

The AsyncTests regression (~4.3%) is within expected CI noise given the StdDev values; no concern there.

Review verdict

No issues. The automation is working correctly — all 340 additions are balanced by 340 deletions (pure replacement of stale values). The structure of the generated docs is sound and consistent across all benchmark files.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

automated benchmarks documentation Improvements or additions to documentation ignore-for-release

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant