Skip to content

🤖 Update Mock Benchmark Results#5844

Merged
thomhurst merged 1 commit intomainfrom
automated-mock-benchmarks-update
May 7, 2026
Merged

🤖 Update Mock Benchmark Results#5844
thomhurst merged 1 commit intomainfrom
automated-mock-benchmarks-update

Conversation

@thomhurst
Copy link
Copy Markdown
Owner

Automated Mock Benchmark Update

This PR updates the mock benchmark documentation with the latest results from the Mock Benchmarks workflow.

Benchmarks Produced

Individual benchmark artifacts are available for download:

  • mock-benchmark-MockCreation
  • mock-benchmark-Setup
  • mock-benchmark-Invocation
  • mock-benchmark-Verification
  • mock-benchmark-Callback
  • mock-benchmark-CombinedWorkflow
  • mock-benchmark-summary (aggregated overview)

Libraries Compared

Libraries are discovered dynamically from the benchmark output. See the generated summary.json for the full list.

Changes

  • Updated mock benchmark data in docs/static/benchmarks/mocks/latest.json
  • Regenerated mock benchmark documentation in docs/docs/benchmarks/mocks/
  • Updated mock benchmark summary in docs/static/benchmarks/mocks/summary.json

Workflow Run

  • Run ID: 25473991379
  • Triggered: schedule

🤖 This PR was automatically created and will be merged automatically once CI checks pass.

@thomhurst thomhurst added automated benchmarks documentation Improvements or additions to documentation ignore-for-release labels May 7, 2026
@thomhurst thomhurst deployed to Pull Requests May 7, 2026 03:27 — with GitHub Actions Active
@thomhurst thomhurst temporarily deployed to Pull Requests May 7, 2026 03:27 — with GitHub Actions Inactive
@thomhurst thomhurst temporarily deployed to Pull Requests May 7, 2026 03:27 — with GitHub Actions Inactive
@thomhurst thomhurst merged commit e17af9d into main May 7, 2026
12 of 13 checks passed
@thomhurst thomhurst deleted the automated-mock-benchmarks-update branch May 7, 2026 03:27
@codacy-production
Copy link
Copy Markdown

Up to standards ✅

🟢 Issues 0 issues

Results:
0 new issues

View in Codacy

NEW Get contextual insights on your PRs based on Codacy's metrics, along with PR and Jira context, without leaving GitHub. Enable AI reviewer
TIP This summary will be updated as you push new changes.

Copy link
Copy Markdown
Contributor

@claude claude Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Review: Automated Mock Benchmark Update

This is a clean, automated data refresh — docs-only changes with no code modifications. Everything looks well-structured.

What's here

All 15 files changed are in docs/ and fall into two categories:

  • JSON data files (docs/static/benchmarks/mocks/) — raw benchmark results updated from the 2026-05-07 CI run
  • Generated markdown (docs/docs/benchmarks/mocks/) — docs regenerated from the JSON, including chart axis ranges, tables, and timestamps

Diffs are mechanically consistent: every timestamp, table value, and chart scale updated in lockstep across .json and .md files.

Notable result changes

Most deltas are within normal benchmark noise (~1–5%). One result stands out:

Benchmark Before After Change
CombinedWorkflow — Moq 313 μs 406 μs +30%
CombinedWorkflow — TUnit.Mocks 1.94 μs 1.68 μs -13% (improvement)

The Moq CombinedWorkflow regression is notable (~30%) but is almost certainly CI environmental variance on a single run rather than a real regression — single-run benchmarks on shared CI infrastructure frequently show this kind of outlier. If this pattern recurs across consecutive runs it may be worth flagging, but nothing actionable here.

No issues found

The automation is working correctly. Changes are properly scoped, consistently applied across all related files, and the generated output matches the source data. Good to merge once CI passes.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

automated benchmarks documentation Improvements or additions to documentation ignore-for-release

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant