Profile-powered synthetic tx benchmarks (2/2)

CHANGELOG.md

@@ -9,6 +9,7 @@
 - Added constants support as an immediate value of the repeat statement ([#2548](https://github.com/0xMiden/miden-vm/pull/2548)).
 - Add deserialization of the `MastForest` from untrusted sources. Add fuzzing for MastForest deserialization. ([#2590](https://github.com/0xMiden/miden-vm/pull/2590)).
 - Added `StackInterface::get_double_word()` method for reading 8 consecutive stack elements ([#2607](https://github.com/0xMiden/miden-vm/pull/2607)).
+- Added synthetic transaction kernel benchmarks driven by VM profile snapshots from miden-base ([#2638](https://github.com/0xMiden/miden-vm/pull/2638)).
 
 #### Fixes
 

Cargo.toml

@@ -1,6 +1,7 @@
 [workspace]
 members = [
     "air",
+    "benches/synthetic-tx-kernel",
     "core",
     "crates/assembly",
     "crates/assembly-syntax",

Makefile

@@ -188,7 +188,7 @@ build: ## Builds with default parameters
 
 .PHONY: build-no-std
 build-no-std: ## Builds without the standard library
-	$(BUILDDOCS) cargo build --no-default-features --target wasm32-unknown-unknown --workspace
+	$(BUILDDOCS) cargo build --no-default-features --target wasm32-unknown-unknown --workspace --exclude synthetic-tx-kernel
 
 # --- executable ----------------------------------------------------------------------------------
 

benches/synthetic-tx-kernel/Cargo.toml

@@ -0,0 +1,26 @@
+[package]
+name = "synthetic-tx-kernel"
+version = "0.1.0"
+edition = "2021"
+license.workspace = true
+
+[dependencies]
+miden-vm = { path = "../../miden-vm" }
+miden-core = { path = "../../core" }
+miden-processor = { path = "../../processor", default-features = false, features = ["concurrent"] }
+miden-core-lib = { path = "../../crates/lib/core" }
+serde = { version = "1.0", features = ["derive"] }
+serde_json = "1.0"
+anyhow = "1.0"
+
+[dev-dependencies]
+criterion = { version = "0.5", features = ["async_tokio"] }
+tokio = { version = "1.0", features = ["rt-multi-thread"] }
+
+[[bench]]
+name = "component_benchmarks"
+harness = false
+
+[[bench]]
+name = "synthetic_kernel"
+harness = false

benches/synthetic-tx-kernel/README.md

@@ -0,0 +1,78 @@
+# Synthetic Transaction Kernel Benchmarks
+
+This crate generates synthetic benchmarks that mirror the transaction kernel from miden-base,
+enabling fast feedback for VM developers without requiring the full miden-base dependency.
+
+## Overview
+
+The benchmark system works by:
+
+1. **Profile Export** (in miden-base): The transaction kernel benchmark exports a VM profile
+describing its instruction mix, operation counts, and cycle breakdown.
+
+2. **Profile Consumption** (in miden-vm): This crate reads the profile and generates Miden
+assembly code that replicates the same workload characteristics.
+
+3. **Benchmark Execution**: Criterion.rs runs the generated benchmarks for statistical rigor.
+
+## Usage
+
+### Running Benchmarks
+
+```bash
+# Run component benchmarks (isolated operations)
+cargo bench -p synthetic-tx-kernel --bench component_benchmarks
+
+# Run synthetic kernel benchmark (representative workload)
+cargo bench -p synthetic-tx-kernel --bench synthetic_kernel
+```
+
+### Updating the Profile
+
+When the transaction kernel in miden-base changes:
+
+1. Run benchmarks in miden-base:
+```bash
+cd /path/to/miden-base
+cargo run --bin bench-transaction --features concurrent
+```
+
+2. Copy the generated profile to `latest.json`:
+```bash
+cp bench-tx-vm-profile.json /path/to/miden-vm/benches/synthetic-tx-kernel/profiles/latest.json
+```
+
+3. Commit the updated profile in miden-vm.
+
+## Profile Format
+
+Profiles are JSON files with the following structure:
+
+```json
+{
+  "profile_version": "1.0",
+  "source": "miden-base/bin/bench-transaction",
+  "timestamp": "2025-01-31T...",
+  "miden_vm_version": "0.20.0",
+  "transaction_kernel": {
+    "total_cycles": 73123,
+    "phases": { ... },
+    "instruction_mix": {
+      "arithmetic": 0.05,
+      "hashing": 0.45,
+      "memory": 0.08,
+      "control_flow": 0.05,
+      "signature_verify": 0.37
+    }
+  }
+}
+```
+
+## Architecture
+
+- `src/profile.rs`: Profile data structures
+- `src/generator.rs`: MASM code generation from profiles
+- `src/validator.rs`: Profile validation and comparison
+- `benches/component_benchmarks.rs`: Isolated operation benchmarks
+- `benches/synthetic_kernel.rs`: Representative workload benchmark
+- `profiles/`: Checked-in VM profiles from miden-base