[Compiler] Re-use static to sema conversions in vm. #4287

RZhang05 · 2025-10-14T18:04:00Z

Description

Re-use static to sema conversions from the compiler in the vm. Tried various changes in the linker to no success, tried caching static type ID calls, which was an improvement but affects execution, so not included.

              │ ./bbq/vm/test/old-3.txt │   ./bbq/vm/test/optimized-2.txt   │
              │         sec/op          │   sec/op     vs base              │
FTTransfer-14               39.10µ ± 2%   38.43µ ± 2%  -1.73% (p=0.007 n=8)

              │ ./bbq/vm/test/old-3.txt │ ./bbq/vm/test/optimized-2.txt │
              │          B/op           │     B/op      vs base         │
FTTransfer-14              36.93Ki ± 0%   36.93Ki ± 0%  ~ (p=0.660 n=8)

              │ ./bbq/vm/test/old-3.txt │ ./bbq/vm/test/optimized-2.txt │
              │        allocs/op        │ allocs/op   vs base           │
FTTransfer-14                965.0 ± 0%   965.0 ± 0%  ~ (p=1.000 n=8) ¹

Targeted PR against master branch
Linked to Github issue with discussion and accepted design OR link to spec that describes this work
Code follows the standards mentioned here
Updated relevant documentation
Re-reviewed Files changed in the Github PR explorer
Added appropriate labels

github-actions · 2025-10-14T18:09:46Z

Benchstat comparison

Base branch: onflow:master
Base commit: 3ec0c24

Results

	old.txt	new.txt
	time/op		delta
pkg:github.com/onflow/cadence/runtime goos:linux goarch:amd64
ContractFunctionInvocation-4	405µs ± 0%	401µs ± 0%	~	(p=1.000 n=1+1)
pkg:github.com/onflow/cadence/bbq/vm/test goos:linux goarch:amd64
ContractImport-4	228µs ± 0%	223µs ± 0%	~	(p=1.000 n=1+1)
pkg:github.com/onflow/cadence/runtime goos:linux goarch:amd64
ExportType/composite_type-4	264ns ± 0%	267ns ± 0%	~	(p=1.000 n=1+1)
ExportType/simple_type-4	77.9ns ± 0%	78.0ns ± 0%	~	(p=1.000 n=1+1)
pkg:github.com/onflow/cadence/bbq/vm/test goos:linux goarch:amd64
FTTransfer-4	122µs ± 0%	123µs ± 0%	~	(p=1.000 n=1+1)
pkg:github.com/onflow/cadence/interpreter goos:linux goarch:amd64
ImperativeFib-4	20.1µs ± 0%	19.9µs ± 0%	~	(p=1.000 n=1+1)
pkg:github.com/onflow/cadence/bbq/vm/test goos:linux goarch:amd64
ImperativeFib-4	13.6µs ± 0%	14.1µs ± 0%	~	(p=1.000 n=1+1)
ImperativeFibNewCompilerNewVM-4	35.0µs ± 0%	35.2µs ± 0%	~	(p=1.000 n=1+1)
ImperativeFibNewVM-4	16.2µs ± 0%	16.2µs ± 0%	~	(p=1.000 n=1+1)
pkg:github.com/onflow/cadence/interpreter goos:linux goarch:amd64
InterpretRecursionFib-4	2.03ms ± 0%	2.05ms ± 0%	~	(p=1.000 n=1+1)
pkg:github.com/onflow/cadence/bbq/vm/test goos:linux goarch:amd64
InterpreterFTTransfer-4	110µs ± 0%	113µs ± 0%	~	(p=1.000 n=1+1)
InterpreterImperativeFib-4	20.5µs ± 0%	20.1µs ± 0%	~	(p=1.000 n=1+1)
InterpreterNewStruct-4	63.6µs ± 0%	62.3µs ± 0%	~	(p=1.000 n=1+1)
MethodCall/concrete_type_method_call-4	46.1µs ± 0%	46.2µs ± 0%	~	(p=1.000 n=1+1)
MethodCall/interface_method_call-4	67.3µs ± 0%	64.7µs ± 0%	~	(p=1.000 n=1+1)
pkg:github.com/onflow/cadence/interpreter goos:linux goarch:amd64
NewInterpreter/new_interpreter-4	1.04µs ± 0%	1.03µs ± 0%	~	(p=1.000 n=1+1)
NewInterpreter/new_sub-interpreter-4	324ns ± 0%	318ns ± 0%	~	(p=1.000 n=1+1)
pkg:github.com/onflow/cadence/bbq/vm/test goos:linux goarch:amd64
NewResource-4	86.2µs ± 0%	85.0µs ± 0%	~	(p=1.000 n=1+1)
NewStruct-4	34.2µs ± 0%	34.7µs ± 0%	~	(p=1.000 n=1+1)
NewStructRaw-4	3.83µs ± 0%	3.75µs ± 0%	~	(p=1.000 n=1+1)
RecursionFib-4	764µs ± 0%	801µs ± 0%	~	(p=1.000 n=1+1)
RuntimeFungibleTokenTransfer-4	721µs ± 0%	742µs ± 0%	~	(p=1.000 n=1+1)
pkg:github.com/onflow/cadence/runtime goos:linux goarch:amd64
RuntimeFungibleTokenTransferInterpreter-4	594µs ± 0%	592µs ± 0%	~	(p=1.000 n=1+1)
RuntimeFungibleTokenTransferVM-4	657µs ± 0%	634µs ± 0%	~	(p=1.000 n=1+1)
RuntimeResourceDictionaryValues-4	2.68ms ± 0%	2.67ms ± 0%	~	(p=1.000 n=1+1)
RuntimeResourceTracking-4	12.3ms ± 0%	12.2ms ± 0%	~	(p=1.000 n=1+1)
RuntimeScriptNoop-4	15.0µs ± 0%	14.6µs ± 0%	~	(p=1.000 n=1+1)
RuntimeVMInvokeContractImperativeFib-4	29.0µs ± 0%	28.4µs ± 0%	~	(p=1.000 n=1+1)
pkg:github.com/onflow/cadence/interpreter goos:linux goarch:amd64
ValueIsSubtypeOfSemaType-4	72.4ns ± 0%	72.4ns ± 0%	~	(p=1.000 n=1+1)

	alloc/op		delta
pkg:github.com/onflow/cadence/runtime goos:linux goarch:amd64
ContractFunctionInvocation-4	152kB ± 0%	152kB ± 0%	~	(p=1.000 n=1+1)
pkg:github.com/onflow/cadence/bbq/vm/test goos:linux goarch:amd64
ContractImport-4	74.0kB ± 0%	73.9kB ± 0%	~	(p=1.000 n=1+1)
pkg:github.com/onflow/cadence/runtime goos:linux goarch:amd64
ExportType/composite_type-4	120B ± 0%	120B ± 0%	~	(all equal)
ExportType/simple_type-4	0.00B	0.00B	~	(all equal)
pkg:github.com/onflow/cadence/bbq/vm/test goos:linux goarch:amd64
FTTransfer-4	37.8kB ± 0%	37.8kB ± 0%	~	(p=1.000 n=1+1)
pkg:github.com/onflow/cadence/interpreter goos:linux goarch:amd64
ImperativeFib-4	8.30kB ± 0%	8.30kB ± 0%	~	(all equal)
pkg:github.com/onflow/cadence/bbq/vm/test goos:linux goarch:amd64
ImperativeFib-4	1.94kB ± 0%	1.94kB ± 0%	~	(all equal)
ImperativeFibNewCompilerNewVM-4	21.8kB ± 0%	21.8kB ± 0%	~	(p=1.000 n=1+1)
ImperativeFibNewVM-4	4.66kB ± 0%	4.33kB ± 0%	~	(p=1.000 n=1+1)
pkg:github.com/onflow/cadence/interpreter goos:linux goarch:amd64
InterpretRecursionFib-4	1.19MB ± 0%	1.19MB ± 0%	~	(p=1.000 n=1+1)
pkg:github.com/onflow/cadence/bbq/vm/test goos:linux goarch:amd64
InterpreterFTTransfer-4	37.6kB ± 0%	37.6kB ± 0%	~	(p=1.000 n=1+1)
InterpreterImperativeFib-4	8.29kB ± 0%	8.29kB ± 0%	~	(all equal)
InterpreterNewStruct-4	24.5kB ± 0%	24.5kB ± 0%	~	(p=1.000 n=1+1)
MethodCall/concrete_type_method_call-4	6.94kB ± 0%	6.94kB ± 0%	~	(all equal)
MethodCall/interface_method_call-4	14.5kB ± 0%	13.7kB ± 0%	~	(p=1.000 n=1+1)
pkg:github.com/onflow/cadence/interpreter goos:linux goarch:amd64
NewInterpreter/new_interpreter-4	976B ± 0%	976B ± 0%	~	(all equal)
NewInterpreter/new_sub-interpreter-4	232B ± 0%	232B ± 0%	~	(all equal)
pkg:github.com/onflow/cadence/bbq/vm/test goos:linux goarch:amd64
NewResource-4	40.4kB ± 0%	40.4kB ± 0%	~	(p=1.000 n=1+1)
NewStruct-4	10.4kB ± 0%	10.3kB ± 0%	~	(p=1.000 n=1+1)
NewStructRaw-4	2.61kB ± 0%	2.57kB ± 0%	~	(p=1.000 n=1+1)
RecursionFib-4	88.1kB ± 0%	88.1kB ± 0%	~	(all equal)
RuntimeFungibleTokenTransfer-4	231kB ± 0%	232kB ± 0%	~	(p=1.000 n=1+1)
pkg:github.com/onflow/cadence/runtime goos:linux goarch:amd64
RuntimeFungibleTokenTransferInterpreter-4	155kB ± 0%	155kB ± 0%	~	(p=1.000 n=1+1)
RuntimeFungibleTokenTransferVM-4	174kB ± 0%	173kB ± 0%	~	(p=1.000 n=1+1)
RuntimeResourceDictionaryValues-4	1.77MB ± 0%	1.76MB ± 0%	~	(p=1.000 n=1+1)
RuntimeResourceTracking-4	9.26MB ± 0%	9.26MB ± 0%	~	(p=1.000 n=1+1)
RuntimeScriptNoop-4	7.99kB ± 0%	7.98kB ± 0%	~	(p=1.000 n=1+1)
RuntimeVMInvokeContractImperativeFib-4	10.3kB ± 0%	9.9kB ± 0%	~	(p=1.000 n=1+1)
pkg:github.com/onflow/cadence/interpreter goos:linux goarch:amd64
ValueIsSubtypeOfSemaType-4	48.0B ± 0%	48.0B ± 0%	~	(all equal)

	allocs/op		delta
pkg:github.com/onflow/cadence/runtime goos:linux goarch:amd64
ContractFunctionInvocation-4	2.47k ± 0%	2.47k ± 0%	~	(all equal)
pkg:github.com/onflow/cadence/bbq/vm/test goos:linux goarch:amd64
ContractImport-4	931 ± 0%	931 ± 0%	~	(all equal)
pkg:github.com/onflow/cadence/runtime goos:linux goarch:amd64
ExportType/composite_type-4	3.00 ± 0%	3.00 ± 0%	~	(all equal)
ExportType/simple_type-4	0.00	0.00	~	(all equal)
pkg:github.com/onflow/cadence/bbq/vm/test goos:linux goarch:amd64
FTTransfer-4	965 ± 0%	965 ± 0%	~	(all equal)
pkg:github.com/onflow/cadence/interpreter goos:linux goarch:amd64
ImperativeFib-4	176 ± 0%	176 ± 0%	~	(all equal)
pkg:github.com/onflow/cadence/bbq/vm/test goos:linux goarch:amd64
ImperativeFib-4	49.0 ± 0%	49.0 ± 0%	~	(all equal)
ImperativeFibNewCompilerNewVM-4	210 ± 0%	210 ± 0%	~	(all equal)
ImperativeFibNewVM-4	86.0 ± 0%	84.0 ± 0%	~	(p=1.000 n=1+1)
pkg:github.com/onflow/cadence/interpreter goos:linux goarch:amd64
InterpretRecursionFib-4	17.7k ± 0%	17.7k ± 0%	~	(all equal)
pkg:github.com/onflow/cadence/bbq/vm/test goos:linux goarch:amd64
InterpreterFTTransfer-4	788 ± 0%	788 ± 0%	~	(all equal)
InterpreterImperativeFib-4	175 ± 0%	175 ± 0%	~	(all equal)
InterpreterNewStruct-4	418 ± 0%	418 ± 0%	~	(all equal)
MethodCall/concrete_type_method_call-4	135 ± 0%	135 ± 0%	~	(all equal)
MethodCall/interface_method_call-4	285 ± 0%	275 ± 0%	~	(p=1.000 n=1+1)
pkg:github.com/onflow/cadence/interpreter goos:linux goarch:amd64
NewInterpreter/new_interpreter-4	15.0 ± 0%	15.0 ± 0%	~	(all equal)
NewInterpreter/new_sub-interpreter-4	4.00 ± 0%	4.00 ± 0%	~	(all equal)
pkg:github.com/onflow/cadence/bbq/vm/test goos:linux goarch:amd64
NewResource-4	735 ± 0%	735 ± 0%	~	(all equal)
NewStruct-4	219 ± 0%	219 ± 0%	~	(all equal)
NewStructRaw-4	38.0 ± 0%	38.0 ± 0%	~	(all equal)
RecursionFib-4	3.65k ± 0%	3.65k ± 0%	~	(all equal)
RuntimeFungibleTokenTransfer-4	3.94k ± 0%	3.94k ± 0%	~	(all equal)
pkg:github.com/onflow/cadence/runtime goos:linux goarch:amd64
RuntimeFungibleTokenTransferInterpreter-4	2.93k ± 0%	2.93k ± 0%	~	(all equal)
RuntimeFungibleTokenTransferVM-4	3.06k ± 0%	2.99k ± 0%	~	(p=1.000 n=1+1)
RuntimeResourceDictionaryValues-4	36.7k ± 0%	36.7k ± 0%	~	(p=1.000 n=1+1)
RuntimeResourceTracking-4	159k ± 0%	159k ± 0%	~	(all equal)
RuntimeScriptNoop-4	113 ± 0%	113 ± 0%	~	(all equal)
RuntimeVMInvokeContractImperativeFib-4	213 ± 0%	207 ± 0%	~	(p=1.000 n=1+1)
pkg:github.com/onflow/cadence/interpreter goos:linux goarch:amd64
ValueIsSubtypeOfSemaType-4	1.00 ± 0%	1.00 ± 0%	~	(all equal)

SupunS

It's surprising how/why caching doesn't improve the performance, given that first iteration of caching in #4054 gave us some improvement.

Given that we already cache it after the very first conversion, maybe that initial conversion overhead is trivial?
Could you please add some more stat: for example, the number of cache hits/misses before and after the improvement?

Additionally, do we also need to cache types coming from the imports / for the imported programs?

SupunS · 2025-10-17T21:26:46Z

bbq/program.go

+	Variables     []Variable[E]
+	Types         []T
+	Globals       []Global
+	SemaTypeCache map[sema.TypeID]sema.Type


bbq.Program is currently serializable (and deserializable), even though we don't make use of it at the moment. But, we would lose this capability if we include sema.Type information in bbq.Program.

Could we instead pass this mapping externally? i.e: maybe as part of the vm.Config?

RZhang05 added 2 commits October 10, 2025 16:44

Reuse sema types from compiler, remove sema type in member access check.

85c0635

Add comments.

5d2ff5c

RZhang05 changed the title ~~Reuse sema types from compiler, remove sema type in member access check.~~ [Compiler] Re-use static to sema conversions in vm. Oct 14, 2025

Update type conversion memory metering test.

a11e16b

RZhang05 self-assigned this Oct 14, 2025

RZhang05 added 2 commits October 14, 2025 14:56

Update runtime test.

2962daa

Add type cache of linked programs.

751e32e

RZhang05 added the Improvement label Oct 14, 2025

Fix linker changes.

d6167e7

RZhang05 force-pushed the raymond/optimize-static-to-sema branch from 84d40f6 to d6167e7 Compare October 14, 2025 19:23

RZhang05 added 2 commits October 14, 2025 17:04

Revert check member access changes.

273842a

Remove linker changes to reuse compiler types.

7bc4611

RZhang05 force-pushed the raymond/optimize-static-to-sema branch from 22c2edb to 7bc4611 Compare October 15, 2025 19:30

Fix runtime tests.

b7fad6b

RZhang05 force-pushed the raymond/optimize-static-to-sema branch from 3c317a6 to b7fad6b Compare October 15, 2025 19:37

RZhang05 marked this pull request as ready for review October 15, 2025 20:22

RZhang05 requested review from SupunS and turbolent as code owners October 15, 2025 20:22

SupunS reviewed Oct 17, 2025

View reviewed changes

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

[Compiler] Re-use static to sema conversions in vm. #4287

[Compiler] Re-use static to sema conversions in vm. #4287

Uh oh!

RZhang05 commented Oct 14, 2025 •

edited

Loading

Uh oh!

github-actions bot commented Oct 14, 2025 •

edited

Loading

Uh oh!

SupunS left a comment •

edited

Loading

Uh oh!

SupunS Oct 17, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

[Compiler] Re-use static to sema conversions in vm. #4287

Are you sure you want to change the base?

[Compiler] Re-use static to sema conversions in vm. #4287

Uh oh!

Conversation

RZhang05 commented Oct 14, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Description

Uh oh!

github-actions bot commented Oct 14, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchstat comparison

Uh oh!

SupunS left a comment • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

SupunS Oct 17, 2025

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

RZhang05 commented Oct 14, 2025 •

edited

Loading

github-actions bot commented Oct 14, 2025 •

edited

Loading

SupunS left a comment •

edited

Loading