Add multi-control transfer inference smoke test#77
Merged
Conversation
Add `test_nano_inference_multi_control_transfer` to the Cosmos3-Nano generator inference smoke test, mirroring the existing single-control transfer run (latency preset, 4 ranks -> cfgp=2/cp=2). The generated spec sets two control hints (edge + blur) with per-hint weights and no control_path, so both controls are derived on the fly from a single `vision_path` (the pinned public robot_pouring.mp4 clip) and blended by `multi_control_two_way_attention` (N maskless SDPA passes summed by weight). This exercises the multi-control path added in the multi-control transfer inference feature. Asserts: exactly one output; both edge and blur hints active with a per-hint weight and no control_path; vision_path set; control_guidance and guidance > 1.0; and a non-degenerate vision.mp4 (via the existing _assert_video_has_content). Smoke-level (output validity + path executed under the framework's multi-control runtime asserts), not numeric goldens. Verified end to end on a 4-rank latency run (exit 0, both controls computed on the fly, all assertions pass). Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
foreverlms
approved these changes
Jul 2, 2026
Dinghow
approved these changes
Jul 2, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What
Adds
test_nano_inference_multi_control_transfertotests/nano_inference_smoke_test.py, giving the Cosmos3-Nano generator inference smoke test coverage for the multi-control transfer feature (two control hints blended bymulti_control_two_way_attention).It mirrors the existing single-control transfer run (same
latencypreset, 4 ranks → cfgp=2/cp=2), but the generated spec sets two hints (edge+blur) with per-hintweightand nocontrol_path, so both controls are computed on the fly from a singlevision_path(the pinned publicrobot_pouring.mp4clip) and aggregated by the weighted N-pass multi-control attention.What it verifies
control_weightsset → the network routes tomulti_control_two_way_attention(both controls computed on the fly).edgeandbluractive with aweightand nocontrol_path;vision_pathset;control_guidanceandguidance> 1.0.vision.mp4via the existing_assert_video_has_content(≥16 frames, finite pixels, pixel std > 3).Smoke-level (output validity + path executed under asserts), not numeric goldens — consistent with the rest of the module.
Test
Runs on the same 8-GPU gate as
test_nano_inference_omni:Verified end to end on a 4-rank
latencyrun (exit 0; log shows bothComputing edge control input on the flyandComputing blur control input on the fly; all assertions pass). Collection confirmed both tests register (MAX_GPUS=8).🤖 Generated with Claude Code