Skip to content

Add end-to-end video input support - #494

Open
octo-patch wants to merge 2 commits into
OpenBMB:mainfrom
octo-patch:octo/20260812-input-capability-recvrHlSeh3buu
Open

Add end-to-end video input support#494
octo-patch wants to merge 2 commits into
OpenBMB:mainfrom
octo-patch:octo/20260812-input-capability-recvrHlSeh3buu

Conversation

@octo-patch

Copy link
Copy Markdown

Reason: MiniMax-M3 supports video input, but PilotDeck cannot represent or route video content end to end.

This change adds canonical video content and persisted-media materialization, tracks video requirements during model routing, downgrades video safely for models without the capability, and serializes URL or base64 video content through compatible request paths.

Checks:

  • pnpm exec tsx --test tests/model/request/*.spec.ts
  • pnpm exec tsc -p tsconfig.json --noEmit

@octo-patch

Copy link
Copy Markdown
Author

Updated commit 2bea82c to serialize video inputs across all compatible request paths and extended videoInput.spec.ts coverage. I ran the focused model-request and tool-result-reference tests (14 passed) plus a targeted TypeScript check.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant