Skip to content
This repository was archived by the owner on Dec 3, 2025. It is now read-only.

Adding Camera-Conditioned Video2World capabilities#161

Open
neigbe wants to merge 2 commits into
mainfrom
neigbe/camera-conditioned
Open

Adding Camera-Conditioned Video2World capabilities#161
neigbe wants to merge 2 commits into
mainfrom
neigbe/camera-conditioned

Conversation

@neigbe

@neigbe neigbe commented Sep 3, 2025

Copy link
Copy Markdown
Collaborator

This PR adds camera-conditioned video generation capabilities to cosmos-predict2. Specifically, this code supports:

  • given an input video and a pair of camera trajectories, produces a pair of videos of the same scene from the given camera trajectories
  • given a video from the perspective of a robot's head and the trajectories of its head and hands, produces a pair of videos of the same scene following the robot's hand trajectories

@pjannaty

pjannaty commented Sep 3, 2025

Copy link
Copy Markdown
Contributor

APPROVED_FOR_CI_RUN

1 similar comment
@pjannaty

pjannaty commented Sep 3, 2025

Copy link
Copy Markdown
Contributor

APPROVED_FOR_CI_RUN

@pjannaty

pjannaty commented Sep 3, 2025

Copy link
Copy Markdown
Contributor

pipelines/34347437

@pjannaty pjannaty left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great job!

@pjannaty pjannaty marked this pull request as ready for review September 4, 2025 18:12
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants