Skip to content
This repository was archived by the owner on Dec 3, 2025. It is now read-only.

PICBIR9W-1166: Fix reason1 multiview#152

Merged
spectralflight merged 15 commits into
nvidia-cosmos:mainfrom
spectralflight:joallen/PICBIR9W-1126-cr1-training
Aug 29, 2025
Merged

PICBIR9W-1166: Fix reason1 multiview#152
spectralflight merged 15 commits into
nvidia-cosmos:mainfrom
spectralflight:joallen/PICBIR9W-1126-cr1-training

Conversation

@spectralflight

@spectralflight spectralflight commented Aug 26, 2025

Copy link
Copy Markdown
Collaborator

Follow-up to #132

  • Fix diffusion loss function.
  • Fix hard-coded text encoder constants.
  • Add missing imaginaire code.
  • Add basic debugging information.

Verification

Almost all changes are all behind a feature-flag.

GitLab CI (failure is also on main): pipelines/34096713
Jira Ticket (contains verification evidence): PICBIR9W-1166

@spectralflight spectralflight changed the title PICBIR9W-1126: Fix CR1 training PICBIR9W-1126: Fix reason1 multiview Aug 26, 2025
@spectralflight spectralflight changed the title PICBIR9W-1126: Fix reason1 multiview PICBIR9W-1166: Fix reason1 multiview Aug 28, 2025
Comment thread imaginaire/utils/qwen_vl_utils.py Outdated
Comment thread imaginaire/networks/qwen2_vl.py Outdated
Comment thread cosmos_predict2/datasets/augmentor_provider.py
loss weights per sigma noise level
"""
return (sigma**2 + self.pipe.sigma_data**2) / (sigma * self.pipe.sigma_data) ** 2
return (1 + sigma) ** 2 / sigma**2

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

is ( sigma == self.pipe.sigma_data )? Is there a possibility when running in batch inference mode, there is no self.pipe and it defaults to 0?

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No clue. Lyne told me to copy this from i4. This is how i4 is as well. No idea why there are 2 variables with identical names.

@spectralflight spectralflight marked this pull request as ready for review August 29, 2025 21:15
@spectralflight spectralflight enabled auto-merge (squash) August 29, 2025 22:03
@spectralflight spectralflight merged commit 58887e8 into nvidia-cosmos:main Aug 29, 2025
1 check passed
zhengkw18 pushed a commit to zhengkw18/cosmos-predict2 that referenced this pull request Aug 30, 2025
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants