[Not for merge] Contrastive Language-Speech Pre-training (CLSP) Recipe#2053

Draft

yfyeung wants to merge 27 commits into

k2-fsa:masterfrom

Commits on Dec 3, 2025

init

severusyang
authored and
yfyeung
committed
try to init clap model

severusyang
authored and
yfyeung
committed
fix utils.py

severusyang
authored and
yfyeung
committed
update

severusyang
authored and
yfyeung
committed
support strict fixed batch size

severusyang
authored and
yfyeung
committed
unwrap model for rank0-only evaluation to avoid NCCL hang

severusyang
authored and
yfyeung
committed
use while-loop for strict batch sync, remove sampler state_dict

severusyang
authored and
yfyeung
committed
use emilia webdataset and split out test_fixedbucketbatchsizeconstraint
yfyeung
committed
add paraspeechcaps manifests and support evaluate retrieval
yfyeung
committed
use short caption from paraspeechcaps
yfyeung
committed

Commits on Dec 4, 2025

add normalization for paraspeechcaps
yfyeung
committed

Commits on Dec 8, 2025

add attach_caption
yfyeung
committed

Commits on Dec 10, 2025

Commits on Dec 15, 2025

support multi-positive labels
yfyeung
committed

Commits on Dec 16, 2025

support export retrieval details
yfyeung
committed

Commits on Dec 18, 2025

fix
yfyeung
committed

Commits on Dec 25, 2025

Commits on Dec 26, 2025

Commits on Jan 27, 2026

add clsp recipe
yfyeung
committed