Search results

Comparative analysis of MLA vs MLA-o model behavior

Status: Open.

#12 In chrisjmccormick/shared-subspaces;

· chrisjmccormick opened on Sep 3, 2025

MoE router health analysis

Status: Open.

#11 In chrisjmccormick/shared-subspaces;

· chrisjmccormick opened on Sep 3, 2025

Query vs Output subspace impact comparison

ablation

architecture

benchmarking

throughput

Status: Open.

#10 In chrisjmccormick/shared-subspaces;

· chrisjmccormick opened on Sep 3, 2025

Investigate high gradient norms in MLA-o training

Status: Open.

#9 In chrisjmccormick/shared-subspaces;

· chrisjmccormick opened on Sep 3, 2025

Systematic throughput benchmarking to identify MLA-o advantages

benchmarking

decoder

throughput

Status: Open.

#8 In chrisjmccormick/shared-subspaces;

· chrisjmccormick opened on Sep 3, 2025

Fix RoPE dimension split issue for balanced head configurations

Status: Open.

#7 In chrisjmccormick/shared-subspaces;

· chrisjmccormick opened on Sep 3, 2025

Add a subspace_encoder config that runs quickly as a demo

Status: Open.

#2 In chrisjmccormick/shared-subspaces;

· chrisjmccormick opened on Aug 14, 2025

Set up an on-ramp for new community members

Status: Open.

#1 In chrisjmccormick/shared-subspaces;

· chrisjmccormick opened on Aug 14, 2025