Comparative analysis of MLA vs MLA-o model behavior

[chrisjmccormick]

We have identically trained models with and without output latent space. This creates opportunities for detailed behavioral analysis.

Tasks:

• Gather ideas on what we might look at.
  • Ask for suggestions from communities and interp. researchers.

Research Question: What behavioral differences emerge from the output subspace constraint?