Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
3 changes: 3 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -73,3 +73,6 @@ sample_data/

# ai
.claude/

# results
results/
Binary file removed L19_cluster.png
Binary file not shown.
Binary file removed L20_cluster.png
Binary file not shown.
Binary file removed L21_cluster.png
Binary file not shown.
23 changes: 23 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -295,8 +295,31 @@ chuk-lazarus introspect ablate -m model -p "What's the weather?" -c function_cal
# Multi-layer ablation - test layers together
chuk-lazarus introspect ablate -m model -p "45 * 45 = " -c "2025" --layers 22,23 --multi

# Test if task type is baked into embeddings (RLVF hypothesis)
chuk-lazarus introspect embedding -m model

# Analyze operand encoding structure (holistic vs compositional)
chuk-lazarus introspect operand-directions -m model

# Test commutativity (lookup table vs algorithm)
chuk-lazarus introspect commutativity -m model

# Activation patching between prompts
chuk-lazarus introspect patch -m model --source "7*8=" --target "7+8="

# Low-level hook demonstration
chuk-lazarus introspect hooks -m model -p "Test" --layers 0,4,8 --capture-attention

# MoE Expert Analysis (for MoE models like GPT-OSS, Mixtral, Llama 4)
chuk-lazarus introspect moe-expert analyze -m openai/gpt-oss-20b
chuk-lazarus introspect moe-expert heatmap -m openai/gpt-oss-20b -p "def fib(n):"
chuk-lazarus introspect moe-expert pipeline -m openai/gpt-oss-20b --num-prompts 20
chuk-lazarus introspect moe-expert vocab-contrib -m openai/gpt-oss-20b --top-k 30
chuk-lazarus introspect moe-expert compression -m openai/gpt-oss-20b --threshold 0.8

# Circuit Graph Export
chuk-lazarus introspect circuit export -i ablation_results.json -o circuit.html -f html
chuk-lazarus introspect circuit export -i ablation_results.json -o circuit.dot -f dot
```

**MoE Expert Identification** - Discover what each expert specializes in:
Expand Down
Loading
Loading