Pinned Loading

1. architecture-distillation architecture-distillation Public

   Hotswapping a llama attention layer with a Hyena convolution

   Jupyter Notebook

2. batch-synth-img batch-synth-img Public

   Efficient batch generation for synthetic classification data

   Jupyter Notebook

3. fast-weight-net fast-weight-net Public

   Experimenting with second-order gradient steps in Pytorch

   Jupyter Notebook

4. meta-functions meta-functions Public

   A replication of the GPICL paper

   Jupyter Notebook

5. mnist-metalearner mnist-metalearner Public

   In-context MNIST learning with a gradient optimization on synthetic data

   Jupyter Notebook

6. periodic-rnn periodic-rnn Public

   Testing RNN and FNN performance on periodic functions

   Jupyter Notebook