Skip to content

Latest commit

 

History

History
11 lines (6 loc) · 278 Bytes

llm_linear_transofmration.md

File metadata and controls

11 lines (6 loc) · 278 Bytes

Linear transformation

Each output dimension is a weighted sum of all input dimensions (plus bias).

Each output neuron:

  • sees the entire input vector
  • applies its own independent set of weights
  • so the same input values are reused, but recombined differently each time