Add support for torch.sdp attention#4

Open

Birch-san wants to merge 2 commits intocrowsonkb:mainfrom

Birch-san:torch-sdp

Commits on Oct 18, 2023

add support for torch.sdp attention. passes allclose() comparison with original attention.
Birch-san
committed

Commits on Oct 19, 2023

support non-math torch sdp kernels by ensuring contiguity of attn projections
Birch-san
committed