perf(custom_ops): compute FP8 per-token scale via quantscalepertokenfp8 - #814
Open
prashantgupta24 wants to merge 7 commits into
Open
perf(custom_ops): compute FP8 per-token scale via quantscalepertokenfp8#814prashantgupta24 wants to merge 7 commits into
prashantgupta24 wants to merge 7 commits into
Loading