Lineage and Dependency
what's the goal
To create a static rope_fwd_ktir.mlir example input file.
What's the benefit
RoPE is an important accuracy boosting kernel used in IBM's Granite, and nearly every since DeepSeek. Including it in ktir-cpu's latency demo notebook is a great addition to showcase the usefulness of ktir-cpu.
how to assess completion
- create examples/latency/rope_fwd_ktir.mlir program with reasonable problem size and grid size.
- tests to conform with representative rope operation, accuracy, and loads of datamove and compute.
Lineage and Dependency
what's the goal
To create a static rope_fwd_ktir.mlir example input file.
What's the benefit
RoPE is an important accuracy boosting kernel used in IBM's Granite, and nearly every since DeepSeek. Including it in ktir-cpu's latency demo notebook is a great addition to showcase the usefulness of ktir-cpu.
how to assess completion