FP16 to BF16 and vice-versa is supported via CPU code (
|
dev_info.substitute_fp16_bf16 = true; |
).
We either need to have kernels that convert FP16 to BF16 and the opposite (more kernels loaded but immediate implementation) or add support in the compiler (more difficult).
FP16 to BF16 and vice-versa is supported via CPU code (
ggml/src/ggml-hsa/ggml-hsa.cpp
Line 353 in 9737fac
We either need to have kernels that convert FP16 to BF16 and the opposite (more kernels loaded but immediate implementation) or add support in the compiler (more difficult).