Enable FP8 Parallel LM Head

[R3hankhan123]

Description

Enable FP8 Quantization for Parallel LM Head

Related Issues

Fixes #255

Test Result

Request

curl http://localhost:8002/v1/chat/completions   -H "Content-Type: application/json"   -d '{
    "model": "ibm-granite/granite-4.1-8b-fp8",
    "messages": [
      {
        "role": "user",
        "content": "Hello! Explain what a transformer model is in one paragraph."
      }
    ],
    "max_tokens": 20,
    "temperature": 0.7
  }'

Output

 "content": "A transformer model is a type of deep learning architecture designed to process and generate sequential data, such as",

Checklist

• I have read the contributing guidelines
• My code follows the project's code style (run bash format.sh)
• I have added tests for my changes (if applicable)
• I have updated the documentation (if applicable)
• My commits include a Signed-off-by: line (DCO compliance)

[github-actions]

👋 Hi! Thank you for contributing.
Just a reminder: Make sure that your code passes all the linting checks, otherwise your PR won't be able to be merged. To do so, run ./format.sh.
Now you are good to go 🚀.

We also recommend installing prek and configuring it to check your code before every local commit.