Add GPU debugging output to workbench example

[ktdreyer]

Add GPU debugging information to the llmcompressor workbench example notebook to help users understand whether GPU acceleration is available.

This enhancement helps users verify that their GPU setup is working correctly and understand why they might be experiencing slower performance or abbreviated datasets.

Fixes #4

[ktdreyer]

I don't know the proper way to test in ODH (yet), so I tested this on a bare g6e.4xlarge AWS CentOS node like so:

1. SSH to the node with port-forwarding:
   ssh -L 8888:localhost:8888 ec2-user@ec2-1-2-3-4.us-east-2.compute.amazonaws.com
2. Run the Jupyter image:

   podman run -p 8888:8888 --privileged -it --rm --gpus all quay.io/opendatahub/llmcompressor-workbench:main
   

3. Log into http://localhost:8888/lab
4. Import the workbench from my fork (workbench_example.ipynb)

[jiridanek]

@coderabbitai full review

[coderabbitai]

✅ Actions performed

Full review triggered.

[coderabbitai]

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info

⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro

Run ID: 9f6a9fa3-8355-433e-8b3c-11d1cbb3ff76

📥 Commits

Reviewing files that changed from the base of the PR and between 37af793 and 3b47208.

📒 Files selected for processing (1)

• examples/llmcompressor/workbench_example.ipynb

---

📝 Walkthrough

Walkthrough

Adds GPU-availability messaging to a Jupyter notebook by printing GPU status after checking torch.cuda.is_available(). If no GPU is available, a CPU-only mode warning is printed for user debugging purposes.

Changes

Cohort / File(s)	Summary
GPU Debugging Output examples/llmcompressor/workbench_example.ipynb	Adds conditional print statements to display GPU availability status and CPU-only mode warning when GPU is not detected.

Estimated code review effort

🎯 1 (Trivial) | ⏱️ ~3 minutes

🚥 Pre-merge checks | ✅ 5

✅ Passed checks (5 passed)

Check name	Status	Explanation
Title check	✅ Passed	The title accurately describes the main change: adding GPU debugging output to the workbench example notebook.
Description check	✅ Passed	The description is clearly related to the changeset, explaining the purpose of adding GPU debugging information and referencing the linked issue.
Linked Issues check	✅ Passed	The PR fully addresses issue #4 by adding GPU debugging output to the workbench example notebook as requested.
Out of Scope Changes check	✅ Passed	All changes are directly related to the stated objective of adding GPU debugging information to the workbench example notebook.
Docstring Coverage	✅ Passed	No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.

_{✏️ Tip: You can configure your own custom pre-merge checks in the settings.}

✨ Finishing Touches

🧪 Generate unit tests (beta)

• Create PR with unit tests
• Post copyable unit tests in a comment

📝 Coding Plan

• Generate coding plan for human review comments

Warning

There were issues while running some tools. Please review the errors and either fix the tool's configuration or disable the tool if it's a critical failure.

🔧 Ruff (0.15.5)

examples/llmcompressor/workbench_example.ipynb

Unexpected end of JSON input

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands and usage tips.}