Repository navigation
[BUG]: run opt inference but failed with No module named 'energonai' #5906
Description
Is there an existing issue for this bug?
- I have searched the existing issues
🐛 Describe the bug
[BUG]: run opt inference but failed with No module named 'energonai'
python opt_fastapi.py opt-125m --tp 2 --checkpoint /home/ubuntu/ColossalAI/examples/tutorial/opt/inference/opt-125m
Environment
ubuntu 22, python 3.10, cuda 12.3 ,colossalai-0.4.0
Activity
JazyJiang commentedon Oct 22, 2026
Hi, thanks for reporting this, and sorry it went unanswered for so long. We're going through older issues and closing the ones that no longer apply to the current codebase. It concerns an older release, example or interface, and the components involved have changed substantially since then. We're marking it as stale and will close it in 14 days. If you still see this problem with the latest ColossalAI on PyTorch 2.x, please comment here (or open a new issue) with your environment and a minimal reproduction, and we'll take a look.
JazyJiang commentedon Nov 5, 2026
Closing this issue since there has been no response in the 14 days after it was marked as stale. If you still run into this problem with the latest ColossalAI on PyTorch 2.x, please open a new issue using the bug report template, with your environment and a minimal reproduction.