Repository navigation
[BUG]: The LLama model trained in Lora mode is unable to perform normal reasoning #3533
Closed as not planned
Description
🐛 Describe the bug
In this path 'ColossalAI/applications/Chat/examples/train_sft.sh', LLama-7B model is trained with Lora training method, but there is a problem in the reasoning process, is it because Lora parameters are not loaded? May I ask how to solve it?
Environment
Python 3.9.16
torch 1.12.1
torchaudio 0.12.1
torchvision 0.13.1
transformers 4.28.0.dev0
Activity
binmakeswell commentedon Apr 17, 2023
Hi @tianbuwei Thanks for the feedback, we are fixing LoRA bug. #3439
JazyJiang commentedon Oct 22, 2026
Hi, thanks for reporting this, and sorry it went unanswered for so long. We're going through older issues and closing the ones that no longer apply to the current codebase. It was reported against PyTorch 1.12.1, which current ColossalAI no longer supports (PyTorch 2.x is required). We're marking it as stale and will close it in 14 days. If you still see this problem with the latest ColossalAI on PyTorch 2.x, please comment here (or open a new issue) with your environment and a minimal reproduction, and we'll take a look.
JazyJiang commentedon Nov 5, 2026
Closing this issue since there has been no response in the 14 days after it was marked as stale. If you still run into this problem with the latest ColossalAI on PyTorch 2.x, please open a new issue using the bug report template, with your environment and a minimal reproduction.