Skip to content

请问运行eval_model.py时,出现AttributeError: 'NoneType' object has no attribute 'shape'应该如何解决 #2

@CHE0905

Description

@CHE0905

请问运行eval_model.py时,出现AttributeError: 'NoneType' object has no attribute 'shape'应该如何解决?具体报错如下:
MiniMind模型参数量: 25.83M(illion)
[0] 自动测试
[1] 手动输入
0
👶: 请介绍一下自己。
🤖️: DynamicCache(layers=[DynamicLayer, DynamicLayer, DynamicLayer, DynamicLayer, DynamicLayer, DynamicLayer, DynamicLayer, DynamicLayer])
Traceback (most recent call last):
File "D:\LLM\minimind-master\minimind-master\eval_model.py", line 170, in
main()
File "D:\LLM\minimind-master\minimind-master\eval_model.py", line 151, in main
generated_ids = model.generate(
File "C:\Users\OMEN\Anaconda3\envs\py310torch\lib\site-packages\torch\utils_contextlib.py", line 116, in decorate_context
return func(*args, **kwargs)
File "C:\Users\OMEN\Anaconda3\envs\py310torch\lib\site-packages\transformers\generation\utils.py", line 2539, in generate
result = self._sample(
File "C:\Users\OMEN\Anaconda3\envs\py310torch\lib\site-packages\transformers\generation\utils.py", line 2867, in _sample
outputs = self(**model_inputs, return_dict=True)
File "C:\Users\OMEN\Anaconda3\envs\py310torch\lib\site-packages\torch\nn\modules\module.py", line 1751, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)
File "C:\Users\OMEN\Anaconda3\envs\py310torch\lib\site-packages\torch\nn\modules\module.py", line 1762, in _call_impl
return forward_call(*args, **kwargs)
File "D:\LLM\minimind-master\minimind-master\model\model_minimind.py", line 434, in forward
h, past_kvs, aux_loss = self.model(
File "C:\Users\OMEN\Anaconda3\envs\py310torch\lib\site-packages\torch\nn\modules\module.py", line 1751, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)
File "C:\Users\OMEN\Anaconda3\envs\py310torch\lib\site-packages\torch\nn\modules\module.py", line 1762, in _call_impl
return forward_call(*args, **kwargs)
File "D:\LLM\minimind-master\minimind-master\model\model_minimind.py", line 385, in forward
start_pos = past_key_values[0][0].shape[1] if past_key_values[0] is not None else 0
AttributeError: 'NoneType' object has no attribute 'shape'

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions