请问运行eval_model.py时,出现AttributeError: 'NoneType' object has no attribute 'shape'应该如何解决?具体报错如下:
MiniMind模型参数量: 25.83M(illion)
[0] 自动测试
[1] 手动输入
0
👶: 请介绍一下自己。
🤖️: DynamicCache(layers=[DynamicLayer, DynamicLayer, DynamicLayer, DynamicLayer, DynamicLayer, DynamicLayer, DynamicLayer, DynamicLayer])
Traceback (most recent call last):
File "D:\LLM\minimind-master\minimind-master\eval_model.py", line 170, in
main()
File "D:\LLM\minimind-master\minimind-master\eval_model.py", line 151, in main
generated_ids = model.generate(
File "C:\Users\OMEN\Anaconda3\envs\py310torch\lib\site-packages\torch\utils_contextlib.py", line 116, in decorate_context
return func(*args, **kwargs)
File "C:\Users\OMEN\Anaconda3\envs\py310torch\lib\site-packages\transformers\generation\utils.py", line 2539, in generate
result = self._sample(
File "C:\Users\OMEN\Anaconda3\envs\py310torch\lib\site-packages\transformers\generation\utils.py", line 2867, in _sample
outputs = self(**model_inputs, return_dict=True)
File "C:\Users\OMEN\Anaconda3\envs\py310torch\lib\site-packages\torch\nn\modules\module.py", line 1751, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)
File "C:\Users\OMEN\Anaconda3\envs\py310torch\lib\site-packages\torch\nn\modules\module.py", line 1762, in _call_impl
return forward_call(*args, **kwargs)
File "D:\LLM\minimind-master\minimind-master\model\model_minimind.py", line 434, in forward
h, past_kvs, aux_loss = self.model(
File "C:\Users\OMEN\Anaconda3\envs\py310torch\lib\site-packages\torch\nn\modules\module.py", line 1751, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)
File "C:\Users\OMEN\Anaconda3\envs\py310torch\lib\site-packages\torch\nn\modules\module.py", line 1762, in _call_impl
return forward_call(*args, **kwargs)
File "D:\LLM\minimind-master\minimind-master\model\model_minimind.py", line 385, in forward
start_pos = past_key_values[0][0].shape[1] if past_key_values[0] is not None else 0
AttributeError: 'NoneType' object has no attribute 'shape'
请问运行eval_model.py时,出现AttributeError: 'NoneType' object has no attribute 'shape'应该如何解决?具体报错如下:
MiniMind模型参数量: 25.83M(illion)
[0] 自动测试
[1] 手动输入
0
👶: 请介绍一下自己。
🤖️: DynamicCache(layers=[DynamicLayer, DynamicLayer, DynamicLayer, DynamicLayer, DynamicLayer, DynamicLayer, DynamicLayer, DynamicLayer])
Traceback (most recent call last):
File "D:\LLM\minimind-master\minimind-master\eval_model.py", line 170, in
main()
File "D:\LLM\minimind-master\minimind-master\eval_model.py", line 151, in main
generated_ids = model.generate(
File "C:\Users\OMEN\Anaconda3\envs\py310torch\lib\site-packages\torch\utils_contextlib.py", line 116, in decorate_context
return func(*args, **kwargs)
File "C:\Users\OMEN\Anaconda3\envs\py310torch\lib\site-packages\transformers\generation\utils.py", line 2539, in generate
result = self._sample(
File "C:\Users\OMEN\Anaconda3\envs\py310torch\lib\site-packages\transformers\generation\utils.py", line 2867, in _sample
outputs = self(**model_inputs, return_dict=True)
File "C:\Users\OMEN\Anaconda3\envs\py310torch\lib\site-packages\torch\nn\modules\module.py", line 1751, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)
File "C:\Users\OMEN\Anaconda3\envs\py310torch\lib\site-packages\torch\nn\modules\module.py", line 1762, in _call_impl
return forward_call(*args, **kwargs)
File "D:\LLM\minimind-master\minimind-master\model\model_minimind.py", line 434, in forward
h, past_kvs, aux_loss = self.model(
File "C:\Users\OMEN\Anaconda3\envs\py310torch\lib\site-packages\torch\nn\modules\module.py", line 1751, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)
File "C:\Users\OMEN\Anaconda3\envs\py310torch\lib\site-packages\torch\nn\modules\module.py", line 1762, in _call_impl
return forward_call(*args, **kwargs)
File "D:\LLM\minimind-master\minimind-master\model\model_minimind.py", line 385, in forward
start_pos = past_key_values[0][0].shape[1] if past_key_values[0] is not None else 0
AttributeError: 'NoneType' object has no attribute 'shape'