24-12-02 15:54:56,655 [ERROR] model.py:39 - [Model] >>> Exception:BuildModelGraph error,check ATB_LOG, ASDOPS_LOG
Traceback (most recent call last):
File “/usr/local/python3.11.10/lib/python3.11/site-packages/model_wrapper/model.py”, line 37, in initialize
return self.python_model.initialize(config)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File “/usr/local/python3.11.10/lib/python3.11/site-packages/model_wrapper/standard_model.py”, line 144, in initialize
self.generator = Generator(
^^^^^^^^^^
File “/usr/local/python3.11.10/lib/python3.11/site-packages/mindie_llm/text_generator/generator.py”, line 101, in init
self.warm_up(max_prefill_tokens, max_seq_len, max_input_len, max_iter_times, inference_mode)
File “/usr/local/python3.11.10/lib/python3.11/site-packages/mindie_llm/text_generator/generator.py”, line 245, in warm_up
self.generator_backend.warm_up(model_inputs)
File “/usr/local/python3.11.10/lib/python3.11/site-packages/mindie_llm/text_generator/adapter/generator_backend.py”, line 128, in warm_up
_ = self.forward(model_inputs, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File “/usr/local/python3.11.10/lib/python3.11/site-packages/mindie_llm/utils/decorators/time_decorator.py”, line 38, in wrapper
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File “/usr/local/python3.11.10/lib/python3.11/site-packages/mindie_llm/text_generator/adapter/generator_torch.py”, line 92, in forward
logits = self.model_wrapper.forward(model_inputs, self.cache_pool.npu_cache, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File “/usr/local/python3.11.10/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/atb/atb_model_wrapper.py”, line 65, in forward
logits = self.forward_tensor(
^^^^^^^^^^^^^^^^^^^^
File “/usr/local/python3.11.10/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/atb/atb_model_wrapper.py”, line 92, in forward_tensor
logits = self.model_runner.forward(
^^^^^^^^^^^^^^^^^^^^^^^^^^
File “/usr/local/Ascend/llm_model/atb_llm/runner/model_runner.py”, line 157, in forward
return self.model.forward(**kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File “/usr/local/Ascend/llm_model/atb_llm/models/base/flash_causal_lm.py”, line 380, in forward
self.init_ascend_weight()
File “/usr/local/Ascend/llm_model/atb_llm/models/qwen2/flash_causal_qwen2.py”, line 182, in init_ascend_weight
self.acl_encoder_operation.set_param(json.dumps({**encoder_param}))
RuntimeError: BuildModelGraph error,check ATB_LOG, ASDOPS_LOG
不知道这是啥意思，有大佬知道吗？
标签：python3.11,qwen2,py,--,报错,usr,llm,model,local From： https://blog.csdn.net/xiezhipu/article/details/144201660