[Bug] WSChuan-ASR Qwen2.5-omni3B 加载失败:SafetensorError: incomplete metadata
作者你好,
在使用 infer_qwen2.5omni.py 加载 Qwen2.5-omni3B 模型时报错,提示 safetensors 文件元数据不完整。
问题描述:
报错信息为 safetensors_rust.SafetensorError: Error while deserializing header: incomplete metadata, file not fully covered。
我已经重新下载了两次模型文件,该错误依然存在,排除了本地下载中断的可能性。请检查 Hugging Face 仓库中的原始模型文件是否在上传时损坏。
报错日志:
Loading checkpoint shards: 0%| | 0/3 [00:00<?, ?it/s]
Traceback (most recent call last):
...
File ".../transformers/modeling_utils.py", line 483, in load_state_dict
with safe_open(checkpoint_file, framework="pt") as f:
safetensors_rust.SafetensorError: Error while deserializing header: incomplete metadata, file not fully covered
遇到同样的问题,我核对本地文件的sha256,和仓库的是一致的
报错:
Unrecognized keys in rope_scaling for 'rope_type'='default': {'mrope_section'}
Qwen2_5OmniToken2WavModel does not support eager attention implementation, fall back to sdpa
Loading checkpoint shards: 0%| | 0/3 [00:00<?, ?it/s]
Traceback (most recent call last):
File "/limk/workspace/chuan/WSChuan-ASR/infer_qwen2.5omni.py", line 63, in
transcribe(
File "/limk/workspace/chuan/WSChuan-ASR/infer_qwen2.5omni.py", line 32, in transcribe
model = Qwen2_5OmniForConditionalGeneration.from_pretrained(
File "/opt/conda/envs/qwen/lib/python3.10/site-packages/transformers/models/qwen2_5_omni/modeling_qwen2_5_omni.py", line 4406, in from_pretrained
model = super().from_pretrained(
File "/opt/conda/envs/qwen/lib/python3.10/site-packages/transformers/modeling_utils.py", line 283, in _wrapper
return func(*args, **kwargs)
File "/opt/conda/envs/qwen/lib/python3.10/site-packages/transformers/modeling_utils.py", line 4442, in from_pretrained
) = cls._load_pretrained_model(
File "/opt/conda/envs/qwen/lib/python3.10/site-packages/transformers/modeling_utils.py", line 4871, in _load_pretrained_model
state_dict = load_state_dict(
File "/opt/conda/envs/qwen/lib/python3.10/site-packages/transformers/modeling_utils.py", line 483, in load_state_dict
with safe_open(checkpoint_file, framework="pt") as f:
safetensors_rust.SafetensorError: Error while deserializing header: incomplete metadata, file not fully covered
本地文件sha256:
ee5ce647e0d4852a38d4a76408898e54374f9397c2dcefa7314537a55c1e6b21 :/workspace/chuan/WSChuan-ASR/Qwen2.5-Omni-3B-Chuan/model-00001-of-00003.safetensors
694f5ce71776f6caf0a94ace088cd7eeafd3c1a30e029c6e1c7a70f8221df4ba /workspace/chuan/WSChuan-ASR/Qwen2.5-Omni-3B-Chuan/model-00002-of-00003.safetensors
aedb25618881ce9466eefb9872e19e81f30d281dd2b139b8c8111ae7a9025e7b /workspace/chuan/WSChuan-ASR/Qwen2.5-Omni-3B-Chuan/model-00003-of-00003.safetensors