Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Sign up
Appearance settings

TypeError: cannot unpack non-iterable NoneType object #2267

Open
Assignees
@sankexin

Description

Traceback (most recent call last):
File "/usr/local/lib/python3.10/dist-packages/neural_compressor/quantization.py", line 218, in fit
strategy.traverse()
File "/usr/local/lib/python3.10/dist-packages/neural_compressor/strategy/auto.py", line 140, in traverse
super().traverse()
File "/usr/local/lib/python3.10/dist-packages/neural_compressor/strategy/strategy.py", line 503, in traverse
q_model = self.adaptor.quantize(copy.deepcopy(tune_cfg), self.model, self.calib_dataloader, self.q_func)
File "/usr/local/lib/python3.10/dist-packages/neural_compressor/utils/utility.py", line 426, in fi
res = func(*args, **kwargs)
File "/usr/local/lib/python3.10/dist-packages/neural_compressor/adaptor/pytorch.py", line 4565, in quantize
q_model._model, gptq_config = self.gptq_quantize(q_model._model, tune_cfg, dataloader)
File "/usr/local/lib/python3.10/dist-packages/neural_compressor/adaptor/pytorch.py", line 4719, in gptq_quantize
model, quantization_perm = gptq_quantize(
File "/usr/local/lib/python3.10/dist-packages/neural_compressor/adaptor/torch_utils/weight_only.py", line 518, in gptq_quantize
fp32_modified_model, gptq_config = gptq_quantizer.execute_quantization(model_path=model_path)
File "/usr/local/lib/python3.10/dist-packages/torch/utils/_contextlib.py", line 116, in decorate_context
return func(*args, **kwargs)
File "/usr/local/lib/python3.10/dist-packages/neural_compressor/adaptor/torch_utils/gptq.py", line 681, in execute_quantization
out = transformer_block(*cache_positional_batch, **cache_keyword_batch)
File "/usr/local/lib/python3.10/dist-packages/transformers/modeling_layers.py", line 93, in call
return super().call(*args, **kwargs)
File "/usr/local/lib/python3.10/dist-packages/torch/nn/modules/module.py", line 1553, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)
File "/usr/local/lib/python3.10/dist-packages/torch/nn/modules/module.py", line 1562, in _call_impl
return forward_call(*args, **kwargs)
File "/usr/local/lib/python3.10/dist-packages/transformers/models/qwen3/modeling_qwen3.py", line 257, in forward
hidden_states, _ = self.self_attn(
File "/usr/local/lib/python3.10/dist-packages/torch/nn/modules/module.py", line 1553, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)
File "/usr/local/lib/python3.10/dist-packages/torch/nn/modules/module.py", line 1562, in _call_impl
return forward_call(*args, **kwargs)
File "/usr/local/lib/python3.10/dist-packages/transformers/models/qwen3/modeling_qwen3.py", line 202, in forward
cos, sin = position_embeddings
TypeError: cannot unpack non-iterable NoneType object

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions

      AltStyle によって変換されたページ (->オリジナル) /