Fix cpu ut for transformers v5 by Kaihui-intel · Pull Request #1333 · intel/auto-round

Kaihui-intel · 2026-01-23T07:54:04Z

Description

update test_cpu for transformers v5

Type of Change

Related Issues

Fixes or relates to ##1314

Checklist Before Submitting

My code has been tested locally.
Documentation has been updated as needed.
New or updated tests are included where applicable.

Signed-off-by: sys-lpot-val <sys_lpot_val@intel.com>

Copilot

Pull request overview

This PR updates CPU unit tests to handle compatibility issues introduced in transformers v5, ensuring tests either skip problematic features or adapt to API changes.

Changes:

Added conditional test skipping for transformers v5 due to breaking changes in MOE models, GGUF format support, and API deprecations
Updated assertions to accept both float32 and bfloat16 dtypes for model tensors
Modified model configuration and dtype handling to work with transformers v5 architecture changes

Reviewed changes

Copilot reviewed 9 out of 9 changed files in this pull request and generated 3 comments.

Show a summary per file

File	Description
test/helpers.py	Adds transformers_version helper variable for version checking across tests
test/test_cpu/quantization/test_mxfp_nvfp.py	Skips MOE model tests for transformers v5 due to breaking changes
test/test_cpu/models/test_moe_model.py	Skips Llama4 test and adds commented code for future v5 compatibility
test/test_cpu/integrations/test_llmc_integration.py	Skips llmcompressor integration test due to deprecated use_auth_token parameter
test/test_cpu/export/test_gguf_format.py	Skips entire GGUF test class for transformers v5 due to loading failures
test/test_cpu/export/test_export.py	Updates dtype assertions to accept both float32 and bfloat16
test/test_cpu/core/test_autoround.py	Adds version-specific model path assertions for Qwen2VL visual model
test/test_cpu/backends/test_torch_backend.py	Changes model dtype from bfloat16 to float32 and moves dtype parameter to tokenizer
auto_round/modelling/llama4.py	Conditionally imports no_init_weights from different modules based on transformers version

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Signed-off-by: sys-lpot-val <sys_lpot_val@intel.com>

for more information, see https://pre-commit.ci

Signed-off-by: sys-lpot-val <sys_lpot_val@intel.com>

for more information, see https://pre-commit.ci

Signed-off-by: sys-lpot-val <sys_lpot_val@intel.com>

for more information, see https://pre-commit.ci

Signed-off-by: sys-lpot-val <sys_lpot_val@intel.com>

Signed-off-by: WeiweiZhang1 <weiwei1.zhang@intel.com>

for more information, see https://pre-commit.ci

…5.0.0

Signed-off-by: sys-lpot-val <sys_lpot_val@intel.com>

for more information, see https://pre-commit.ci

Signed-off-by: sys-lpot-val <sys_lpot_val@intel.com>

for more information, see https://pre-commit.ci

Signed-off-by: sys-lpot-val <sys_lpot_val@intel.com>

for more information, see https://pre-commit.ci

Kaihui-intel · 2026-01-27T09:00:51Z

waiting for fix ci by XuehaoSun · Pull Request #1344 · intel/auto-round

revert to torch2.8

2026-01-27T07:41:58.9168661Z /home/hostuser/.venv/lib/python3.12/site-packages/auto_round/utils/common.py:87: in wrapper
2026-01-27T07:41:58.9168977Z     return func(*args, **kwargs)
2026-01-27T07:41:58.9169223Z            ^^^^^^^^^^^^^^^^^^^^^
2026-01-27T07:41:58.9169510Z /home/hostuser/.venv/lib/python3.12/site-packages/transformers/models/auto/auto_factory.py:372: in from_pretrained
2026-01-27T07:41:58.9169938Z     return model_class.from_pretrained(
2026-01-27T07:41:58.9170250Z /home/hostuser/.venv/lib/python3.12/site-packages/transformers/modeling_utils.py:4075: in from_pretrained
2026-01-27T07:41:58.9170547Z     hf_quantizer.preprocess_model(
2026-01-27T07:41:58.9170861Z /home/hostuser/.venv/lib/python3.12/site-packages/transformers/quantizers/base.py:167: in preprocess_model
2026-01-27T07:41:58.9171231Z     self._process_model_before_weight_loading(model, **kwargs)
2026-01-27T07:41:58.9171552Z /home/hostuser/.venv/lib/python3.12/site-packages/transformers/quantizers/quantizer_auto_round.py:54: in _process_model_before_weight_loading
2026-01-27T07:41:58.9171949Z     model, used_backends = convert_hf_model(model, target_device)
2026-01-27T07:41:58.9172453Z                            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-01-27T07:41:58.9172778Z /home/hostuser/.venv/lib/python3.12/site-packages/auto_round/inference/convert_model.py:600: in convert_hf_model
2026-01-27T07:41:58.9173127Z     used_backends = _replace_by_quant_layers(model, layer_configs, backend, target_device, packing_format)
2026-01-27T07:41:58.9173434Z                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-01-27T07:41:58.9173725Z /home/hostuser/.venv/lib/python3.12/site-packages/auto_round/inference/convert_model.py:348: in _replace_by_quant_layers
2026-01-27T07:41:58.9174159Z     layer_backend = get_layer_backend(target_device, backend, packing_format, config, in_features, out_features)
2026-01-27T07:41:58.9174459Z                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-01-27T07:41:58.9174736Z /home/hostuser/.venv/lib/python3.12/site-packages/auto_round/inference/backend.py:1019: in get_layer_backend
2026-01-27T07:41:58.9175049Z     process_requirement(backend_info.requirements, target_device=device)
2026-01-27T07:41:58.9175431Z /home/hostuser/.venv/lib/python3.12/site-packages/auto_round/inference/backend.py:1138: in process_requirement
2026-01-27T07:41:58.9175723Z     exit(-1)

dataset issue

FAILED test_cpu/utils/test_calib_dataset.py::TestLocalCalibDataset::test_combine_dataset
FAILED test_cpu/utils/test_calib_dataset.py::TestLocalCalibDataset::test_combine_dataset2

…4 model Signed-off-by: He, Xin3 <xin3.he@intel.com>

Signed-off-by: Sun, Xuehao <xuehao.sun@intel.com>

Signed-off-by: Kaihui-intel <kaihui.tang@intel.com> Signed-off-by: WeiweiZhang1 <weiwei1.zhang@intel.com> Signed-off-by: He, Xin3 <xin3.he@intel.com> Signed-off-by: Sun, Xuehao <xuehao.sun@intel.com> Co-authored-by: sys-lpot-val <sys_lpot_val@intel.com> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: WeiweiZhang1 <weiwei1.zhang@intel.com> Co-authored-by: Xin He <xin3.he@intel.com> Co-authored-by: Sun, Xuehao <xuehao.sun@intel.com> Co-authored-by: Heng Guo <heng.guo@intel.com>

sys-lpot-val added 2 commits January 22, 2026 23:49

fix cpu ut for transformersv5

dde4ba9

Signed-off-by: sys-lpot-val <sys_lpot_val@intel.com>

minor fix

735ca68

Signed-off-by: sys-lpot-val <sys_lpot_val@intel.com>

Copilot AI review requested due to automatic review settings January 23, 2026 07:54

Copilot AI reviewed Jan 23, 2026

View reviewed changes

Comment thread test/test_cpu/backends/test_torch_backend.py Outdated

Comment thread test/test_cpu/export/test_gguf_format.py Outdated

Comment thread test/test_cpu/models/test_moe_model.py Outdated

sys-lpot-val and others added 2 commits January 22, 2026 23:56

merge main

7d335a7

Signed-off-by: sys-lpot-val <sys_lpot_val@intel.com>

[pre-commit.ci] auto fixes from pre-commit.com hooks

dafcc5f

for more information, see https://pre-commit.ci

chensuyue added this to the 0.10.0 milestone Jan 23, 2026

wenhuach21 reviewed Jan 23, 2026

View reviewed changes

Comment thread test/test_cpu/backends/test_torch_backend.py Outdated

wenhuach21 reviewed Jan 23, 2026

View reviewed changes

Comment thread test/test_cpu/export/test_gguf_format.py Outdated

xin3he reviewed Jan 26, 2026

View reviewed changes

Comment thread test/test_cpu/integrations/test_llmc_integration.py

sys-lpot-val and others added 5 commits January 25, 2026 22:49

update issue link

f45be48

Signed-off-by: sys-lpot-val <sys_lpot_val@intel.com>

[pre-commit.ci] auto fixes from pre-commit.com hooks

f35e42a

for more information, see https://pre-commit.ci

fix wf init

e0c16ba

Signed-off-by: sys-lpot-val <sys_lpot_val@intel.com>

[pre-commit.ci] auto fixes from pre-commit.com hooks

dbf8cb4

for more information, see https://pre-commit.ci

revert wf

e0623fa

Signed-off-by: sys-lpot-val <sys_lpot_val@intel.com>

Kaihui-intel requested a review from n1ck-guo January 26, 2026 07:53

sys-lpot-val and others added 4 commits January 26, 2026 01:33

fix mixed type

b4f0108

Signed-off-by: sys-lpot-val <sys_lpot_val@intel.com>

fix copy out of meta tensor issue

fc1a96b

Signed-off-by: WeiweiZhang1 <weiwei1.zhang@intel.com>

fix copy out of meta tensor issue

a51ff10

Signed-off-by: WeiweiZhang1 <weiwei1.zhang@intel.com>

[pre-commit.ci] auto fixes from pre-commit.com hooks

6f3691a

for more information, see https://pre-commit.ci

xin3he approved these changes Jan 27, 2026

View reviewed changes

xin3he and others added 5 commits January 27, 2026 06:12

fix lm_eval import issue and update requirement to suit transformers …

e10c525

…5.0.0

skip PhiConfig has no attribute 'pad_token_id'

8b4f2d5

Signed-off-by: sys-lpot-val <sys_lpot_val@intel.com>

[pre-commit.ci] auto fixes from pre-commit.com hooks

c3fec96

for more information, see https://pre-commit.ci

fix mixed type in qlinera_torch_zp

a55841c

Signed-off-by: sys-lpot-val <sys_lpot_val@intel.com>

update no_init_weights import for gpt-oss

e725099

n1ck-guo approved these changes Jan 27, 2026

View reviewed changes

skip diffusers

85eb094

Signed-off-by: sys-lpot-val <sys_lpot_val@intel.com>

xin3he mentioned this pull request Jan 27, 2026

Fix transformers 5.0 upgrade issue for interface no_init_weights #1353

Closed

9 tasks

skip phiconfig

a93c9e3

Signed-off-by: sys-lpot-val <sys_lpot_val@intel.com>

pre-commit-ci Bot and others added 4 commits January 27, 2026 08:47

[pre-commit.ci] auto fixes from pre-commit.com hooks

eb6d09e

for more information, see https://pre-commit.ci

update vllm and sglang to use git main branch

d9a9e4e

skip diffusers import

8ca34fe

Signed-off-by: sys-lpot-val <sys_lpot_val@intel.com>

[pre-commit.ci] auto fixes from pre-commit.com hooks

de7819f

for more information, see https://pre-commit.ci

Merge branch 'main' into kaihui/v5_cpu_ut

ec19894

wenhuach21 reviewed Jan 27, 2026

View reviewed changes

Comment thread auto_round/eval/eval_cli.py

xin3he and others added 4 commits January 27, 2026 12:29

set trust_remote_code=False for tiny-deepseek

4bd8b48

set pad_token_id to None in setup_llama4 for compatibility with Llama…

fb21e4e

…4 model Signed-off-by: He, Xin3 <xin3.he@intel.com>

fix

c4c74f0

Signed-off-by: Sun, Xuehao <xuehao.sun@intel.com>

Merge branch 'main' into kaihui/v5_cpu_ut

2ba863a

Kaihui-intel merged commit f6e7e30 into main Jan 28, 2026
28 of 29 checks passed

Kaihui-intel deleted the kaihui/v5_cpu_ut branch January 28, 2026 05:11

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Fix cpu ut for transformers v5#1333

Fix cpu ut for transformers v5#1333
Kaihui-intel merged 29 commits intomainfrom
kaihui/v5_cpu_ut

Kaihui-intel commented Jan 23, 2026 •

edited by xin3he

Loading

Uh oh!

Copilot AI left a comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Kaihui-intel commented Jan 27, 2026

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

9 participants

Conversation

Kaihui-intel commented Jan 23, 2026 • edited by xin3he Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Description

Type of Change

Related Issues

Checklist Before Submitting

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Kaihui-intel commented Jan 27, 2026

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

9 participants

Kaihui-intel commented Jan 23, 2026 •

edited by xin3he

Loading