cannot import name 'MT5Tokenizer' from 'transformers'

[n1ck-guo]

Describe the bug

When using diffusers with transformers, it shows this bug:

E RuntimeError: Failed to import diffusers.pipelines.auto_pipeline because of the following error (look up to see its traceback):
E Failed to import diffusers.pipelines.hunyuandit.pipeline_hunyuandit because of the following error (look up to see its traceback):
E cannot import name 'MT5Tokenizer' from 'transformers' (/home/hengguo/miniforge3/envs/ar_env/lib/python3.12/site-packages/transformers/init.py)

Cause in pipeline_hunyuandit.py : from transformers import BertModel, BertTokenizer, CLIPImageProcessor, MT5Tokenizer, T5EncoderModel

Reproduction

pipe = AutoPipelineForText2Image.from_pretrained("black-forest-labs/FLUX.1-dev")

Logs

./../../../miniforge3/envs/ar_env/lib/python3.12/site-packages/diffusers/utils/import_utils.py:1016: in _get_module
    return importlib.import_module("." + module_name, self.__name__)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
../../../../miniforge3/envs/ar_env/lib/python3.12/importlib/__init__.py:90: in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<frozen importlib._bootstrap>:1381: in _gcd_import
    ???
<frozen importlib._bootstrap>:1354: in _find_and_load
    ???
<frozen importlib._bootstrap>:1325: in _find_and_load_unlocked
    ???
<frozen importlib._bootstrap>:929: in _load_unlocked
    ???
<frozen importlib._bootstrap_external>:994: in exec_module
    ???
<frozen importlib._bootstrap>:488: in _call_with_frames_removed
    ???
../../../../miniforge3/envs/ar_env/lib/python3.12/site-packages/diffusers/pipelines/hunyuandit/pipeline_hunyuandit.py:20: in <module>
    from transformers import BertModel, BertTokenizer, CLIPImageProcessor, MT5Tokenizer, T5EncoderModel
E   ImportError: cannot import name 'MT5Tokenizer' from 'transformers' (/home/hengguo/miniforge3/envs/ar_env/lib/python3.12/site-packages/transformers/__init__.py)

The above exception was the direct cause of the following exception:
../../../../miniforge3/envs/ar_env/lib/python3.12/site-packages/diffusers/utils/import_utils.py:1016: in _get_module
    return importlib.import_module("." + module_name, self.__name__)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
../../../../miniforge3/envs/ar_env/lib/python3.12/importlib/__init__.py:90: in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<frozen importlib._bootstrap>:1381: in _gcd_import
    ???
<frozen importlib._bootstrap>:1354: in _find_and_load
    ???
<frozen importlib._bootstrap>:1325: in _find_and_load_unlocked
    ???
<frozen importlib._bootstrap>:929: in _load_unlocked
    ???
<frozen importlib._bootstrap_external>:994: in exec_module
    ???
<frozen importlib._bootstrap>:488: in _call_with_frames_removed
    ???
../../../../miniforge3/envs/ar_env/lib/python3.12/site-packages/diffusers/pipelines/auto_pipeline.py:55: in <module>
    from .hunyuandit import HunyuanDiTPipeline
<frozen importlib._bootstrap>:1406: in _handle_fromlist
    ???
../../../../miniforge3/envs/ar_env/lib/python3.12/site-packages/diffusers/utils/import_utils.py:1006: in __getattr__
    module = self._get_module(self._class_to_module[name])
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
../../../../miniforge3/envs/ar_env/lib/python3.12/site-packages/diffusers/utils/import_utils.py:1018: in _get_module
    raise RuntimeError(
E   RuntimeError: Failed to import diffusers.pipelines.hunyuandit.pipeline_hunyuandit because of the following error (look up to see its traceback):
E   cannot import name 'MT5Tokenizer' from 'transformers' (/home/hengguo/miniforge3/envs/ar_env/lib/python3.12/site-packages/transformers/__init__.py)

The above exception was the direct cause of the following exception:
test_cpu/models/test_diffusion.py:4: in <module>
    from diffusers import AutoPipelineForText2Image
<frozen importlib._bootstrap>:1406: in _handle_fromlist
    ???
../../../../miniforge3/envs/ar_env/lib/python3.12/site-packages/diffusers/utils/import_utils.py:1007: in __getattr__
    value = getattr(module, name)
            ^^^^^^^^^^^^^^^^^^^^^
../../../../miniforge3/envs/ar_env/lib/python3.12/site-packages/diffusers/utils/import_utils.py:1006: in __getattr__
    module = self._get_module(self._class_to_module[name])
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
../../../../miniforge3/envs/ar_env/lib/python3.12/site-packages/diffusers/utils/import_utils.py:1018: in _get_module
    raise RuntimeError(
E   RuntimeError: Failed to import diffusers.pipelines.auto_pipeline because of the following error (look up to see its traceback):
E   Failed to import diffusers.pipelines.hunyuandit.pipeline_hunyuandit because of the following error (look up to see its traceback):
E   cannot import name 'MT5Tokenizer' from 'transformers' (/home/hengguo/miniforge3/envs/ar_env/lib/python3.12/site-packages/transformers/__init__.py)

System Info

Who can help?

No response

[yiyixuxu]

hey @n1ck-guo
I think it's already fixed in #12877
can you update diffusers to latest?

[janepie]

I have the same issue, looks to me like it's merged but not released?