Skip to content

Embedding mode dosn't work. #9064

@kelei999999

Description

@kelei999999

LocalAI version:
<LocalAI 4.0.0>

Environment, CPU architecture, OS, and Version:
<Windows Server 2025 WSL Ubuntu 22.04 Nvidia RTX4090>

Describe the bug
<我在使用Qwen3-Embedding-4B时,发现无法返回正确的结果>

To Reproduce

Expected behavior

Logs

Additional context
<参数配置如下:
name: Qwen3-Embedding-4B
backend: llama-cpp
embeddings: true
context_size: 40960
parameters:
model: Qwen3-Embedding-4B/Qwen3-Embedding-4B-q4_k_m.gguf

请问Embedding模型应该怎么配置?

Metadata

Metadata

Assignees

No one assigned

    Labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions