Skip to content

Add Qwen 3.5 GGUF support and configurable chat-template kwargs (thinking toggle)#8

Draft
Copilot wants to merge 3 commits intoAdd-support-for-Qwen3.5-models-and-option-to-additional-paramters-(to-enable/disable-thinking)from
copilot/add-qwen3-5-support
Draft

Add Qwen 3.5 GGUF support and configurable chat-template kwargs (thinking toggle)#8
Copilot wants to merge 3 commits intoAdd-support-for-Qwen3.5-models-and-option-to-additional-paramters-(to-enable/disable-thinking)from
copilot/add-qwen3-5-support

Conversation

Copy link

Copilot AI commented Mar 5, 2026

Qwen 3.5 GGUF models were not loading reliably, and there was no way to pass llama.cpp chat-template kwargs needed to disable default thinking mode.
This change adds first-class support for chat-template kwargs in GGUF config flow and applies sensible defaults for Qwen 3.5 models.

  • GGUF inference schema: add chat-template kwargs

    • Added chatTemplateKwargs to GgufInferenceParams.
    • Preserved JSON compatibility by keeping it optional/empty by default.
  • Engine wiring: pass kwargs to native runtime

    • GGUFEngine now applies chat-template kwargs after model load.
    • Uses reflective invocation of nativeSetChatTemplateKwargs(String) for backward compatibility with older native libs that do not expose this API.
  • Qwen 3.5 default behavior

    • Added GgufEngineSchema.defaultsForModel(modelName) to preconfigure Qwen 3.5 models with:
      • {"enable_thinking": false}
    • Used this default schema in both model install paths:
      • local import/install flow
      • downloaded model install flow
  • Config UI support

    • Added an editable GGUF config field:
      • Chat Template Kwargs (Optional JSON)
    • Added corresponding ViewModel update path so users can override defaults per model.
  • Model catalog update

    • Added default repository entry for:
      • Qwen/Qwen3.5-4B-Instruct-GGUF

Example of newly supported config payload:

{
  "chatTemplateKwargs": "{\"enable_thinking\": false}"
}

💡 You can make Copilot smarter by setting up custom instructions, customizing its development environment and configuring Model Context Protocol (MCP) servers. Learn more Copilot coding agent tips in the docs.

Copilot AI and others added 2 commits March 5, 2026 04:02
Co-authored-by: Godzilla675 <131464726+Godzilla675@users.noreply.github.com>
Co-authored-by: Godzilla675 <131464726+Godzilla675@users.noreply.github.com>
Copilot AI changed the title [WIP] Add support for Qwen3.5 models and updated parameters Add Qwen 3.5 GGUF support and configurable chat-template kwargs (thinking toggle) Mar 5, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants