This PR implements the previously stubbed state management methods in the _internals.py module and updates the corresponding API calls in llama.py to use the correct underlying C++ function names.#2134

Open

bsides230 wants to merge 6 commits into

abetlen:mainfrom

bsides230:kv-caching-issue

Commits on Mar 3, 2026

feat: update llama.cpp submodule and bindings for Qwen 3.5 support
codavidgarcia
committed

Commits on Mar 5, 2026

This PR implements the previously stubbed state management methods in the _internals.py module and updates the corresponding API calls in llama.py to use the correct underlying C++ function names.
bsides230
committed