Commit 9952353
committed
feat(_ggml): implement ggml-backend API bindings and fix type hints
- Introduces extensive ctypes bindings for `ggml-backend.h` (devices, buffers, registries, and CPU buffer types) to support advanced memory routing like MoE CPU offloading. Also fixes various static typing warnings by adding `# type: ignore` to pointer annotations.
Signed-off-by: JamePeng <jame_peng@sina.com>1 parent db8bf45 commit 9952353
1 file changed
Lines changed: 499 additions & 26 deletions
0 commit comments