Skip to content

Commit 9952353

Browse files
committed
feat(_ggml): implement ggml-backend API bindings and fix type hints
- Introduces extensive ctypes bindings for `ggml-backend.h` (devices, buffers, registries, and CPU buffer types) to support advanced memory routing like MoE CPU offloading. Also fixes various static typing warnings by adding `# type: ignore` to pointer annotations. Signed-off-by: JamePeng <jame_peng@sina.com>
1 parent db8bf45 commit 9952353

1 file changed

Lines changed: 499 additions & 26 deletions

File tree

0 commit comments

Comments
 (0)