Skip to content

Commit fd65076

Browse files
committed
Update Submodule vendor/llama.cpp 1acee6b..d161ea7
Signed-off-by: JamePeng <jame_peng@sina.com>
1 parent 1b0ae70 commit fd65076

2 files changed

Lines changed: 2 additions & 1 deletion

File tree

llama_cpp/llama_cpp.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -2804,6 +2804,7 @@ def llama_state_seq_load_file(
28042804
LLAMA_STATE_SEQ_FLAGS_PARTIAL_ONLY = 1
28052805

28062806
# // keeps the tensor data on device buffers (i.e. not accessible in host memory, but faster save/load)
2807+
# // Getting the state for a seq_id with this flag invalidates all prior states gotten for that seq_id with this flag.
28072808
LLAMA_STATE_SEQ_FLAGS_ON_DEVICE = 2
28082809

28092810
llama_state_seq_flags = ctypes.c_uint32

vendor/llama.cpp

Submodule llama.cpp updated 108 files

0 commit comments

Comments
 (0)