Describe the Issue
Attempting to use llama.cpp's automating fitting code. This will override all your layer configs, may or may not work!
Autofit Reserve Space: 1024 MB
Traceback (most recent call last):
File "koboldcpp.py", line 9087, in
main(launch_args=parser.parse_args(),default_args=parser.parse_args([]))
File "koboldcpp.py", line 8031, in main
kcpp_main_process(args,global_memory,using_gui_launcher)
File "koboldcpp.py", line 8501, in kcpp_main_process
loadok = load_model(modelname)
File "koboldcpp.py", line 1659, in load_model
ret = handle.load_model(inputs)
OSError: exception: access violation reading 0x00000143D21238E0
[21616] Failed to execute script 'koboldcpp' due to unhandled exception!
Additional Information:
Please provide as much relevant information about your setup as possible, such as the Operating System, CPU, GPU, KoboldCpp Version, and relevant logs (helpful to include the launch params from the terminal output, flags and crash logs)
Describe the Issue
Attempting to use llama.cpp's automating fitting code. This will override all your layer configs, may or may not work!
Autofit Reserve Space: 1024 MB
Traceback (most recent call last):
File "koboldcpp.py", line 9087, in
main(launch_args=parser.parse_args(),default_args=parser.parse_args([]))
File "koboldcpp.py", line 8031, in main
kcpp_main_process(args,global_memory,using_gui_launcher)
File "koboldcpp.py", line 8501, in kcpp_main_process
loadok = load_model(modelname)
File "koboldcpp.py", line 1659, in load_model
ret = handle.load_model(inputs)
OSError: exception: access violation reading 0x00000143D21238E0
[21616] Failed to execute script 'koboldcpp' due to unhandled exception!
Additional Information:
Please provide as much relevant information about your setup as possible, such as the Operating System, CPU, GPU, KoboldCpp Version, and relevant logs (helpful to include the launch params from the terminal output, flags and crash logs)