Skip to content

Commit 6034e13

Browse files
authored
Update README.md
1 parent c7ff6fe commit 6034e13

1 file changed

Lines changed: 9 additions & 1 deletion

File tree

llama/README.md

Lines changed: 9 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,4 @@
1-
--- # SmallBASIC Llama Module
1+
# SmallBASIC Llama Module
22

33
A comprehensive SmallBASIC library module that bridges the scripting capabilities of SmallBASIC with the power of Llama.cpp Large Language Models. This project allows developers to create, configure, and interact with LLM instances directly within a SmallBASIC environment.
44

@@ -116,6 +116,12 @@ Once the model file is in your `models` directory (or wherever specified), you c
116116
llama = LLAMA("models/llama3-8b/llama-3-8b-instruct.Q4_K_M.gguf", 2048, 1024, -1, 0)
117117
```
118118

119+
### Method 3: Direct download
120+
121+
1. Navigate to https://huggingface.co/
122+
2. Click Models at the top and then select Libraries/GGUF
123+
3. Use the parameters slider to limit the selection for your hardware.
124+
119125
---
120126

121127
## Architecture
@@ -309,5 +315,7 @@ llama.set_penalty_repeat(1.0)
309315
---
310316
311317
## Conclusion
318+
312319
This module empowers SmallBASIC users to build sophisticated AI applications, from chatbots to creative writing tools, leveraging the efficiency of Llama.cpp within a familiar scripting paradigm. Proper configuration of CUDA and generation parameters ensures optimal performance and output quality. Models can be easily acquired via the Hugging Face Hub using standard CLI tools or Python scripts.
320+
313321
---

0 commit comments

Comments
 (0)