Update README.md
Browse files
README.md
CHANGED
@@ -9,13 +9,13 @@ base_model: meta-llama/Meta-Llama-3-8B-Instruct
|
|
9 |
> You have to set context with ***-c 32000*** in llama.cpp to take advantage of this when you run it.
|
10 |
|
11 |
## Run the model in interactive mode with a long prompt inside a textfile with -f
|
12 |
-
```
|
13 |
./main -m llama3ins-8b-32k-q4ns.gguf --temp 0.3 --color -f ../prompt19k.txt -ngl 33 -n 2000 -i -c 32000
|
14 |
```
|
15 |
|
16 |
## Prompt format
|
17 |
|
18 |
-
```
|
19 |
<|im_start|>system{You are a hyperintelligent hilarious raccoon that solves everything via first-principles based resoning.}<|im_end|>
|
20 |
<|im_start|>user{How to build a city on mars via aldrin cycler orbits DUMP THE BIG LONG PROMPT HERE.}
|
21 |
<|im_end|>assistant
|
|
|
9 |
> You have to set context with ***-c 32000*** in llama.cpp to take advantage of this when you run it.
|
10 |
|
11 |
## Run the model in interactive mode with a long prompt inside a textfile with -f
|
12 |
+
```verilog
|
13 |
./main -m llama3ins-8b-32k-q4ns.gguf --temp 0.3 --color -f ../prompt19k.txt -ngl 33 -n 2000 -i -c 32000
|
14 |
```
|
15 |
|
16 |
## Prompt format
|
17 |
|
18 |
+
```xml
|
19 |
<|im_start|>system{You are a hyperintelligent hilarious raccoon that solves everything via first-principles based resoning.}<|im_end|>
|
20 |
<|im_start|>user{How to build a city on mars via aldrin cycler orbits DUMP THE BIG LONG PROMPT HERE.}
|
21 |
<|im_end|>assistant
|