Commit
·
0f5c016
1
Parent(s):
0bdc197
Update README.md
Browse files
README.md
CHANGED
@@ -7,4 +7,18 @@ datasets:
|
|
7 |
|
8 |
# falcon-40b-megacode2-oasst
|
9 |
|
10 |
-
- wandb: [
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
7 |
|
8 |
# falcon-40b-megacode2-oasst
|
9 |
|
10 |
+
- wandb: stage 1: [run37_megacode_falcon40](https://wandb.ai/open-assistant/epfl-mt-sft/runs/run37_megacode_falcon40), stage 2: [run38_megacode_oasst_falcon40](https://wandb.ai/open-assistant/epfl-mt-sft/runs/run38_megacode_oasst_falcon40)
|
11 |
+
|
12 |
+
## Prompt Template
|
13 |
+
|
14 |
+
[chatml](https://github.com/openai/openai-python/blob/main/chatml.md) format is used:
|
15 |
+
"<|im_start|>user\n{user prompt}<|im_end|>\n<|im_start|>assistant\n{Assistant answer}<|im_end|>\n"
|
16 |
+
|
17 |
+
Multi-line:
|
18 |
+
|
19 |
+
```
|
20 |
+
<|im_start|>user
|
21 |
+
{user prompt}<|im_end|>
|
22 |
+
<|im_start|>assistant
|
23 |
+
{Assistant answer}<|im_end|>
|
24 |
+
```
|