Locutusque commited on
Commit
dc8cc0f
·
verified ·
1 Parent(s): 3f5d110

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +23 -0
README.md ADDED
@@ -0,0 +1,23 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ datasets:
3
+ - HuggingFaceH4/ultrachat_200k
4
+ language:
5
+ - en
6
+ license: other
7
+ base_model: Qwen/Qwen-7B
8
+ ---
9
+ # Model description
10
+ The model was trained on about 100,000 examples of the HuggingFaceH4/ultrachat_200k dataset, with plans to release more checkpoints later on.
11
+
12
+ This model has not been aligned with DPO. In the future, different repositories will be released that contain versions of this model aligned with DPO, using various datasets.
13
+
14
+ # Evaluation
15
+ Upon personal testing, the model demonstrates excellent performance in mathematics, history, and coding tasks. This model will also be submitted to the Open LLM Leaderboard.
16
+
17
+ # Recommended inference parameters
18
+
19
+ temperature=0.2, top_p=0.14, top_k=12, repetition_penalty=1.1
20
+
21
+ # License
22
+
23
+ Please make sure to read the Qwen licensing agreement before using this model.