m-i commited on
Commit
5193f22
·
verified ·
1 Parent(s): bd56d54

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +32 -0
README.md ADDED
@@ -0,0 +1,32 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model: mkurman/Qwen2.5-14B-DeepSeek-R1-1M
4
+ tags:
5
+ - mlx
6
+ ---
7
+
8
+ # m-i/Qwen2.5-14B-DeepSeek-R1-1M-Q8-mlx
9
+
10
+ The Model [m-i/Qwen2.5-14B-DeepSeek-R1-1M-Q8-mlx](https://huggingface.co/m-i/Qwen2.5-14B-DeepSeek-R1-1M-Q8-mlx) was converted to MLX format from [mkurman/Qwen2.5-14B-DeepSeek-R1-1M](https://huggingface.co/mkurman/Qwen2.5-14B-DeepSeek-R1-1M) using mlx-lm version **0.20.5**.
11
+
12
+ ## Use with mlx
13
+
14
+ ```bash
15
+ pip install mlx-lm
16
+ ```
17
+
18
+ ```python
19
+ from mlx_lm import load, generate
20
+
21
+ model, tokenizer = load("m-i/Qwen2.5-14B-DeepSeek-R1-1M-Q8-mlx")
22
+
23
+ prompt="hello"
24
+
25
+ if hasattr(tokenizer, "apply_chat_template") and tokenizer.chat_template is not None:
26
+ messages = [{"role": "user", "content": prompt}]
27
+ prompt = tokenizer.apply_chat_template(
28
+ messages, tokenize=False, add_generation_prompt=True
29
+ )
30
+
31
+ response = generate(model, tokenizer, prompt=prompt, verbose=True)
32
+ ```