prithivMLmods
commited on
Update README.md
Browse files
README.md
CHANGED
@@ -14,14 +14,14 @@ tags:
|
|
14 |
---
|
15 |
# **Primal-Mini-3B-Exp**
|
16 |
|
17 |
-
Primal-Mini-3B-Exp is based on the Qwen
|
18 |
|
19 |
### **Key Improvements**
|
20 |
1. **Advanced Reasoning & Logic**: Optimized for multi-step problem-solving, logical deduction, and contextual analysis.
|
21 |
-
2. **Fine-Tuned Instruction Following**: Generates precise responses, structured outputs (e.g., JSON), and extended long-form text (
|
22 |
3. **Greater Adaptability**: Excels in role-playing, multi-turn dialogues, and diverse system prompts.
|
23 |
-
4. **Long-Context Support**: Handles up to **
|
24 |
-
5. **Multilingual Proficiency**: Supports over **
|
25 |
|
26 |
### **Quickstart with Transformers**
|
27 |
|
@@ -52,7 +52,7 @@ model_inputs = tokenizer([text], return_tensors="pt").to(model.device)
|
|
52 |
|
53 |
generated_ids = model.generate(
|
54 |
**model_inputs,
|
55 |
-
max_new_tokens=
|
56 |
)
|
57 |
generated_ids = [
|
58 |
output_ids[len(input_ids):] for input_ids, output_ids in zip(model_inputs.input_ids, generated_ids)
|
@@ -67,12 +67,12 @@ print(response)
|
|
67 |
- **Mathematical & Scientific Computation**: Supports theorem proving, complex calculations, and scientific knowledge retrieval.
|
68 |
- **Code Generation & Debugging**: Generates optimized code, detects errors, and improves programming workflows.
|
69 |
- **Structured Data Analysis**: Processes tables, JSON, and structured formats for data-centric applications.
|
70 |
-
- **Multilingual Reasoning & Translation**: High proficiency across **
|
71 |
- **Extended Text Generation**: Capable of generating research papers, instructional guides, and in-depth reports.
|
72 |
|
73 |
### **Limitations**
|
74 |
-
1. **
|
75 |
2. **Language-Specific Variability**: Performance may differ across supported languages, especially for low-resource languages.
|
76 |
3. **Potential Error Accumulation**: Long-form text generation can introduce inconsistencies over extended outputs.
|
77 |
4. **Limited Real-World Awareness**: Knowledge is restricted to training data and may not reflect recent world events.
|
78 |
-
5. **Prompt Sensitivity**: The quality of responses depends on the specificity and clarity of the input prompt.
|
|
|
14 |
---
|
15 |
# **Primal-Mini-3B-Exp**
|
16 |
|
17 |
+
Primal-Mini-3B-Exp is based on the Qwen 3B modality architecture, designed to enhance the reasoning capabilities of 3B-parameter models. It has been fine-tuned on a synthetic dataset derived from a subset of Qwen’s QWQ and DeepSeek R1, further optimizing its chain-of-thought (CoT) reasoning and logical problem-solving abilities. The model demonstrates significant improvements in context understanding, structured data processing, and long-context comprehension, making it ideal for complex reasoning tasks, instruction-following, and text generation.
|
18 |
|
19 |
### **Key Improvements**
|
20 |
1. **Advanced Reasoning & Logic**: Optimized for multi-step problem-solving, logical deduction, and contextual analysis.
|
21 |
+
2. **Fine-Tuned Instruction Following**: Generates precise responses, structured outputs (e.g., JSON), and extended long-form text (4K+ tokens).
|
22 |
3. **Greater Adaptability**: Excels in role-playing, multi-turn dialogues, and diverse system prompts.
|
23 |
+
4. **Long-Context Support**: Handles up to **64K tokens** and generates up to **4K tokens** per output.
|
24 |
+
5. **Multilingual Proficiency**: Supports over **20 languages**, including Chinese, English, French, Spanish, Portuguese, German, and more.
|
25 |
|
26 |
### **Quickstart with Transformers**
|
27 |
|
|
|
52 |
|
53 |
generated_ids = model.generate(
|
54 |
**model_inputs,
|
55 |
+
max_new_tokens=256
|
56 |
)
|
57 |
generated_ids = [
|
58 |
output_ids[len(input_ids):] for input_ids, output_ids in zip(model_inputs.input_ids, generated_ids)
|
|
|
67 |
- **Mathematical & Scientific Computation**: Supports theorem proving, complex calculations, and scientific knowledge retrieval.
|
68 |
- **Code Generation & Debugging**: Generates optimized code, detects errors, and improves programming workflows.
|
69 |
- **Structured Data Analysis**: Processes tables, JSON, and structured formats for data-centric applications.
|
70 |
+
- **Multilingual Reasoning & Translation**: High proficiency across **20+ languages** for international applications.
|
71 |
- **Extended Text Generation**: Capable of generating research papers, instructional guides, and in-depth reports.
|
72 |
|
73 |
### **Limitations**
|
74 |
+
1. **Moderate Computational Requirements**: Requires **mid-end consumer GPUs** for optimal inference.
|
75 |
2. **Language-Specific Variability**: Performance may differ across supported languages, especially for low-resource languages.
|
76 |
3. **Potential Error Accumulation**: Long-form text generation can introduce inconsistencies over extended outputs.
|
77 |
4. **Limited Real-World Awareness**: Knowledge is restricted to training data and may not reflect recent world events.
|
78 |
+
5. **Prompt Sensitivity**: The quality of responses depends on the specificity and clarity of the input prompt.
|