prithivMLmods commited on
Commit
a1ad10b
·
verified ·
1 Parent(s): 9e93849

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -8
README.md CHANGED
@@ -14,14 +14,14 @@ tags:
14
  ---
15
  # **Primal-Mini-3B-Exp**
16
 
17
- Primal-Mini-3B-Exp is based on the Qwen 2.5 14B modality architecture, designed to enhance the reasoning capabilities of 3B-parameter models. It has been fine-tuned on a Synthetic dataset entries based on one half of Qwen’s QWQ and DeepSeek R1, further optimizing its chain-of-thought (CoT) reasoning and logical problem-solving abilities. The model demonstrates significant improvements in context understanding, structured data processing, and long-context comprehension, making it ideal for complex reasoning tasks, instruction-following, and text generation.
18
 
19
  ### **Key Improvements**
20
  1. **Advanced Reasoning & Logic**: Optimized for multi-step problem-solving, logical deduction, and contextual analysis.
21
- 2. **Fine-Tuned Instruction Following**: Generates precise responses, structured outputs (e.g., JSON), and extended long-form text (8K+ tokens).
22
  3. **Greater Adaptability**: Excels in role-playing, multi-turn dialogues, and diverse system prompts.
23
- 4. **Long-Context Support**: Handles up to **128K tokens** and generates up to **8K tokens** per output.
24
- 5. **Multilingual Proficiency**: Supports over **29 languages**, including Chinese, English, French, Spanish, Portuguese, German, and more.
25
 
26
  ### **Quickstart with Transformers**
27
 
@@ -52,7 +52,7 @@ model_inputs = tokenizer([text], return_tensors="pt").to(model.device)
52
 
53
  generated_ids = model.generate(
54
  **model_inputs,
55
- max_new_tokens=512
56
  )
57
  generated_ids = [
58
  output_ids[len(input_ids):] for input_ids, output_ids in zip(model_inputs.input_ids, generated_ids)
@@ -67,12 +67,12 @@ print(response)
67
  - **Mathematical & Scientific Computation**: Supports theorem proving, complex calculations, and scientific knowledge retrieval.
68
  - **Code Generation & Debugging**: Generates optimized code, detects errors, and improves programming workflows.
69
  - **Structured Data Analysis**: Processes tables, JSON, and structured formats for data-centric applications.
70
- - **Multilingual Reasoning & Translation**: High proficiency across **29+ languages** for international applications.
71
  - **Extended Text Generation**: Capable of generating research papers, instructional guides, and in-depth reports.
72
 
73
  ### **Limitations**
74
- 1. **High Computational Requirements**: Due to its **3B parameters** and **128K context support**, it requires powerful GPUs or TPUs for efficient inference.
75
  2. **Language-Specific Variability**: Performance may differ across supported languages, especially for low-resource languages.
76
  3. **Potential Error Accumulation**: Long-form text generation can introduce inconsistencies over extended outputs.
77
  4. **Limited Real-World Awareness**: Knowledge is restricted to training data and may not reflect recent world events.
78
- 5. **Prompt Sensitivity**: The quality of responses depends on the specificity and clarity of the input prompt.
 
14
  ---
15
  # **Primal-Mini-3B-Exp**
16
 
17
+ Primal-Mini-3B-Exp is based on the Qwen 3B modality architecture, designed to enhance the reasoning capabilities of 3B-parameter models. It has been fine-tuned on a synthetic dataset derived from a subset of Qwen’s QWQ and DeepSeek R1, further optimizing its chain-of-thought (CoT) reasoning and logical problem-solving abilities. The model demonstrates significant improvements in context understanding, structured data processing, and long-context comprehension, making it ideal for complex reasoning tasks, instruction-following, and text generation.
18
 
19
  ### **Key Improvements**
20
  1. **Advanced Reasoning & Logic**: Optimized for multi-step problem-solving, logical deduction, and contextual analysis.
21
+ 2. **Fine-Tuned Instruction Following**: Generates precise responses, structured outputs (e.g., JSON), and extended long-form text (4K+ tokens).
22
  3. **Greater Adaptability**: Excels in role-playing, multi-turn dialogues, and diverse system prompts.
23
+ 4. **Long-Context Support**: Handles up to **64K tokens** and generates up to **4K tokens** per output.
24
+ 5. **Multilingual Proficiency**: Supports over **20 languages**, including Chinese, English, French, Spanish, Portuguese, German, and more.
25
 
26
  ### **Quickstart with Transformers**
27
 
 
52
 
53
  generated_ids = model.generate(
54
  **model_inputs,
55
+ max_new_tokens=256
56
  )
57
  generated_ids = [
58
  output_ids[len(input_ids):] for input_ids, output_ids in zip(model_inputs.input_ids, generated_ids)
 
67
  - **Mathematical & Scientific Computation**: Supports theorem proving, complex calculations, and scientific knowledge retrieval.
68
  - **Code Generation & Debugging**: Generates optimized code, detects errors, and improves programming workflows.
69
  - **Structured Data Analysis**: Processes tables, JSON, and structured formats for data-centric applications.
70
+ - **Multilingual Reasoning & Translation**: High proficiency across **20+ languages** for international applications.
71
  - **Extended Text Generation**: Capable of generating research papers, instructional guides, and in-depth reports.
72
 
73
  ### **Limitations**
74
+ 1. **Moderate Computational Requirements**: Requires **mid-end consumer GPUs** for optimal inference.
75
  2. **Language-Specific Variability**: Performance may differ across supported languages, especially for low-resource languages.
76
  3. **Potential Error Accumulation**: Long-form text generation can introduce inconsistencies over extended outputs.
77
  4. **Limited Real-World Awareness**: Knowledge is restricted to training data and may not reflect recent world events.
78
+ 5. **Prompt Sensitivity**: The quality of responses depends on the specificity and clarity of the input prompt.