prithivMLmods commited on
Commit
081cc39
·
verified ·
1 Parent(s): 10d7c8d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +95 -1
README.md CHANGED
@@ -8,4 +8,98 @@ pipeline_tag: text-generation
8
  library_name: transformers
9
  tags:
10
  - text-generation-inference
11
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
8
  library_name: transformers
9
  tags:
10
  - text-generation-inference
11
+ ---
12
+ ![xfghxxfdghfdgh.gif](https://cdn-uploads.huggingface.co/production/uploads/65bb837dbfb878f46c77de4c/pyyKGHchFLAc5L5F1r44E.gif)
13
+
14
+ # **Megatron-Opus-14B-2.0-GGUF [ Exp ]**
15
+
16
+ [Megatron-Opus-14B-2.0-GGUF ] Exp finetuned from Microsoft's Phi-4 is a state-of-the-art open model developed with a focus on responsible problem solving and advanced reasoning capabilities. Built upon a diverse blend of synthetic datasets, carefully filtered public domain websites, and high-quality academic books and Q&A datasets, Megatron-Opus-14B-2.0-GGUF ensures that small, capable models are trained with datasets of exceptional depth and precision.
17
+
18
+ Megatron-Opus-14B-2.0-GGUF adopts a robust safety post-training approach using open-source and in-house synthetic datasets. This involves a combination of SFT (Supervised Fine-Tuning) and iterative DPO (Direct Preference Optimization) techniques, ensuring helpful and harmless outputs across various safety categories.
19
+
20
+
21
+ # **Dataset Info**
22
+
23
+ Megatron-Opus-14B-2.0-GGUF is fine-tuned on a carefully curated synthetic dataset generated using an advanced pipeline optimized for Chain of Thought (CoT) reasoning and Responsible Problem Breakdown (RPB) methodologies. This ensures that the model excels at:
24
+
25
+ - **Logical reasoning**
26
+ - **Step-by-step problem-solving**
27
+ - **Breaking down complex tasks into manageable parts**
28
+
29
+ The dataset also emphasizes responsible decision-making and fairness in generating solutions.
30
+
31
+ # **Run with Transformers**
32
+
33
+ ```python
34
+ # pip install accelerate
35
+ from transformers import AutoTokenizer, AutoModelForCausalLM
36
+ import torch
37
+
38
+ tokenizer = AutoTokenizer.from_pretrained("prithivMLmods/Megatron-Opus-14B-2.0-GGUF")
39
+ model = AutoModelForCausalLM.from_pretrained(
40
+ "prithivMLmods/Megatron-Opus-14B-2.0-GGUF",
41
+ device_map="auto",
42
+ torch_dtype=torch.bfloat16,
43
+ )
44
+
45
+ input_text = "Explain the concept of black holes."
46
+ input_ids = tokenizer(input_text, return_tensors="pt").to("cuda")
47
+
48
+ outputs = model.generate(**input_ids, max_new_tokens=64)
49
+ print(tokenizer.decode(outputs[0]))
50
+ ```
51
+
52
+ For chat-style interactions, use `tokenizer.apply_chat_template`:
53
+
54
+ ```python
55
+ messages = [
56
+ {"role": "user", "content": "Explain the concept of black holes."},
57
+ ]
58
+ input_ids = tokenizer.apply_chat_template(messages, return_tensors="pt", return_dict=True).to("cuda")
59
+
60
+ outputs = model.generate(**input_ids, max_new_tokens=256)
61
+ print(tokenizer.decode(outputs[0]))
62
+ ```
63
+
64
+ # **Intended Use**
65
+
66
+ Megatron-Opus-14B-2.0-GGUF is tailored for a wide range of applications, especially those involving **advanced reasoning**, **multilingual capabilities**, and **responsible problem-solving**. Its primary use cases include:
67
+
68
+ 1. **Responsible Problem Solving**
69
+ - Breaking down complex problems into logical, actionable steps.
70
+ - Offering ethical, well-rounded solutions in academic and professional contexts.
71
+
72
+ 2. **Advanced Reasoning Tasks**
73
+ - Excelling in mathematics, logic, and scientific reasoning.
74
+ - Providing detailed explanations and systematic answers.
75
+
76
+ 3. **Content Generation**
77
+ - Assisting in generating high-quality content for various domains, including creative writing and technical documentation.
78
+ - Supporting marketers, writers, and educators with detailed and well-structured outputs.
79
+
80
+ 4. **Educational Support**
81
+ - Acting as a virtual tutor for students by generating practice questions, answers, and detailed explanations.
82
+ - Helping educators design learning material that promotes critical thinking and step-by-step problem-solving.
83
+
84
+ 5. **Customer Support & Dialogue Systems**
85
+ - Enabling chatbots and virtual assistants to provide accurate, helpful, and responsible responses.
86
+ - Enhancing customer service with reasoning-driven automation.
87
+
88
+ # **Limitations**
89
+
90
+ Despite its strengths, Megatron-Opus-14B-2.0-GGUF has some limitations that users should be aware of:
91
+
92
+ 1. **Bias and Fairness**
93
+ - While great effort has been made to minimize biases, users should critically assess the model’s output in sensitive scenarios to avoid unintended bias.
94
+
95
+ 2. **Contextual Interpretation**
96
+ - The model may occasionally misinterpret highly nuanced prompts or ambiguous contexts, leading to suboptimal responses.
97
+
98
+ 3. **Knowledge Cutoff**
99
+ - Megatron-Opus-14B-2.0-GGUF’s knowledge is static and based on the data available at the time of training. It does not include real-time updates or information on recent developments.
100
+
101
+ 4. **Safety and Harmlessness**
102
+ - Despite post-training safety alignment, inappropriate or harmful outputs may still occur. Continuous monitoring and human oversight are advised when using the model in critical contexts.
103
+
104
+ 5. **Computational Requirements**
105
+ - Deploying Megatron-Opus-14B-2.0-GGUF efficiently may require substantial computational resources, particularly for large-scale deployments or real-time applications.