Update README.md

README.md

@@ -9,16 +9,16 @@ base_model:
 ---
 
 # Mistral-Small-3-Reasoner-s1
-A simple [Mistral-Small-24B-Instruct-2501](https://huggingface.co/mistralai/Mistral-Small-24B-Instruct-2501) finetune on the [s1K reasoning dataset by Muennighoff et al.](https://huggingface.co/datasets/simplescaling/s1K) to give the original model basic reasoning capabilities similar to DeepSeek R1's. Surprisingly, they appear to work even outside math/STEM subjects.
+A simple [Mistral-Small-24B-Instruct-2501](https://huggingface.co/mistralai/Mistral-Small-24B-Instruct-2501) finetune on the [s1K reasoning dataset by Muennighoff et al.](https://huggingface.co/datasets/simplescaling/s1K) to give the original model basic reasoning capabilities within `<think>` tags, like DeepSeek R1. Surprisingly, the model can reason even outside math/STEM subjects.
 
 ## Usage notes
-Prepend the assistant response with `<think>` to make the model engage in a chain-of-thought. This should happen automatically with math questions on an empty context, but it needs to be forced in longer conversations. When done thinking, the model will generate `</think>` and then the final response.
+Prepend the assistant response with `<think>` to make the model engage in a chain-of-thought. This should happen automatically with math questions on an empty context, but it needs to be forced in longer conversations. When done thinking, it will generate `</think>` and then the final response.
 
-Make sure that the models' output length is long enough, and be prepared to make the model continue its response if it stops prematurely.
+Make sure that the model's output length is long enough; be prepared to make the it continue its response if it stops prematurely.
 
-Low-depth instructions (perhaps at depth-0, just before the assistant's rsponse) can be beneficial in steering how the model should think. An additional `[SYSTEM_PROMPT]` can be used there.
+Low-depth instructions (perhaps at depth-0, just before the assistant's rsponse) can be beneficial in steering how the model should think. An additional `[SYSTEM_PROMPT]` could be used there.
 
-I advise to remove old chain-of-thoughts from the chat history before the model generates a new one, but I haven't tested this in depth.
+I recommend to remove old chain-of-thoughts from the chat history before the model generates a new one, but I haven't tested this in depth.
 
 ## Prompting format
 ```
@@ -30,10 +30,9 @@ Model response.</s>
 ```
 
 ## Known quirks and issues
-- Very long chain-of-thoughts might confuse the model during multi-turn conversations.
-- The model can override the requested formatting/style with that of the finetuning data.
-- Some of the non-reasoning capabilities of the original `Mistral-Small-24B-Instruct-2501` model might have degraded.
-- Most default guardrails apparently still work, but can be bypassed with a suitable prompt as with the original model.
+- The chain-of-thoughts can confuse the model during prolonged multi-turn conversations (note that the finetuning data was exclusively single-turn).
+- Besides multi-turn capabilities, other non-reasoning capabilities of the original `Mistral-Small-24B-Instruct-2501` model might have degraded.
+- Most default guardrails apparently still work, but can be very easily bypassed with a suitable prompt as with the original model.
 
 # What's in this repository
 - Checkpoints for epochs 1~5
@@ -41,10 +40,10 @@ Model response.</s>
 - Some static GGUF quantizations
 
 ## Dataset
-Almost the entirety of the [s1K dataset](https://huggingface.co/datasets/simplescaling/s1K) was used with minimal modifications to make it properly work with Mistral-Small-3-Instruct, with the exception of 4 rows that didn't fit within the training sequence length of 8192 tokens and 16 of the shortest ones that have been used as the test set instead. No samples have been clipped and no system prompt was added. All were single-turn.
+Almost the entirety of the [s1K dataset](https://huggingface.co/datasets/simplescaling/s1K) was used with minimal modifications to make it properly work with Mistral-Small-3-Instruct, except 4 rows that didn't fit within the training sequence length of 8192 tokens and 16 of the shortest ones that have been used as the test set instead. No samples have been clipped and no system prompt was added. All were single-turn.
 
 ## Training hyperparameters
-I tried to roughly follow indications from [appendix C in the paper](https://arxiv.org/abs/2501.19393) with the notable exception of using 4-bit LoRA finetuning and tuning the learning rate accordingly. The loss was not computed on questions within `[INST]...[/INST]` tags (including the tags), just on reasoning traces and solutions. The training sequence length was about the maximum I could use on one NVidia RTX3090 24GB GPU. The total training time was about 18 hours.
+I tried to roughly follow indications from [appendix C in the paper](https://arxiv.org/abs/2501.19393) with the notable exception of using 4-bit LoRA finetuning and tuning the learning rate accordingly. The loss was not computed on questions within `[INST]...[/INST]` tags (including the tags), just on reasoning traces and solutions. The training sequence length was close to the maximum I could use on one NVidia RTX3090 24GB GPU. The total training time was about 18 hours.
 
 Overfitting (increasing eval loss) occurred after 1 epoch, but the training loss behavior was similar to that observed in the paper.