update readme
Browse files
README.md
CHANGED
@@ -38,8 +38,8 @@ AutoConfig.register("jetmoe", JetMoEConfig)
|
|
38 |
AutoModelForCausalLM.register(JetMoEConfig, JetMoEForCausalLM)
|
39 |
AutoModelForSequenceClassification.register(JetMoEConfig, JetMoEForSequenceClassification)
|
40 |
|
41 |
-
tokenizer = AutoTokenizer.from_pretrained('
|
42 |
-
model = AutoModelForCausalLM.from_pretrained('
|
43 |
```
|
44 |
The MoE code is based on the [ScatterMoE](https://github.com/shawntan/scattermoe). The code is still under active development, we are happy to receive any feedback or suggestions.
|
45 |
|
|
|
38 |
AutoModelForCausalLM.register(JetMoEConfig, JetMoEForCausalLM)
|
39 |
AutoModelForSequenceClassification.register(JetMoEConfig, JetMoEForSequenceClassification)
|
40 |
|
41 |
+
tokenizer = AutoTokenizer.from_pretrained('jetmoe/jetmoe-8b')
|
42 |
+
model = AutoModelForCausalLM.from_pretrained('jetmoe/jetmoe-8b')
|
43 |
```
|
44 |
The MoE code is based on the [ScatterMoE](https://github.com/shawntan/scattermoe). The code is still under active development, we are happy to receive any feedback or suggestions.
|
45 |
|