xxx777xxxASD
/

L3.1-ClaudeMaid-4x8B

Text Generation

Mixture of Experts

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

xxx777xxxASD commited on Jul 27, 2024

Commit

31e8a6d

·

verified ·

1 Parent(s): 5777eb3

Update README.md

Files changed (1) hide show

README.md +2 -4

README.md CHANGED Viewed

@@ -54,11 +54,9 @@ experts:
 ## Usage
-It seems like 1.71 koboldcpp can't run MoE llama-3.1 models yet, or perhaps im just dumb and messed something up
-![image/png](https://cdn-uploads.huggingface.co/production/uploads/64f5e51289c121cb864ba464/sTM3GUVMucM_AnIk8iG7H.png)
 If anyone has simmilar problem - run the model directly from llama.cpp, here's simple [open source GUI(Windows)](https://huggingface.co/xxx777xxxASD/LlamaCpp-Server-Ui) you can use if the console is your worst enemy
 ## Models used

 ## Usage
+It seems like 1.71 koboldcpp can't run GGUFs of llama-3.1 MoE models yet, or perhaps im just dumb and messed something up
 If anyone has simmilar problem - run the model directly from llama.cpp, here's simple [open source GUI(Windows)](https://huggingface.co/xxx777xxxASD/LlamaCpp-Server-Ui) you can use if the console is your worst enemy
+![image/png](https://cdn-uploads.huggingface.co/production/uploads/64f5e51289c121cb864ba464/sTM3GUVMucM_AnIk8iG7H.png)
 ## Models used