Hugging Face's logo

mesolitica
/
malaysian-mistral-349M-MLM-512

Feature Extraction
Transformers
Safetensors
Malay
mistral
custom_code
text-generation-inference
text-embeddings-inference
Inference Endpoints
Model card Files Community

Malaysian Mistral 349M on MLM task using 512 context length

Replicating https://github.com/McGill-NLP/llm2vec using https://huggingface.co/mesolitica/malaysian-mistral-349M-4096, done by https://github.com/aisyahrzk https://twitter.com/aisyahhhrzk

Source code at https://github.com/mesolitica/malaya/tree/master/session/llm2vec

WandB, https://wandb.ai/aisyahrazak/mistral-349M-mlm?nw=nwuseraisyahrazak

Downloads last month
83
Safetensors
Model size
349M params
Tensor type
F32
·
Inference Providers NEW
Feature Extraction
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The HF Inference API does not support model that require custom code execution.

Collection including mesolitica/malaysian-mistral-349M-MLM-512