meta-llama/Llama-3.1-8B-Instruct
Text Generation
•
Updated
•
5.78M
•
•
3.58k
NIM Serverless Inference API
Models in this collection are available for inference via a serverless API powered by NVIDIA NIM.
Note NIM LLM deployed with H100 x 1
meta-llama/Llama-3.1-70B-Instruct
Text Generation • Updated • 417k • • 781Note NIM LLM deployed with H100 x 4
meta-llama/Llama-3.1-405B-Instruct-FP8
Text Generation • Updated • 18.3k • 184Note NIM LLM deployed with H100 x 8
meta-llama/Meta-Llama-3-8B-Instruct
Text Generation • Updated • 2.29M • • 3.8kNote NIM LLM deployed with H100 x 1
meta-llama/Meta-Llama-3-70B-Instruct
Text Generation • Updated • 160k • • 1.46kNote NIM LLM deployed with H100 x 4
mistralai/Mistral-7B-Instruct-v0.3
Text Generation • Updated • 1.21M • • 1.31kNote NIM LLM deployed with H100 x 2
mistralai/Mixtral-8x7B-Instruct-v0.1
Text Generation • Updated • 1.19M • • 4.28kNote NIM LLM deployed with H100 x 2
mistralai/Mixtral-8x22B-Instruct-v0.1
Text Generation • Updated • 860k • • 710Note NIM LLM deployed with H100 x 8