Article
Welcome to Inference Providers on the Hub 🔥
•
258
Hugo Larcher
hlarcher
AI & ML interests
None yet
Recent Activity
authored
a paper
37 minutes ago
SmolLM2: When Smol Goes Big -- Data-Centric Training of a Small Language
Model
upvoted
an
article
9 days ago
Welcome to Inference Providers on the Hub 🔥
posted
an
update
21 days ago
We are introducing multi-backend support in Hugging Face Text Generation Inference!
With new TGI architecture we are now able to plug new modeling backends to get best performances according to selected model and available hardware. This first step will very soon be followed by the integration of new backends (TRT-LLM, llama.cpp, vLLM, Neuron and TPU).
We are polishing the TensorRT-LLM backend which achieves impressive performances on NVIDIA GPUs, stay tuned 🤗 !
Check out the details: https://huggingface.co/blog/tgi-multi-backend
Organizations
hlarcher's activity
upvoted
an
article
9 days ago
upvoted
an
article
21 days ago
Article
Introducing multi-backends (TRT-LLM, vLLM) support for Text Generation Inference
•
63
upvoted
a
paper
11 months ago
upvoted
a
paper
over 1 year ago