myshell-ai/OpenVoice
Text-to-Speech
•
Updated
•
421
AV LLMs
A collection of Audio, Video and Visual LLMs.
-
-
1.02k
OpenVoice
🤗 -
dataautogpt3/ProteusV0.3
Text-to-Image • Updated • 84.1k • 93 -
ByteDance/SDXL-Lightning
Text-to-Image • Updated • 165k • • 1.98k -
openai/whisper-large-v3
Automatic Speech Recognition • Updated • 4.83M • • 4k -
stabilityai/TripoSR
Image-to-3D • Updated • 31.7k • 514 -
Efficient-Large-Model/VILA-7b
Text Generation • Updated • 231 • 26 -
google/paligemma-3b-pt-896
Image-Text-to-Text • Updated • 4.29k • 116 -
microsoft/Phi-3-vision-128k-instruct
Text Generation • Updated • 163k • 947 -
stabilityai/stable-audio-open-1.0
Text-to-Audio • Updated • 23.9k • 1.05k -
OpenVLA: An Open-Source Vision-Language-Action Model
Paper • 2406.09246 • Published • 37 -
aiola/whisper-medusa-v1
Updated • 137 • 178 -
merve/idefics3llama-vqav2
Updated • 8 -
black-forest-labs/FLUX.1-schnell
Text-to-Image • Updated • 895k • • 3.34k -
112
Llama3.1 S V0.2 Checkpoint 2024 08 20
😻Convert text to audio and vice versa
-
gpt-omni/mini-omni
Text-to-Speech • Updated • 1 • 416 -
fishaudio/fish-speech-1.4
Text-to-Speech • Updated • 1.24k • 448 -
166
Tonic's GOT OCR
📲GOT - OCR (from : UCAS, Beijing)
-
stepfun-ai/GOT-OCR2_0
Image-Text-to-Text • Updated • 475k • 1.36k -
apple/coreml-sam2-large
Mask Generation • Updated • 22 • 25 -
coreml-projects/sam-2-studio
Updated • 22 -
mistralai/Pixtral-12B-2409
Image-Text-to-Text • Updated • 594 -
allenai/Molmo-72B-0924
Image-Text-to-Text • Updated • 4.65k • 280 -
openai/whisper-large-v3-turbo
Automatic Speech Recognition • Updated • 3.92M • • 1.9k -
Revai/reverb-asr
Automatic Speech Recognition • Updated • 12 • 78 -
342
GOT Online
💬Extract text from images using various OCR modes
-
facebook/vfusion3d
Image-to-3D • Updated • 78 • 66 -
facebook/cotracker
Updated • 1.03k • 35 -
rhymes-ai/Aria
Image-Text-to-Text • Updated • 29.7k • 611 -
SWivid/F5-TTS
Text-to-Speech • Updated • 1.11M • 887 -
63
Ichigo Llama3.1 S Instruct
🏢Generate text from audio recordings
-
kyutai/moshiko-mlx-q4
Updated • 247 • 27 -
kyutai/moshiko-mlx-q8
Updated • 226 • 5 -
98
Open VLM Video Leaderboard
🌎VLMEvalKit Eval Results in video understanding benchmark
-
jimmycarter/LibreFLUX
Text-to-Image • Updated • 501 • 159 -
microsoft/OmniParser
Image-Text-to-Text • Updated • 1.99k • 1.55k -
235
Aya Expanse
🌍Interact with Aya Expanse to chat, speak, and generate images in 23 languages
-
CohereForAI/aya-expanse-32b
Text Generation • Updated • 23.1k • 206 -
stabilityai/stable-diffusion-3.5-medium
Text-to-Image • Updated • 138k • • 554 -
OuteAI/OuteTTS-0.1-350M
Text-to-Speech • Updated • 5.22k • 300 -
vidore/colpali
Updated • 44.7k • 417 -
vidore/colpali-v1.2
Updated • 72.2k • 105 -
si-pbc/hertz-dev
Audio-to-Audio • Updated • 209 -
38
Talk To Ultravox
⚡Talk to Fixie.ai's Ultravox with WebRTC ⚡️
-
LLaVA-o1: Let Vision Language Models Reason Step-by-Step
Paper • 2411.10440 • Published • 113 -
Xkev/Llama-3.2V-11B-cot
Image-Text-to-Text • Updated • 6.7k • 141 -
google/paligemma-3b-pt-224
Image-Text-to-Text • Updated • 44.8k • 298 -
apple/coreml-mobileclip
Updated • 352 • 38 -
InstantX/InstantIR
Image-to-Image • Updated • 1 • 165 -
79
InstantIR
🖼diffusion-based Image Restoration model
-
135
Flux IP Adapter
🖼Prompt with Images in flux[dev]
-
38
Image Preferences - Argilla annotation space
🖼A community project to create an image preferences dataset.
-
fishaudio/fish-speech-1.5
Text-to-Speech • Updated • 8.15k • 422 -
meta-llama/Llama-3.3-70B-Instruct
Text Generation • Updated • 639k • • 1.87k -
42
Paligemma2 Vqav2
🐨PaliGemma2 LoRA finetuned on VQAv2
-
VisionZip: Longer is Better but Not Necessary in Vision Language Models
Paper • 2412.04467 • Published • 106 -
fancyfeast/llama-joycaption-alpha-two-hf-llava
Updated • 77.6k • 136 -
taohu/mask
Updated • 5 -
[MASK] is All You Need
Paper • 2412.06787 • Published • 2 -
595
Open VLM Leaderboard
🌎VLMEvalKit Evaluation Results Collection
-
microsoft/LLM2CLIP-Llama3.2-1B-EVA02-L-14-336
Zero-Shot Image Classification • Updated • 10 -
LLM2CLIP: Powerful Language Model Unlock Richer Visual Representation
Paper • 2411.04997 • Published • 37 -
Generative Powers of Ten
Paper • 2312.02149 • Published • 6 -
60
StoryStar
💬Fantasy story generator
-
GoodiesHere/Apollo-LMMs-Apollo-7B-t32
Video-Text-to-Text • Updated • 583 • 50 -
Apollo: An Exploration of Video Understanding in Large Multimodal Models
Paper • 2412.10360 • Published • 139 -
Qwen/Qwen2-VL-7B-Instruct
Image-Text-to-Text • Updated • 1.78M • 1.11k -
XiaoduoAILab/Xmodel_VLM
Text Generation • Updated • 64 • 12 -
nvidia/Cosmos-1.0-Diffusion-14B-Text2World
Updated • 105k • 48 -
nvidia/Cosmos-1.0-Autoregressive-12B
Updated • 1.12k • 27 -
nvidia/Cosmos-1.0-Autoregressive-13B-Video2World
Updated • 1.21k • 31 -
nvidia/Cosmos-1.0-Diffusion-7B-Text2World
Updated • 225k • 199 -
nvidia/Cosmos-1.0-Diffusion-14B-Video2World
Updated • 3.3k • 48 -
348
Stable Point-Aware 3D
⚡Create 3D models from images
-
hexgrad/Kokoro-82M
Text-to-Speech • Updated • 172k • 2.83k -
1.9k
Kokoro TTS
❤Upgraded to v1.0!
-
openbmb/MiniCPM-o-2_6
Any-to-Any • Updated • 316k • 922 -
283
TTS Spaces Arena
🤗Blind vote on HF TTS models!
-
google/paligemma2-10b-pt-896
Image-Text-to-Text • Updated • 4.72k • 29 -
NovaSky-AI/Sky-T1-32B-Preview
Text Generation • Updated • 19k • 524 -
MiniMaxAI/MiniMax-VL-01
Image-Text-to-Text • Updated • 2.14k • 229 -
44
SmolVLM
📊Generate descriptions from images and text prompts
-
HKUSTAudio/Llasa-3B
Text-to-Speech • Updated • 7.08k • 415 -
HuggingFaceTB/SmolVLM-500M-Instruct
Image-Text-to-Text • Updated • 14.2k • 96 -
deepseek-ai/Janus-Pro-7B
Any-to-Any • Updated • 223k • 2.66k -
228
Kokoro TTS Zero
🎴✨[With v1.0.0] Accelerated TTS on Kokoro-82M
