Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,542

Full-text search

Active filters: llama.cpp

TeichAI/GLM-4.7-Flash-Claude-Opus-4.5-High-Reasoning-Distill-GGUF

30B • Updated 19 days ago • 90.4k • 457

LiquidAI/LFM2-24B-A2B-GGUF

Text Generation • 24B • Updated 24 days ago • 26.5k • 108

TeichAI/Qwen3.5-27B-Claude-Opus-4.6-Distill-GGUF

27B • Updated 9 days ago • 11.3k • 22

jinaai/jina-embeddings-v5-text-small-text-matching

Sentence Similarity • 0.6B • Updated 11 days ago • 15.8k • 10

LiquidAI/LFM2.5-1.2B-Instruct-GGUF

Text Generation • 1B • Updated Jan 5 • 58.2k • 141

jinaai/jina-embeddings-v5-text-small-retrieval

Sentence Similarity • 0.6B • Updated 11 days ago • 161k • 16

Ex0bit/Qwen3.5-122B-A10B-PRISM-LITE-GGUF

Image-Text-to-Text • 122B • Updated 12 days ago • 3.69k • 11

Ex0bit/Qwen3.5-122B-A10B-PRISM-PRO-GGUF

Image-Text-to-Text • 122B • Updated 11 days ago • 171 • 18

avalon2244/Qwen3.5-4B-Claude-Opus-4.6-Distilled-GGUF

4B • Updated 7 days ago • 3.36k • 9

prithivMLmods/Qwen3-VL-8B-Instruct-abliterated-v2-GGUF

Image-Text-to-Text • 8B • Updated Dec 15, 2025 • 13.2k • 20

LiquidAI/LFM2.5-VL-1.6B-GGUF

Image-Text-to-Text • 1B • Updated 28 days ago • 156k • 67

LiquidAI/LFM2.5-Audio-1.5B-GGUF

1B • Updated Feb 4 • 6.01k • 81

TeichAI/Devstral-Small-2505-Deepseek-V3.2-Speciale-Distill-GGUF

24B • Updated Feb 4 • 1.94k • 7

TeichAI/Qwen3-32B-Kimi-K2-Thinking-Distill-GGUF

33B • Updated Feb 4 • 2.03k • 8

jinaai/jina-embeddings-v5-text-small-clustering

Feature Extraction • 0.6B • Updated 11 days ago • 13.9k • 5

prithivMLmods/Qwen3-VL-4B-Instruct-Unredacted-MAX-GGUF

Image-Text-to-Image • 4B • Updated 26 days ago • 3.03k • 5

sokann/Qwen3.5-27B-GGUF-4.165bpw

27B • Updated 13 days ago • 1.16k • 4

Ex0bit/Qwen3.5-PRISM-Dynamic-Quant-GGUF

Text Generation • 0.8B • Updated 10 days ago • 3.19k • 6

Andycurrent/Mistral-Nemo-2407-12B-Thinking-Claude-Gemini-GPT5.2-Uncensored-HERETIC-GGUF

Text Generation • 12B • Updated 9 days ago • 4.74k • 5

Voodisss/Qwen3-Reranker-0.6B-GGUF-llama_cpp

Text Ranking • 0.6B • Updated 2 days ago • 224 • 2

khazarai/Qwen3-4B-Gemini-3.1-Pro-Reasoning-Distilled

Text Generation • 4B • Updated 1 day ago • 3.33k • 2

google/gemma-2b-it-GGUF

3B • Updated Jun 27, 2024 • 146 • 20

nvjob/Mistral-24B-crack-ru

24B • Updated Feb 28, 2025 • 169 • 2

mistralai/Magistral-Small-2509-GGUF

24B • Updated Sep 18, 2025 • 1.13k • 70

LiquidAI/LFM2-Audio-1.5B-GGUF

0.3B • Updated Dec 5, 2025 • 1.2k • 29

jinaai/jina-reranker-v3-GGUF

Text Ranking • 0.6B • Updated Oct 4, 2025 • 1.31k • 13

LiquidAI/LFM2-VL-3B-GGUF

Image-Text-to-Text • 3B • Updated Dec 5, 2025 • 79.7k • 34

geoffmunn/Qwen3-30B-A3B-Thinking-2507

Text Generation • 31B • Updated Nov 13, 2025 • 207 • 2

LiteMind/YutaLM-GGUF

Text Generation • 0.4B • Updated Dec 28, 2025 • 64 • 2

LiquidAI/LFM2.5-1.2B-JP-GGUF

Text Generation • 1B • Updated Jan 6 • 38.4k • 29