Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
Edit Models filters
Main
Tasks
Libraries
Languages
Licenses
Other
1
Apps
llama.cpp
LM Studio
Jan
Backyard AI
Draw Things
DiffusionBee
Jellybox
RecurseChat
Msty
Sanctum
JoyFusion
LocalAI
vLLM
node-llama-cpp
Ollama
TGI
MLX LM
Docker Model Runner
Lemonade
Inference Providers
Select all
Groq
Novita
Nebius AI
Cerebras
SambaNova
Nscale
fal
Hyperbolic
Together AI
Fireworks
Featherless AI
Zai
Replicate
Cohere
Scaleway
Public AI
OVHcloud AI Endpoints
HF Inference API
WaveSpeed
Misc
Reset Misc
bitsandbytes
Inference Endpoints
text-generation-inference
Eval Results
Merge
4-bit precision
custom_code
8-bit precision
text-embeddings-inference
Mixture of Experts
Carbon Emissions
Apply filters
Models
40,545
Full-text search
Inference Available
Edit filters
Sort: Trending
Active filters:
bitsandbytes
Clear all
PLOI-Labs/lh-degen-001
Updated
2 days ago
•
67
•
3
Undi95/Mistral-7B-roleplay_alpaca-lora
Text Generation
•
Updated
Sep 28, 2023
•
43
•
9
unsloth/mistral-7b-instruct-v0.2-bnb-4bit
Text Generation
•
7B
•
Updated
Nov 22, 2024
•
10.9k
•
34
unsloth/mistral-7b-instruct-v0.1-bnb-4bit
Text Generation
•
7B
•
Updated
Sep 11, 2024
•
536
•
7
unsloth/Phi-3-mini-4k-instruct-bnb-4bit
Text Generation
•
4B
•
Updated
Sep 3, 2024
•
37.3k
•
39
unsloth/Qwen2.5-Coder-7B-bnb-4bit
Text Generation
•
8B
•
Updated
Nov 12, 2024
•
14.9k
•
13
unsloth/Qwen2.5-Coder-7B-Instruct-bnb-4bit
Text Generation
•
4B
•
Updated
Nov 12, 2024
•
98k
•
8
unsloth/llava-1.5-7b-hf-bnb-4bit
Image-Text-to-Text
•
4B
•
Updated
Feb 13
•
194k
•
5
da-fr/Mistral-NeMo-Minitron-8B-ARChitects-Full-bnb-4bit
8B
•
Updated
Dec 3, 2024
•
18
•
7
unsloth/Llama-3.1-8B-unsloth-bnb-4bit
Text Generation
•
5B
•
Updated
Feb 15
•
5.71k
•
5
RichardErkhov/MrezaPRZ_-_CodeLlama-7B-postgres-expert-4bits
7B
•
Updated
Feb 26
•
16
•
1
secemp9/TraceBack-12b
Text Generation
•
7B
•
Updated
Mar 14
•
62
•
32
RichardErkhov/zjj815_-_Qwen1.5-4B-Chinese-toxic-content-detection-4bits
4B
•
Updated
Apr 6
•
31
•
1
unsloth/Qwen3-14B-unsloth-bnb-4bit
Text Generation
•
15B
•
Updated
May 13
•
48.6k
•
10
unsloth/Qwen3-1.7B-unsloth-bnb-4bit
Text Generation
•
2B
•
Updated
May 13
•
47.8k
•
10
wolfofbackstreet/Qwen2.5-Omni-3B-4Bit
6B
•
Updated
May 1
•
14
•
4
OrionCAF/qwen2_5_turkish_vlm
5B
•
Updated
Jun 2
•
28
•
4
unsloth/gpt-oss-20b-unsloth-bnb-4bit
Text Generation
•
21B
•
Updated
Aug 8
•
202k
•
36
unsloth/gemma-3-270m-it-unsloth-bnb-4bit
Text Generation
•
0.3B
•
Updated
Aug 14
•
20.5k
•
5
Dhruvil03/Perception-LM-1B-Int4bit
Image-Text-to-Text
•
2B
•
Updated
12 days ago
•
57
•
1
unsloth/Qwen3-VL-8B-Instruct-unsloth-bnb-4bit
Image-Text-to-Text
•
9B
•
Updated
Oct 31
•
86.8k
•
13
JasmineBBB/Kimi-Linear-48B-A3B-Instruct-bnb-4bit
Text Generation
•
49B
•
Updated
Nov 5
•
81
•
1
unsloth/Ministral-3-8B-Base-2512-bnb-4bit
9B
•
Updated
11 days ago
•
50
•
1
aphoticshaman/qwen-72b-math-nf4
Text Generation
•
73B
•
Updated
7 days ago
•
29
•
1
unsloth/Ministral-3-3B-Instruct-2512-unsloth-bnb-4bit
4B
•
Updated
7 days ago
•
284
•
1
unsloth/Ministral-3-8B-Instruct-2512-unsloth-bnb-4bit
9B
•
Updated
7 days ago
•
181
•
1
unsloth/Ministral-3-14B-Instruct-2512-bnb-4bit
14B
•
Updated
7 days ago
•
320
•
1
aphoticshaman/deepseek-coder-v2-lite-nf4
Text Generation
•
16B
•
Updated
7 days ago
•
10
•
1
ikarius/Qwen3_8B_NoThink-NF4
Text Generation
•
8B
•
Updated
3 days ago
•
27
•
1
pankajmathur/Ministral-8B-Instruct-2410-sft-adapters
Text Generation
•
Updated
1 day ago
•
12
•
1
Previous
1
2
3
...
100
Next