Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

4-bit precision

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

19

Full-text search

Active filters: 4-bit precision

cmod/firefunction-v1-GGUF

Updated Feb 25, 2024

RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w4a16

Text Generation • 8B • Updated Sep 22 • 28.2k • 30

Esperanto/gemma-2b-it-kvc-AWQ-int4-onnx

Updated Dec 12, 2024 • 14

Esperanto/gemma-7b-it-kvc-AWQ-int4-onnx

Updated Dec 12, 2024 • 12

Esperanto/mistral-7b-Instruct-v0.2-kvc-AWQ-int4-onnx

Updated Dec 12, 2024 • 16 • 1

Esperanto/phi3-mini-4k-instruct-kvc-AWQ-int4-onnx

Updated Dec 12, 2024 • 15

amornpan/openthaigpt-MedChatModelv11

Text Generation • 8B • Updated Mar 10 • 38 • 2

Esperanto/llama-3.2-3B-Instruct-kvc-AWQ-int4-onnx

Text Generation • Updated Dec 12, 2024 • 22

Esperanto/llama-3.2-1B-Instruct-kvc-AWQ-int4-onnx

Text Generation • Updated Dec 12, 2024 • 4

Esperanto/llama3.1-8b-Instruct-kvc-AWQ-int4-onnx

Text Generation • Updated Dec 12, 2024 • 18

Esperanto/mistral-7b-kvc-AWQ-int4-onnx

Updated Dec 18, 2024 • 6

amornpan/openthaigpt1.5-14b-MedChatModelV1

Text Generation • 15B • Updated Nov 4, 2024 • 12 • 1

RedHatAI/Llama-3.3-70B-Instruct-quantized.w4a16

Text Generation • 11B • Updated Sep 22 • 2.04k • 3

akkikiki/j-moshi-ext-mlx-q4

Updated Feb 12 • 12

ruslanmv/granite-3.1-2b-Reasoning-4bit

Text Generation • 3B • Updated Feb 11 • 8

amornpan/V3_qwen2.5-32b-med-thai-optimized

Text Generation • Updated Mar 14 • 1

korarishi/rishi-2-2b-it

Text Generation • 3B • Updated May 10 • 8 • 1

Aeshp/llama2-7bChatbot

Text Generation • Updated Jun 27 • 8

ZennyKenny/novoyaz-20b

Text Generation • Updated Nov 9 • 23 • 1