Collection of models used in the blog post www.distillabs.ai/blog/the-10x-inference-tax-you-dont-have-to-pay
AI & ML interests
Knowledge Distillation, Self-Alignement
A family of small language models (SLMs) specialized for policy-aware PII redaction that can run locally.
-
distil-labs/Distil-PII-Llama-3.2-1B-Instruct
Text Generation • 1B • Updated • 103 • • 6 -
distil-labs/Distil-PII-SmolLM2-135M-Instruct-gguf
Text Generation • 0.1B • Updated • 17 -
distil-labs/Distil-PII-gemma-3-270m-it-gguf
Text Generation • 0.3B • Updated • 42 • 3 -
distil-labs/Distil-PII-gemma-3-270m-it
Text Generation • 0.3B • Updated • 19 • 2
Collection of models used in the blog post www.distillabs.ai/blog/the-10x-inference-tax-you-dont-have-to-pay
A family of small language models (SLMs) specialized for policy-aware PII redaction that can run locally.
-
distil-labs/Distil-PII-Llama-3.2-1B-Instruct
Text Generation • 1B • Updated • 103 • • 6 -
distil-labs/Distil-PII-SmolLM2-135M-Instruct-gguf
Text Generation • 0.1B • Updated • 17 -
distil-labs/Distil-PII-gemma-3-270m-it-gguf
Text Generation • 0.3B • Updated • 42 • 3 -
distil-labs/Distil-PII-gemma-3-270m-it
Text Generation • 0.3B • Updated • 19 • 2
models 52
distil-labs/distil-lfm25-home-assistant
Text Generation • 0.4B • Updated • 6 • 2
distil-labs/distil-lfm25-voice-assistant
Text Generation • 0.4B • Updated • 4 • 1
distil-labs/distil-lfm25-shellper
Text Generation • 0.4B • Updated • 33.6k • 11
distil-labs/hotpotqa-qwen3-4b
Text Generation • 4B • Updated • 5
distil-labs/banking77-qwen3-06b
Text Generation • 0.6B • Updated • 9
distil-labs/docstring-qwen3-8b
Text Generation • 8B • Updated • 2
distil-labs/trec-qwen3-4b
Text Generation • 4B • Updated • 9
distil-labs/ecommerce-qwen3-4b
Text Generation • 4B • Updated • 3
distil-labs/text2sql-qwen3-4b
Text Generation • 4B • Updated • 7 • • 2
distil-labs/pii-redaction-healthcare-qwen3-4b
Text Generation • 4B • Updated • 8 • 1
datasets 0
None public yet