squeezebits/Llama-3.1-8B-Instruct-FP8-dynamic
8B • Updated
AI & ML interests
SqueezeBits is building an ecosystem for designing, training, and deploying highly compressed Neural Networks.
Recent Activity
View all activity
models 8
squeezebits/Llama-3.1-8B-Instruct-quantized.w4a16
8B • Updated
squeezebits/Llama-3.1-8B-Instruct-quantized.w4a16.per_channel
8B • Updated
squeezebits/kanana-1.5-2.1b-instruct-2505-mlx
Text Generation • 0.4B • Updated • 1
squeezebits/Qwen3-32B-AWQ
33B • Updated • 4
squeezebits/Qwen3-32B-AWQ-G32
33B • Updated • 2
squeezebits/Qwen-32B-FP8-Dynamic
Text Generation • 33B • Updated • 1
squeezebits/dummy_slm
Text Generation • 13.4M • Updated • 5
datasets 6
squeezebits/synthesized-coding-assistant-dataset
Viewer • Updated • 100 • 76
squeezebits/diffusion-benchmark
Viewer • Updated • 5 • 45
squeezebits/2kBookTitiles
Viewer • Updated • 2k • 5
squeezebits/augmented-json-mode-eval
Viewer • Updated • 300 • 6
squeezebits/dynamic_sonnet_llama2
Viewer • Updated • 4.1k • 86
squeezebits/dynamic_sonnet_llama3
Viewer • Updated • 4.1k • 239 • 3