Inference Optimization

community

AI & ML interests

None defined yet.

Recent Activity

ChibuUkachi updated a model about 3 hours ago

inference-optimization/Ministral-3-14B-Instruct-2512-NVFP4

MeganEFlynn updated a model 1 day ago

inference-optimization/Gemma4-DFlash-SWA-Causal-Nemo-Cascade

MeganEFlynn published a model 1 day ago

inference-optimization/Gemma4-DFlash-SWA-Causal-Nemo-Cascade

View all activity

inference-optimization 's models 355

inference-optimization/ctest-Qwen3-8B-speculator.dflash

2B • Updated 21 days ago • 105

inference-optimization/DeepSeek-V4-Flash-bf16-NVFP4-FP8-BLOCK

Updated 27 days ago

inference-optimization/DeepSeek-V4-Flash-bf16

Updated 28 days ago

inference-optimization/DeepSeek-V4-Flash-5layers-nvfp4moe

20B • Updated 28 days ago • 16

inference-optimization/DeepSeek-V4-Flash-bf16-dequantized-5layers

Updated 29 days ago • 17

inference-optimization/Qwen3-30B-A3B-Instruct-2507-7-bits-mode-noise-per-tensor

26B • Updated Apr 23 • 30

inference-optimization/Qwen3-30B-A3B-Instruct-2507-7-bits-mode-hybrid-per-tensor

27B • Updated Apr 23 • 30

inference-optimization/Qwen3-30B-A3B-Instruct-2507-7-bits-mode-heuristic-per-tensor

27B • Updated Apr 23 • 27

inference-optimization/Qwen3-30B-A3B-Instruct-2507-6.5-bits-mode-noise-per-tensor

25B • Updated Apr 23 • 28

inference-optimization/Qwen3-30B-A3B-Instruct-2507-6.5-bits-mode-hybrid-per-tensor

25B • Updated Apr 23 • 27

inference-optimization/Qwen3-30B-A3B-Instruct-2507-6.5-bits-mode-heuristic-per-tensor

25B • Updated Apr 23 • 30

inference-optimization/Qwen3-30B-A3B-Instruct-2507-6-bits-mode-noise-per-tensor

23B • Updated Apr 23 • 29

inference-optimization/Qwen3-30B-A3B-Instruct-2507-6-bits-mode-hybrid-per-tensor

23B • Updated Apr 23 • 30

inference-optimization/Qwen3-30B-A3B-Instruct-2507-6-bits-mode-heuristic-per-tensor

23B • Updated Apr 23 • 28

inference-optimization/Qwen3-30B-A3B-Instruct-2507-5.5-bits-mode-noise-per-tensor

21B • Updated Apr 23 • 31

inference-optimization/Qwen3-30B-A3B-Instruct-2507-5.5-bits-mode-hybrid-per-tensor

21B • Updated Apr 23 • 27

inference-optimization/Qwen3-30B-A3B-Instruct-2507-5.5-bits-mode-heuristic-per-tensor

21B • Updated Apr 23 • 29

inference-optimization/Qwen3-30B-A3B-Instruct-2507-5-bits-mode-noise-per-tensor

19B • Updated Apr 23 • 28

inference-optimization/Qwen3-30B-A3B-Instruct-2507-5-bits-mode-hybrid-per-tensor

19B • Updated Apr 23 • 28

inference-optimization/Qwen3-30B-A3B-Instruct-2507-5-bits-mode-heuristic-per-tensor

19B • Updated Apr 23 • 38

inference-optimization/Qwen3.6-35B-A3B-NVFP4

Updated Apr 23 • 9

inference-optimization/Qwen3-30B-A3B-7-bits-mode-noise-per-tensor

27B • Updated Apr 22 • 28

inference-optimization/Qwen3-30B-A3B-7-bits-mode-hybrid-per-tensor

27B • Updated Apr 22 • 29

inference-optimization/Qwen3-30B-A3B-7-bits-mode-heuristic-per-tensor

27B • Updated Apr 22 • 43

inference-optimization/Qwen3-30B-A3B-6.5-bits-mode-noise-per-tensor

25B • Updated Apr 22 • 32

inference-optimization/Qwen3-30B-A3B-6.5-bits-mode-hybrid-per-tensor

25B • Updated Apr 22 • 29

inference-optimization/Qwen3-30B-A3B-6.5-bits-mode-heuristic-per-tensor

25B • Updated Apr 22 • 29

inference-optimization/Qwen3-30B-A3B-6-bits-mode-noise-per-tensor

23B • Updated Apr 22 • 29

inference-optimization/Qwen3-30B-A3B-6-bits-mode-hybrid-per-tensor

23B • Updated Apr 22 • 30

inference-optimization/Qwen3-30B-A3B-6-bits-mode-heuristic-per-tensor

23B • Updated Apr 22 • 48