MoE models quantized with the APEX Quantization technique ( https://github.com/mudler/apex-quant )
mudler PRO
mudler
AI & ML interests
APEX quants, LocalAI Creator ( https://localai.io )
Website: https://mudler.pm, llama.cpp fan
Recent Activity
updated a model about 16 hours ago
LocalAI-io/whisper-large-v3-turbo-it-yodas-only-ggml updated a model about 16 hours ago
LocalAI-io/whisper-large-v3-turbo-it-yodas-only-ct2-int8 updated a model about 16 hours ago
LocalAI-io/whisper-large-v3-turbo-it-yodas-onlyOrganizations
Fine-tuned models for LocalAI finetuned by me
-
LocalAI-io/LocalAI-functioncall-phi-4-v0.3
Text Generation • Updated • 9 • 8 -
LocalAI-io/LocalAI-functioncall-llama3.2-1b-v0.4
Text Generation • 1B • Updated • 9 • -
LocalAI-io/Mirai-Nova-Llama3-LocalAI-8B-v0.1
Text Generation • 8B • Updated • 4 • 1 -
LocalAI-io/LocalAI-Llama3-8b-Function-Call-v0.2
Text Generation • 8B • Updated • 5 • 10
MoE models quantized with the APEX Quantization technique ( https://github.com/mudler/apex-quant )
Fine-tuned models for LocalAI finetuned by me
-
LocalAI-io/LocalAI-functioncall-phi-4-v0.3
Text Generation • Updated • 9 • 8 -
LocalAI-io/LocalAI-functioncall-llama3.2-1b-v0.4
Text Generation • 1B • Updated • 9 • -
LocalAI-io/Mirai-Nova-Llama3-LocalAI-8B-v0.1
Text Generation • 8B • Updated • 4 • 1 -
LocalAI-io/LocalAI-Llama3-8b-Function-Call-v0.2
Text Generation • 8B • Updated • 5 • 10
models 60
mudler/Carnice-Qwen3.6-MoE-35B-A3B-APEX-MTP-GGUF
36B • Updated • 17.3k • 8
mudler/Qwen3.6-35B-A3B-Claude-4.6-Opus-Reasoning-Distilled-APEX-MTP-GGUF
36B • Updated • 11.2k • 2
mudler/Qwopus3.6-35B-A3B-v1-APEX-MTP-GGUF
36B • Updated • 17.2k • 13
mudler/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled-APEX-MTP-GGUF
36B • Updated • 23.4k • 19
mudler/Qwen3.6-35B-A3B-APEX-MTP-GGUF
36B • Updated • 34.3k • 40
mudler/Darwin-36B-Opus-APEX-GGUF
35B • Updated • 8.18k • 19
mudler/Qwopus3.6-35B-A3B-v1-APEX-GGUF
35B • Updated • 7.75k • 18
mudler/gemma-4-26B-A4B-it-APEX-GGUF
25B • Updated • 89.4k • 72
mudler/Qwen3.5-35B-A3B-Uncensored-FernflowerAI-APEX-GGUF
35B • Updated • 7.14k
mudler/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-APEX-GGUF
32B • Updated • 5.94k • 7