MiniLLM/MiniLLM-gpt2-340M
Text Generation • Updated • 895 • 6
AI & ML interests
Training efficient language models (MiniLLM, MiniPLM)
MiniLLM/SFT-gpt2-120M
Text Generation • 0.1B • Updated • 950
MiniLLM/SFT-gpt2-760M
Text Generation • 0.8B • Updated • 13
MiniLLM/MiniPLM-Qwen-500M
Text Generation • 0.5B • Updated • 67 • • 7
MiniLLM/MiniPLM-llama3.1-212M
Text Generation • 0.2B • Updated • 12 • 6
MiniLLM/MiniPLM-Mamba-130M
Text Generation • 0.1B • Updated • 13 • 3
MiniLLM/MiniPLM-Qwen-1.2B
Text Generation • 1B • Updated • 62 • 4
MiniLLM/Ref-Pretrain-Qwen-104M
Text Generation • 0.1B • Updated • 10 • 2
MiniLLM/Pretrain-Qwen-1.2B
Text Generation • 1B • Updated • 5
MiniLLM/Pretrain-Qwen-500M
Text Generation • 0.5B • Updated • 13
MiniLLM/Pretrain-Qwen-200M
Text Generation • 0.2B • Updated • 32
MiniLLM/VanillaKD-Pretrain-Qwen-200M
Text Generation • 0.2B • Updated • 7
MiniLLM/VanillaKD-Pretrain-Qwen-500M
Text Generation • 0.5B • Updated • 13 •
MiniLLM/VanillaKD-Pretrain-Qwen-1.2B
Text Generation • 1B • Updated • 3
MiniLLM/init-gpt2-120M
Text Generation • 0.1B • Updated • 880 • 1
MiniLLM/teacher-Llama-13B
Text Generation • Updated • 1
MiniLLM/MiniLLM-Llama-7B
Text Generation • Updated • 9 • 3
MiniLLM/MiniPLM-Qwen-200M
Text Generation • 0.2B • Updated • 476 • 9
MiniLLM/init-Llama-7B
Text Generation • Updated • 6
MiniLLM/teacher-OPT-13B
Text Generation • Updated • 7
MiniLLM/SeqKD-Llama-7B
Text Generation • Updated • 1
MiniLLM/KD-Llama-7B
Text Generation • Updated • 1
MiniLLM/SFT-Llama-7B
Text Generation • Updated • 6
MiniLLM/init-OPT-6.7B
Text Generation • Updated • 9
MiniLLM/init-OPT-2.7B
Text Generation • Updated • 4
MiniLLM/init-OPT-1.3B
Text Generation • Updated • 7
MiniLLM/SeqKD-OPT-6.7B
Text Generation • Updated • 5
MiniLLM/SeqKD-OPT-2.7B
Text Generation • Updated • 1
MiniLLM/SeqKD-OPT-1.3B
Text Generation • Updated • 2
MiniLLM/KD-OPT-6.7B
Text Generation • Updated • 6