75 7 43

Lane Fiedler

CompactAI

lanefiedler731-gif

AI & ML interests

Hey there! If your reading this, my profile has moved to https://huggingface.co/CompactAI-O

Recent Activity

updated a Space about 1 hour ago

CompactAI-O/Homepage

reacted to Crownelius's post with 🔥 about 1 hour ago

Howdy, CompactAI-O is launching a tiny Model Golf, and the winner walks away with $50 in RunPod credits. Monthly. Every month. Show up, build, somebody wins. What it is Build the best language model you can under 100 million parameters, with at least a 1028-token context window. That's it. Any architecture, any tokenizer, any training scheme you can dream up at 3am. The only catch is it's gotta be open source (MIT, GPL, Apache, AGPL) take your pick. It scratches the same itch as a Kaggle comp without the dataset\leaderboard nonsense. No fixed benchmark to game. No llama.cpp compatibility hoops. If you wanna train a 50M-param MoE with five experts and a tokenizer built on cookbooks, you can do that. Nothing stopping you. The rules are listed in the discord and on the organization page if you're interested. Why $50???? It's symbolic. It ain't gonna make anyone rich. But it's enough to cover a weekend of GPU time, enough to keep enthusiasts coming back, and not so much that it pulls in people who are just there for the money. Enthusiasts build interesting things. Interesting things move the field forward. A little incentive. I'd do it for $50 lol. How to join First round opens soon. Landing page is here: → https://huggingface.co/spaces/CompactAI-O/Tiny-model-golf For questions or to swap ideas, the Discord's open: → https://discord.gg/y2jTct6Cxv Excited to see what yall come up with. ♥ — Shane

updated a collection about 16 hours ago

TrueACT

View all activity

Organizations

updated a Space about 1 hour ago

Built With Curiosity Not Compute

🐠

Chat with TinyMemoryLM, a lightweight AI assistant

reacted to Crownelius's post with 🔥 about 1 hour ago

Post

1403

Howdy,
CompactAI-O is launching a tiny Model Golf, and the winner walks away with $50 in RunPod credits. Monthly. Every month. Show up, build, somebody wins.

What it is

Build the best language model you can under 100 million parameters, with at least a 1028-token context window. That's it. Any architecture, any tokenizer, any training scheme you can dream up at 3am. The only catch is it's gotta be open source (MIT, GPL, Apache, AGPL) take your pick.

It scratches the same itch as a Kaggle comp without the dataset\leaderboard nonsense. No fixed benchmark to game. No llama.cpp compatibility hoops. If you wanna train a 50M-param MoE with five experts and a tokenizer built on cookbooks, you can do that. Nothing stopping you.

The rules are listed in the discord and on the organization page if you're interested.

Why $50????

It's symbolic. It ain't gonna make anyone rich. But it's enough to cover a weekend of GPU time, enough to keep enthusiasts coming back, and not so much that it pulls in people who are just there for the money. Enthusiasts build interesting things. Interesting things move the field forward. A little incentive. I'd do it for $50 lol.

How to join

First round opens soon. Landing page is here:

→ CompactAI-O/Tiny-model-golf

For questions or to swap ideas, the Discord's open:

→ https://discord.gg/y2jTct6Cxv

Excited to see what yall come up with. ♥

— Shane