Gemstones 💎: A Model Suite for Multi-Faceted Scaling Laws

university

https://mcleish7.github.io/gemstone-scaling-laws/

AI & ML interests

None defined yet.

Organization Card

Community About org cards

Gemstones: A Model Suite for Multi-Faceted Scaling Laws [NeurIPS 2025]

A joint project by: Sean McLeish, John Kirchenbauer, David Yu Miller, Siddharth Singh, Abhinav Bhatele, Micah Goldblum, Ashwinee Panda and Tom Goldstein.

Link to full model collection

models 22

Gemstone-Models/Gemstone-512x16

Text Generation • 0.1B • Updated Feb 9, 2025 • 9

Gemstone-Models/Gemstone-3072x12

Text Generation • 2B • Updated Feb 9, 2025 • 37

Gemstone-Models/Gemstone-768x45

Text Generation • 0.5B • Updated Feb 9, 2025 • 11

Gemstone-Models/Gemstone-256x27

Text Generation • 52.3M • Updated Feb 9, 2025 • 10

Gemstone-Models/Gemstone-2560x8

Text Generation • 1B • Updated Feb 7, 2025 • 57 • 1

Gemstone-Models/Gemstone-2048x27

Text Generation • 2B • Updated Feb 7, 2025 • 4

Gemstone-Models/Gemstone-1536x50

Text Generation • 2B • Updated Feb 7, 2025 • 46

Gemstone-Models/Gemstone-256x23

Text Generation • 48.4M • Updated Feb 7, 2025 • 159

Gemstone-Models/Gemstone-512x14

Text Generation • 0.1B • Updated Feb 7, 2025 • 7

Gemstone-Models/Gemstone-384x13

Text Generation • 66.8M • Updated Feb 7, 2025 • 6

datasets 0

None public yet