VOOZH about

URL: https://huggingface.co/SupraLabs/Supra-1.5-50M-instruct-exp-gguf/discussions/1

โ‡ฑ SupraLabs/Supra-1.5-50M-instruct-exp-gguf ยท Idea


Idea

#1
by HuggingfacebrosLLM - opened

๐Ÿฆ… Supra-Edge-100M

Tagline: "The smartest model that fits everywhere."

๐ŸŽฏ Goal

A 100M parameter base and instruct model (two variants) optimized for:

๐Ÿ“ฑ Phones (Android)
๐Ÿ“ Raspberry Pi
๐Ÿ’ป Old laptops
๐Ÿ–ฅ๏ธ CPUs without GPUs
๐ŸŒ Offline use
๐Ÿš€ Why this is interesting

The jump from 50M โ†’ 100M is huge for reasoning quality while still being extremely lightweight.

Most people either build:

Tiny meme models (1Mโ€“10M)
Huge models (7B+)

Very few organizations focus on the 100M sweet spot. Combo for training data: 50B FineWeb-Edu tokens
6B Wikipedia tokens
3B The Stack tokens

We are already producing a 124M model.

AxionLab-official changed discussion status to closed

BTW: @HuggingfacebrosLLM stop using AI to impress us. โ˜น๏ธ

ยท Sign up or log in to comment