VOOZH about

URL: https://huggingface.co/RinKana/AmadeusZero-123M-TinyStories

⇱ RinKana/AmadeusZero-123M-TinyStories · Hugging Face


AmadeusZeroLM

This is trained on 100k slice of karpathy/tinystories-gpt4-clean by one epoch:

Result

Epoch: 0 | Step: 12000 | LR: 0.000001 | Train Loss: 0.3362 | Val Loss: 0.4241 | Val PPL: 1.5282 | Perplexity: 1.3997

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Dataset used to train RinKana/AmadeusZero-123M-TinyStories