VOOZH about

URL: https://huggingface.co/GAIR/LIMO

โ‡ฑ GAIR/LIMO ยท Hugging Face


YAML Metadata Warning:empty or missing yaml metadata in repo card

Check out the documentation for more information.

LIMO: Less Is More for Reasoning ๐Ÿš€

๐Ÿ“Œ Table of Contents

Overview

LIMO challenges the conventional wisdom in mathematical reasoning by demonstrating that models can achieve superior performance with significantly less but higher quality training data. Our approach:

  • ๐ŸŽฏ Achieves SOTA with only 817 carefully curated training samples
  • ๐ŸŒŸ Shows strong generalization across diverse problem types
  • ๐Ÿ”ฌ Provides comprehensive evaluation on 10 benchmarks
  • ๐Ÿ“š Releases high-quality datasets and evaluation tools

Key Results

Model AIME24 MATH500 Training Samples
LIMO (Ours) 57.1% 94.8% 817
Previous SOTA 6.5% 59.2% 100k+

Model Zoo

Our LIMO model is available on Hugging Face ๐Ÿค—:

Model Backbone Size Link
LIMO Qwen2.5-32B-Instruct 32B ๐Ÿค—

Datasets

We release our datasets through Hugging Face ๐Ÿค—:

Dataset Description Size Link
LIMO Training set used to train LIMO model 817 ๐Ÿค—

Note: We are gradually releasing additional datasets mentioned in our paper, including those used for comparative experiments, to facilitate reproducibility and further analysis by the research community. Stay tuned!

Quick Start

Our model is fine-tuned on Qwen2.5-32B-Instruct and is compatible with most mainstream frameworks like HF Transformers, VLLM, TensorRT-LLM and etc.

License

This project is licensed under the MIT License - see the LICENSE file for details.

Citation

@misc{ye2025limoreasoning,
 title={LIMO: Less is More for Reasoning}, 
 author={Yixin Ye and Zhen Huang and Yang Xiao and Ethan Chern and Shijie Xia and Pengfei Liu},
 year={2025},
 eprint={2502.03387},
 archivePrefix={arXiv},
 primaryClass={cs.CL},
 url={https://arxiv.org/abs/2502.03387}, 
}
Downloads last month
14
Safetensors
Model size
33B params
Tensor type
BF16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for GAIR/LIMO

Quantizations
2 models

Collection including GAIR/LIMO

Paper for GAIR/LIMO