GPT-4o Mini, announced today, is very impressive for how cheap it is being offered 👀
With a MMLU score of 82% (reported by TechCrunch), it surpasses the quality of other smaller models including Gemini 1.5 Flash (79%) and Claude 3 Haiku (75%). What is particularly exciting is ffered at a cheaper price than these models. The reported price is $0.15/1M input tokens and $0.6/1M output tokens.
With such a cheap price for input tokens and its large 128k context window, it will be very compelling for long context use-cases (including large document RAG).
@OpenAI have clearly made a very high quality model relative to its size (pricing can indicate size due to the direct relationship to compute cost). The model seems a worthy successor to GPT3.5 Turbo as OpenAI's smallest model and the model used for ChatGPT's free version.
 |
VOOZH | about |
