VOOZH about

URL: https://huggingface.co/HuggingFaceTB/SmolLM2-1.7B/discussions/9

โ‡ฑ HuggingFaceTB/SmolLM2-1.7B ยท Unexpected behavior of models in terms of generation time


Unexpected behavior of models in terms of generation time

#9
by LinkaG - opened

Dear developers, can you tell me why smaller SmolLM models take longer to generate than larger models? I have attached the results of my experiments on different datasets:

๐Ÿ‘ image

ยท Sign up or log in to comment