RULER Datasets SmolLM3-11T-32k-v1-remote-code

RULER Datasets

RULER Datasets gemma3-base

RULER Datasets

RULER Datasets Falcon-H1-3B-Base

tokenized with: `tokenizer.tokenize(text, add_special_tokens=False)`

RULER Datasets Qwen2.5-Instruct

msg = [{"role": "user", "content": text}] tokenizer.apply_chat_template(msg, add_special_tokens=True, tokenize=True)

RULER Datasets Qwen-3

tokenized with: `tokenizer.tokenize(text, add_special_tokens=False)`

RULER Datasets gemma3-instruct

RULER Datasets

RULER Datasets Falcon-H1-3B-Instruct

RULER Datasets

RULER Datasets Lamma3-Instruct

msg = [{"role": "user", "content": text}] tokenizer.apply_chat_template(msg, add_special_tokens=True, tokenize=True)

RULER Datasets Qwen-3-Instruct

msg = [{"role": "user", "content": text}] tokenizer.apply_chat_template(msg, add_special_tokens=True, tokenize=True)