VOOZH about

URL: https://huggingface.co/dungnvt/Tini1.5-8B-A1B

โ‡ฑ dungnvt/Tini1.5-8B-A1B ยท Hugging Face


Tini1.5-8B-A1B

๐Ÿ‘ Tini1.5-8B-A1B Logo

Tini1.5-8B-A1B is a production-grade fine-tuned version of the hybrid model architecture LiquidAI/LFM2.5-8B-A1B. This model is highly optimized for English Agentic Reasoning, seamlessly combining deep multi-turn Chain-of-Thought (CoT) and strict policy-compliant native system function calling capabilities.


๐Ÿ“Š Dataset Mixture

The model was Supervised Fine-Tuned (SFT) on a symmetric data matrix balancing deep reasoning tracks and advanced tool execution trajectories:

Dataset Category
nvidia/Nemotron-SFT-Agentic-v2 Tool Use / Multi-step Agentic Policy
Jackrong/DeepSeek-V4-Distill-8000x Pure Reasoning / Math / Code
nohurry/Opus-4.6-Reasoning-3000x-filtered Advanced CoT Reasoning
Jackrong/Qwen3.5-reasoning-700x Hard Logic & Complex Math

๐Ÿ› ๏ธ Training Techniques

To preserve the model's core architecture while focusing gradient updates entirely on structured agent workflows, the following configurations were applied: Train on Response Only


๐Ÿƒโ€โ™‚๏ธ Quick Start & Inference Parameters Guide

๐Ÿ’ก Recommended Decoding Parameters

  • Agentic & Function-Calling Tasks: temperature: 0.1 | top_p: 0.95 | top_k: 50 | repetition_penalty: 1.00

  • General Coding & Contextual Reasoning Tasks: temperature: 0.35 | top_p: 0.90 | top_k: 40 | repetition_penalty: 1.05

๐Ÿš€ Python Example Script

import torch
from unsloth import FastLanguageModel
from transformers import TextStreamer

MODEL_PATH = "iselabvn/Tini1.5-8B-A1B"

# 1. Load model with 4-bit quantization and essential regex patches
model, tokenizer = FastLanguageModel.from_pretrained(
 model_name = MODEL_PATH,
 max_seq_length = 8192,
 dtype = torch.bfloat16,
 load_in_4bit = True,
 trust_remote_code = True,
 fix_mistral_regex = True
)
FastLanguageModel.for_inference(model)

# 2. Configure system prompt aligned with strict v1.5 validation guardrails
messages = [
 {
 "role": "system", 
 "content": "You are an advanced, high-efficiency executive Agent. If a tool requires a parameter that is missing from the prompt, DO NOT analyze or debate the schema. Stop thinking immediately and output a clear question asking the user for that parameter."
 },
 {
 "role": "user", 
 "content": "What is the current stock price of Nvidia (NVDA) today?"
 }
]

inputs = tokenizer.apply_chat_template(messages, tokenize=True, add_generation_prompt=True, return_tensors="pt").to("cuda")
text_streamer = TextStreamer(tokenizer, skip_prompt=True)

# 3. Generate structured output within a safe tokens boundary
with torch.no_grad():
 _ = model.generate(
 input_ids = inputs,
 streamer = text_streamer,
 max_new_tokens = 2048,
 use_cache = True,
 temperature = 0.1,
 top_p = 0.95,
 top_k = 50,
 repetition_penalty = 1.00
 )
Downloads last month
20
Safetensors
Model size
8B params
Tensor type
F32
ยท
BF16
ยท

Model tree for dungnvt/Tini1.5-8B-A1B

Finetuned
(25)
this model
Quantizations
2 models

Datasets used to train dungnvt/Tini1.5-8B-A1B