sft

Here are 190 public repositories matching this topic...

modelscope / ms-swift

Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.5, DeepSeek-R1, GLM-5, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM4.5v, Llava, Phi4, ...) (AAAI 2025).

moe llama lora embedding liger peft multimodal reranker sft megatron llm internvl deepseek-r1 grpo open-r1 qwen3 llama4 qwen3-vl qwen3-omni qwen3-5

Updated
Python

dataelement / bisheng

Star

BISHENG is an open LLM devops platform for next generation Enterprise AI applications. Powerful and comprehensive features include: GenAI workflow, RAG, Agent, Unified model management, Evaluation, SFT, Dataset Management, Enterprise-level System Management, Observability and more.

react python agent enterprise workflow ocr ai chatbot orchestration openai llama gpt finetune rag sft llm llmops genai langchian llmdevops

Updated
TypeScript

oumi-ai / oumi

Star

Easily fine-tune, evaluate and deploy gpt-oss, Qwen3, DeepSeek-R1, or any open source LLM / VLM!

evaluation inference llama fine-tuning sft dpo slms llms vlms gpt-oss gpt-oss-120b gpt-oss-20b

Updated
Python

adongwanai / AgentGuide

Star

tutorial interview multi-agent job-hunting rag sft ai-agent llm langchain crewai graphrag grpo agenticrag

Updated
HTML

AI-Hypercomputer / maxtext

Star

A simple, performant and scalable Jax LLM!

gpt mistral fine-tuning jax sft large-language-models llm llama2 mixtral deepseek llama3 gemma2 gemma3 llama4

Updated
Python

ssbuild / chatglm_finetuning

Star

chatglm 6b finetuning and alpaca finetuning

deep-learning pytorch freeze lora sft chatglm p-tuning-v2 adalora qlora ia3

Updated
Python

InternScience / GraphGen

Star

GraphGen: Enhancing Supervised Fine-Tuning for LLMs with Knowledge-Driven Synthetic Data Generation

qa knowledge-graph data-generation question-answering data-synthesis sft pretrain pretraining graphgen ai4science llm llm-training qwen xtuner llama-factory sft-data

Updated
Python

ScienceOne-AI / DeepSeek-671B-SFT-Guide

Star

An open-source solution for full parameter fine-tuning of DeepSeek-V3/R1 671B, including complete code and scripts from training to inference, as well as some practical experiences and conclusions. (DeepSeek-V3/R1 满血版 671B 全参数微调的开源解决方案，包含从训练到推理的完整代码和脚本，以及实践中积累一些经验和结论。)

python moe sft llm deepseek-r1

Updated
Python

jerry1993-tech / Cornucopia-LLaMA-Fin-Chinese

Star

聚宝盆(Cornucopia): 中文金融系列开源可商用大模型，并提供一套高效轻量化的垂直领域LLM训练框架(Pretraining、SFT、RLHF、Quantize等)

nlp finance qa transformers text-generation chinese llama sft large-language-models rlhf

Updated
Python

choosewhatulike / trainable-agents

Star

Code and datasets for "Character-LLM: A Trainable Agent for Role-Playing"

agent natural-language-processing character roleplay language-model sft large-language-models llm

Updated
Python

ukairia777 / tensorflow-nlp-tutorial

Star

tensorflow를 사용하여 텍스트 전처리부터, Topic Models, BERT, GPT, LLM과 같은 최신 모델의 다운스트림 태스크들을 정리한 Deep Learning NLP 저장소입니다.

nlp natural-language-processing tensorflow transformers named-entity-recognition question-answering llama lora trainer bert keras-tutorial sft dpo nlp-tutorial huggingface bert-ner llm

Updated
Jupyter Notebook

awesome-rag / awesome-rag

Star

Awesome-RAG: Collect typical RAG papers and systems.

agent awesome opensource ai paper awesome-list mm rag sft llm graphrag

Updated

0xsequence / erc-1155

Star

Ethereum Semi Fungible Standard (ERC-1155)

ethereum nft token-contract sft erc1155 semi-fungible

Updated
TypeScript

Zeyi-Lin / Qwen3-Medical-SFT

Star

Qwen3 Fine-tuning: Medical R1 Style Chat

r1 fine-tuning sft qwen3

Updated
Python

datawhalechina / diy-llm

Star

🎓 系统性大语言模型构建课程｜🛠️ 覆盖预训练数据工程、Tokenizer、Transformer、MoE、GPU 编程 (CUDA/Triton)、分布式训练、Scaling Laws、推理优化及对齐 (SFT/RLHF/GRPO)｜🚀 6 个渐进式作业 + 代码驱动，建立 LLM 全栈认知体系

nlp transformer triton rl gpu-programming sft llm

Updated
Jupyter Notebook

invergent-ai / surogate

Star

Full-Stack Development Platform for Building Reliable Agents

deep-learning cuda llama nvidia-gpu fine-tuning sft llm llms generative-ai qwen

Updated
C++

liangyuwang / zo2

Star

ZO2 (Zeroth-Order Offloading): Full Parameter Fine-Tuning 175B LLMs with 18GB GPU Memory [COLM2025]

offloading llama sft zeroth-order-optimization llms qwen deepseek

Updated
Python

TYH-labs / unsloth-buddy

Star

Zero-friction LLM fine-tuning skill for Claude Code, Gemini CLI & any ACP agent. Unsloth on NVIDIA · TRL+MPS/MLX on Apple Silicon. Automates env setup, LoRA training (SFT, DPO, GRPO, vision), post-hoc GRPO log diagnostics, evaluation, and export end-to-end. Part of the Gaslamp AI platform.

transformer lora fine-tuning sft dpo huggingface apple-silicon rlhf qlora unsloth grpo claude-code gaslamp

Updated
Python

ScottishFold007 / Cosyvoice_DPO_NOTES

Star

CosyVoice_DPO_NOTES: Supercharge Your Cosyvoice model with Cutting-Edge DPO Fine-Tuning!

tts sft dpo cosyvoice

Updated
Python

NiuTrans / Vision-LLM-Alignment

Star

This repository contains the code for SFT, RLHF, and DPO, designed for vision-based LLMs, including the LLaVA models and the LLaMA-3.2-vision models.

vision alignment multi-model reward ppo sft dpo llm rlhf mllm llava llama3-vision

Updated
Python

Improve this page

Add a description, image, and links to the sft topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the sft topic, visit your repo's landing page and select "manage topics."

Learn more

URL: https://github.com/topics/sft

⇱ sft · GitHub Topics · GitHub

sft

Here are 190 public repositories matching this topic...

modelscope / ms-swift

dataelement / bisheng

oumi-ai / oumi

adongwanai / AgentGuide

AI-Hypercomputer / maxtext

ssbuild / chatglm_finetuning

InternScience / GraphGen

ScienceOne-AI / DeepSeek-671B-SFT-Guide

jerry1993-tech / Cornucopia-LLaMA-Fin-Chinese

choosewhatulike / trainable-agents

ukairia777 / tensorflow-nlp-tutorial

awesome-rag / awesome-rag

0xsequence / erc-1155

Zeyi-Lin / Qwen3-Medical-SFT

datawhalechina / diy-llm

invergent-ai / surogate

liangyuwang / zo2

TYH-labs / unsloth-buddy

ScottishFold007 / Cosyvoice_DPO_NOTES

NiuTrans / Vision-LLM-Alignment

Improve this page

Add this topic to your repo