kernrl Training Materials

Training resources for the kernrl GPU kernel optimization environment.

Overview

This repository contains:

• GRPO training notebook for training LLMs to write optimized GPU kernels
• Example scripts and configurations

Quick Start

from trl import GRPOConfig, GRPOTrainer
from kernrl import kernrl_env, KernelAction

# Connect to kernrl environment
env = kernrl_env(base_url="http://localhost:8000")

# Train with GRPO
trainer = GRPOTrainer(
 model="Qwen/Qwen2.5-Coder-1.5B-Instruct",
 reward_funcs=[reward_compilation, reward_correctness, reward_speedup],
 train_dataset=dataset,
 rollout_func=rollout_func,
 args=GRPOConfig(use_vllm=True, vllm_mode="colocate"),
)
trainer.train()

Files

• kernrl_grpo_training.ipynb - Complete GRPO training notebook
• train_kernrl.py - Standalone training script

Links

• kernrl Environment
• OpenEnv Repository
• TRL Documentation