Ray RLlib
ML library for reinforcement learning. Anyscale supports and further optimizes Ray RLlib for improved performance, reliability, and scale.
What is Ray RLlib?
RLlib is an open-source library for reinforcement learning (RL), offering support for production-level, highly distributed RL workloads while maintaining unified and simple APIs for a large variety of industry applications.
RLlib is used by industry leaders in many different verticals, such as climate control, industrial control, manufacturing and logistics, finance, gaming, automobile, robotics, boat design, and many others.
Benefits
Easy Pythonic API
Get up and running quickly with Ray RLlib’s easy-to-use Pythonic APIs. RLlib provides simple configurations and classes to customize all aspects of your training- and experimental workflows.
Complex, Multi-Agent Use Cases
With RLlib, get support for self play and dynamically add and remove policies as needed. Agents have access to all other agents' information for training shared NN components, but can also function completely independently based on your needs and configurations.
Modular Algorithms
Ray RLlib offers modular algorithms, for model-free and model-based RL, on- and off-policy training, multi-agent RL, offline RL, and more.
Advanced Architectures & Environments
Get started with environments supported by RLlib, such as Farama foundation’s Gymnasium, PettingZoo, and many custom APIs for vectorized and multi-agent environments.
A Library that Scales with Your Needs
RLlib is the most scalable reinforcement learning platform. Scale by adding environment workers, or by training your model on more compute power.
Easy Pythonic API
Get up and running quickly with Ray RLlib’s easy-to-use Pythonic APIs. RLlib provides simple configurations and classes to customize all aspects of your training- and experimental workflows.
Complex, Multi-Agent Use Cases
With RLlib, get support for self play and dynamically add and remove policies as needed. Agents have access to all other agents' information for training shared NN components, but can also function completely independently based on your needs and configurations.
Modular Algorithms
Ray RLlib offers modular algorithms, for model-free and model-based RL, on- and off-policy training, multi-agent RL, offline RL, and more.
Advanced Architectures & Environments
Get started with environments supported by RLlib, such as Farama foundation’s Gymnasium, PettingZoo, and many custom APIs for vectorized and multi-agent environments.
A Library that Scales with Your Needs
RLlib is the most scalable reinforcement learning platform. Scale by adding environment workers, or by training your model on more compute power.
Feature Comparison
Multi-Agent Support
Including Independent, Collaborative, and Adversarial
Stable Baseline3
Multi-Model Support
Including Curiosity, Shared Value Functions, and more
Stable Baseline3
Stable Baseline3 | |||
|---|---|---|---|
Custom Models (PyTorch) | Stable Baseline3 | ||
Vector Environments for Multiprocessing | Stable Baseline3Limited | ||
Scalable Environment Runners | Stable Baseline3Limited | ||
Multi-Node/Multi-GPU Training | Stable Baseline3Limited | – | |
Offline RL and Behavior Cloning | Stable Baseline3– | ||
Multi-Agent SupportIncluding Independent, Collaborative, and Adversarial | Stable Baseline3– | ||
Multi-Model SupportIncluding Curiosity, Shared Value Functions, and more | Stable Baseline3– | ||
Model-Based Reinforcement Learning | Stable Baseline3– | – |
Related Resources
Learn more about why Anyscale Ray RLlib is the leader for reinforcement learning and AI workloads.
Ray RLlib Docs
Explore in-depth documentation on how to get started and use Ray RLlib.
Intro to RL with OpenAI Gym, RLlib, and Google
Read our tutorial to learn everything you need to get up-and-running with reinforcement learning.
Ray RLlib Github Project
Explore the Ray RLlib Github project and join the community.
Comparing Ray OSS and Anyscale
See why Anyscale, built by the creators of Ray, is the best place to run Ray.
Try Anyscale Today
Build, deploy, and manage scalable AI and Python applications on the leading AI platform. Unlock your AI potential with Anyscale.