VOOZH about

URL: https://github.com/xorbitsai

⇱ Xorbits Β· GitHub


Skip to content

XorbitsAI

XorbitsAI builds production-ready infrastructure for Model Inference and AI Agents.

We focus on scalable model serving, agent orchestration, and intelligent system deployment β€” enabling teams to move from models to real-world AI systems.

Core Projects

πŸ‘ Image
πŸ‘ Slack
πŸ‘ Twitter

  • xinference: a powerful and versatile library designed to serve language, speech recognition, and multimodal models.
  • xagent: AI agents for everyone. Production-ready platform with dynamic planning and autonomous tool orchestration.
  • xoscar: Python actor framework for heterogeneous computing.

Our Focus

We are building the next generation of AI infrastructure:

  • πŸ”Ή Scalable model inference
  • πŸ”Ή Agent orchestration & dynamic planning
  • πŸ”Ή Enterprise-ready deployment
  • πŸ”Ή Private & on-prem AI systems

From inference to intelligent agents β€” we help teams build real AI systems, not just demos.

Pinned Loading

  1. inference Public

    Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop β€” all through one unified, production-re…

    Python 9.2k 813

  2. xagent Public

    A production-ready platform for dynamic AI agents β€” plan, use tools, and complete real work without hardcoded workflows.

    Python 207 27

  3. xllamacpp Public

    Forked from shakfu/cyllama

    xllamacpp - a Python wrapper of llama.cpp

    C++ 78 12

  4. xoscar Public

    Python actor framework for heterogeneous computing.

    Python 169 29

Repositories

Showing 10 of 18 repositories

People

This organization has no public members. You must be a member to see who’s a part of this organization.

You can’t perform that action at this time.