Skip to content
OSS for Founders
AI & ML

xLLM-AI/xllm

A high-performance inference engine for LLM, VLM, DiT and REC models, optimized for diverse AI accelerators. It is hosted in OpenAtom Foundation.

Stars
1.6k
Forks
330
Language
C++
License
Apache-2.0
Last commit
updated Nov 2026
Active
deepseekinferenceinference-enginellm-inferenceqwenlarge-language-modelsglm

Straight from GitHub

Nobody has written up this repo. Everything on this page comes straight from the GitHub API, so there is no founder write-up, no pros and cons, and no difficulty rating — rather than a generated guess at them.

Maintenance

Pushed within three months of the last stats read (as of Nov 6, 2026).

Licence

Apache-2.0

Tech stack

Primary language: C++. GitHub reports only the dominant language, so this is not the whole stack.

Install

No install command has been verified for this repo. Follow the README rather than a guess.

Quality score

Computed by the discovery import when this entry was added.

0.90out of 1.00
Recent activity×0.30
1.00

How recently the default branch was pushed to.

Adoption×0.20
0.68

Stars on a log scale, so adoption counts without dominating.

Description and topics×0.15
1.00

Whether the repo describes itself: description, topics, homepage.

README present×0.15
1.00

Whether the repository has a README at all.

Licence clarity×0.10
1.00

Whether GitHub can resolve the licence to a recognised SPDX id.

Issue health×0.10
0.60

Open issues relative to adoption, as a rough maintenance signal.

Similar repos

Same category, ranked by shared topics.

  • A native.NET LLM inference engine and agent runtime for GGUF models. TensorSharp provides a console application, a web-based chatbot interface, iPhone App, and Ollama/OpenAI-compatible HTTP APIs for programmatic access. It supports Windows/MacOS/iOS/Linux with full GPU capability

    660 starsC#BSD-3-Clauseupdated Nov 2026AI & ML
  • A programmable system for high-performance model serving

    239 starsRustApache-2.0updated Nov 2026AI & ML
  • Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

    186k starsGoMITupdated Nov 2026AI & ML
  • Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

    168.6k starsPythonApache-2.0updated Nov 2026AI & ML

Stats updated Nov 6, 2026. Stars, forks, issue counts, and dates are a snapshot read from the GitHub REST API, not a live figure. This site makes no requests to GitHub when you load a page.

Command Palette

Search for a command to run...