Skip to content
OSS for Founders
AI & ML

pegainfer-project/pegainfer

Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2

Stars
737
Forks
121
Language
Rust
License
Apache-2.0
Last commit
updated Nov 2026
Active
inferencekimillm-servingmodel-servingcudacuda-kernelsdeepseekgpu

Straight from GitHub

Nobody has written up this repo. Everything on this page comes straight from the GitHub API, so there is no founder write-up, no pros and cons, and no difficulty rating — rather than a generated guess at them.

Maintenance

Pushed within three months of the last stats read (as of Nov 6, 2026).

Licence

Apache-2.0

Tech stack

Primary language: Rust. GitHub reports only the dominant language, so this is not the whole stack.

Install

No install command has been verified for this repo. Follow the README rather than a guess.

Quality score

Computed by the discovery import when this entry was added.

0.88out of 1.00
Recent activity×0.30
1.00

How recently the default branch was pushed to.

Adoption×0.20
0.61

Stars on a log scale, so adoption counts without dominating.

Description and topics×0.15
1.00

Whether the repo describes itself: description, topics, homepage.

README present×0.15
1.00

Whether the repository has a README at all.

Licence clarity×0.10
1.00

Whether GitHub can resolve the licence to a recognised SPDX id.

Issue health×0.10
0.60

Open issues relative to adoption, as a rough maintenance signal.

Similar repos

Same category, ranked by shared topics.

  • High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.

    3k starsPythonApache-2.0updated Nov 2026AI & ML
  • A high-throughput and memory-efficient inference and serving engine for LLMs

    96.5k starsPythonApache-2.0updated Nov 2026AI & ML
  • SGLang is a high-performance serving framework for large language models and multimodal models.

    38.5k starsPythonApache-2.0updated Nov 2026AI & ML
  • A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

    6k starsPythonApache-2.0updated Nov 2026AI & ML

Stats updated Nov 6, 2026. Stars, forks, issue counts, and dates are a snapshot read from the GitHub REST API, not a live figure. This site makes no requests to GitHub when you load a page.

Command Palette

Search for a command to run...