Tiiny-AI/PowerInfer
High-speed Large Language Model Serving for Local Deployment
- Stars
- 9.9k
- Forks
- 616
- Language
- C++
- License
- MIT
- Last commit
- updated May 2026
Straight from GitHub
Nobody has written up this repo. Everything on this page comes straight from the GitHub API, so there is no founder write-up, no pros and cons, and no difficulty rating — rather than a generated guess at them.
Maintenance
Last push was 179 days before the stats read (as of Nov 6, 2026).
Licence
MIT
Tech stack
Primary language: C++. GitHub reports only the dominant language, so this is not the whole stack.
Install
No install command has been verified for this repo. Follow the README rather than a guess.
Quality score
Computed by the discovery import when this entry was added.
- Recent activity×0.30
- 0.70
How recently the default branch was pushed to.
- Adoption×0.20
- 0.85
Stars on a log scale, so adoption counts without dominating.
- Description and topics×0.15
- 0.80
Whether the repo describes itself: description, topics, homepage.
- README present×0.15
- 1.00
Whether the repository has a README at all.
- Licence clarity×0.10
- 1.00
Whether GitHub can resolve the licence to a recognised SPDX id.
- Issue health×0.10
- 1.00
Open issues relative to adoption, as a rough maintenance signal.
Similar repos
Same category, ranked by shared topics.
中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)
18.9k starsPythonApache-2.0updated Apr 2026AI & MLLMDeploy is a toolkit for compressing, deploying, and serving LLMs.
8.1k starsPythonApache-2.0updated Nov 2026AI & ML中文LLaMA-2 & Alpaca-2大模型二期项目 + 64K超长上下文模型 (Chinese LLaMA-2 & Alpaca-2 LLMs with 64K long context models)
7.1k starsPythonApache-2.0updated Apr 2026AI & MLLemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk
6.1k starsC++Apache-2.0updated Nov 2026AI & ML
Stats updated Nov 6, 2026. Stars, forks, issue counts, and dates are a snapshot read from the GitHub REST API, not a live figure. This site makes no requests to GitHub when you load a page.