Skip to content
OSS for Founders
SaaS Development

algorithmicsuperintelligence/optillm

Optimizing inference proxy for LLMs

Stars
4.3k
Forks
399
Language
Python
License
Apache-2.0
Last commit
updated Nov 2026
Active
agentagentic-aiagentic-workflowagentsapi-gatewaygenailarge-language-modelsllm
View on GitHub

Straight from GitHub

Nobody has written up this repo. Everything on this page comes straight from the GitHub API, so there is no founder write-up, no pros and cons, and no difficulty rating — rather than a generated guess at them.

Maintenance

Pushed within three months of the last stats read (as of Nov 6, 2026).

Licence

Apache-2.0

Tech stack

Primary language: Python. GitHub reports only the dominant language, so this is not the whole stack.

Install

No install command has been verified for this repo. Follow the README rather than a guess.

Quality score

Computed by the discovery import when this entry was added.

0.93out of 1.00
Recent activity×0.30
1.00

How recently the default branch was pushed to.

Adoption×0.20
0.77

Stars on a log scale, so adoption counts without dominating.

Description and topics×0.15
0.80

Whether the repo describes itself: description, topics, homepage.

README present×0.15
1.00

Whether the repository has a README at all.

Licence clarity×0.10
1.00

Whether GitHub can resolve the licence to a recognised SPDX id.

Issue health×0.10
1.00

Open issues relative to adoption, as a rough maintenance signal.

Similar repos

Same category, ranked by shared topics.

  • Open-source AI Gateway — Use any SDK to call 100+ LLMs. Built-in failover, load balancing, cost control & end-to-end tracing.

    5.4k starsGoApache-2.0updated Nov 2026AI & ML
  • Enterprise-grade, commercial-friendly agentic workflow platform for building next-generation SuperAgents.

    8.9k starsJavaApache-2.0updated Nov 2026AI & ML
  • An AI Gateway, registry, and proxy that sits in front of any MCP, A2A, or REST/gRPC APIs, exposing a unified endpoint with centralized discovery, guardrails and management. Optimizes Agent & Tool calling, and supports plugins.

    4.8k starsPythonApache-2.0updated Nov 2026SaaS Development
  • 一款简单易用和高性能的AI部署框架 | An Easy-to-Use and High-Performance AI Deployment Framework

    1.9k starsC++Apache-2.0updated Aug 2026SaaS Development

Stats updated Nov 6, 2026. Stars, forks, issue counts, and dates are a snapshot read from the GitHub REST API, not a live figure. This site makes no requests to GitHub when you load a page.

Command Palette

Search for a command to run...