No AI summary available for this article.
Why It Matters
Hi HN, we built an open source model gateway.
Provenance
Discovered via Hacker News and published by GitHub.
Key Claims
Original description
Hi HN, we built an open source model gateway. It's a single place to manage our own self hosted, frontier, and open source models in one place. It’s is rust native, built for concurrency, and implements all the config quirks across models and providers (streaming formats, tool calls, model parameters, rate limits, and different error behavior). The gateway adds under 1 ms for BYOK requests and under 2 ms when Experiential supplies the provider key. It has every major inference provider, and 1000+ models refreshed daily via a codex agent that opens a PR. Compared to other similar projects we’re...
Discovered via Hacker News
Community-ranked links and discussion from the HN front page.
Publisher: github.com
ID: 49471407 · Indexed 3 days ago