Sorai

An open-source LLM proxy gateway written in TypeScript, built for resource efficiency and high performance. Sorai sits between applications and model providers, routing and normalizing traffic so teams can swap models without rewriting their AI features.