Launch HN: Respan (YC W24) – Open-source Rust AI gateway built around plugins
Respan is an open-source Rust AI gateway that decouples providers, protocols, modalities, and features into plugins, allowing developers to build their own features without modifying the core. The gateway is built on LiteLLM and has a small core responsible for dispatching events, with a shared structure for parsing requests and preserving provider-specific fields. Respan is open-source under the MIT or Apache-2.0 license and can be run on a local machine, with a hosted platform available for a fee.
Read the full article at news.ycombinator.com →