GitHub - tensorzero/tensorzero: TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.
Summary
TensorZero introduces an open-source LLMOps platform that combines a gateway, observability, evaluation, optimization, and experimentation in one stack. The platform supports major LLM providers and OpenAI-compatible clients, and it is designed for low latency, high throughput, and self-hosted deployment. The article also highlights TensorZero Autopilot, a paid add-on that automates prompt optimization, eval setup, and A/B testing. The company positions the product for production LLM applications and says it already serves teams from startups to large enterprises.
Classifications
industries
No industries detected
applications
Accounting and Taxes
AskAI Classifications
Labels
Open Source Software
MLOps Platforms
Developer Tools
Linked Companies
TensorZero
up to $1M