BricksAI: Streamlining LLM application management for enterprises
Summary
Do you want to set a custom rate/spend-limit for each project/user?Create a free account and try us out today \U0001f604Hey everyone, this is @Spike Lu and @Donovan So! Were excited to share that weve launched BricksAI Cloud.A lot of enterprise features are still missing from todays LLM providers, particularly: there isnt a good way of controlling LLM spendings in a granular way (e.g. per user/project/env/feature etc.) there isnt a good way of monitoring LLMs in a granular wayBut building an LLM wrapper in-house takes away valuable engineering time from shipping features that actually drive business value.BricksAI Cloud is an open-core SaaS solution that protects and monitors your LLM usage. Were a proxy, so instead of using API keys from your providers, youd create and use Bricks API keys that come with custom limits (e.g. expiry date, rate-limit, or spend-limit).We currently have official support OpenAI and Anthropic, meaning youll be able to accurately track your token usage and cost without any configuration. We also support integrations with custom models.Over the past few months, we have streamlined LLM operations for a wide range of clients, including a late-stage sustainability tech startup, a major leadership training nonprofit, a top European travel agency, and multiple AI startups.Now, were opening up our tool to the world with the launch of BricksAI Cloud.