ML Engineer at Raindrop

Raindrop is the monitoring platform for AI agents. Engineering teams at some of the fastest growing AI companies including Replit, Speak, Clay, and more use Raindrop to get alerts about silent failures with their AI agents. Raindrop sends alerts when AI agents misbehave, so AI engineers can dig into the conversations or traces, understand the root cause, and fix it, fast. AI agents fail constantly in ways both hilarious and terrifying. Regular software throws exceptions. But AI agents fail silently, leaving engineers with almost no visibility into how their agents are actually performing. The current status quo is sifting through millions of logs and trying debug flaky evals that just aren't matching real world results. Evals are like unit tests, they confirm your model got specific test cases right. But in the real world agents call thousands of tools, run for hours, and encounter millions of unpredictable actions. That’s where Raindrop comes in. It learns the unique shape of each AI agent’s issues. Starting from presets like Laziness, Forgetting, or Task Failure, to automatically tuning itself to each agent and discovering unknown unknowns. With one click of a button, AI engineer