Book a demo Start building

Northwind cut its p95 in half in a week.

Customer
Northwind
Industry
Retail
Requests
41M a month
Team
6 engineers

The problem

Northwind ran product search and support on four providers, each with its own SDK, key and bill. Every outage meant a scramble, and nobody could say what a single customer cost.

What changed.

Week 1

Four providers behind one key. No code changes beyond the endpoint.

Month 1

Routing learned which model answers each kind of search fastest.

Month 3

Replays caught two prompt changes that would have hurt conversion.

Today

One dashboard for cost per customer, latency and quality.

  • 01 Week 1
  • 02 Month 1
  • 03 Month 3
  • 04 Today

How they rolled it out.

Connect

Swap the endpoint, keep the code.

Split

Route search and support differently.

Measure

Watch latency, cost and quality live.

  • 01 Connect
  • 02 Split
  • 03 Measure
“We moved four providers behind one key in a week. Our p95 dropped by half, and the bill finally makes sense.”

Dana Okafor · Head of Platform, Northwind

Ship your first model this afternoon.