Skip to content
Branemind
All insights
What's newProduct··3 min read

BM Watch is generally available

Trace every step, eval continuously, cap the cost. The observability layer we had been running internally is now available to every customer.

Traces
Step-level
Evals
Continuous
offline + online

Measured against a baseline captured before the work started. One engagement, not a forecast for another business. See the methodology note below.

BM Watch started as internal tooling. We built it because we could not debug our own agents without it, and every customer who saw it asked whether they could have it. It is now generally available.

  • Step-level traces across tool calls, retrievals, model versions, latencies and cost.
  • Offline eval suites on every prompt change, plus online evals on sampled live traffic.
  • Drift and regression alerts wired to the metric you actually care about, not just token counts.
  • Replay: re-run any historical decision exactly as it was made.

It works with agents we built and agents you built. If it speaks OpenTelemetry, BM Watch can read it.

Methodology and privacy

  • Clients are described rather than named. Where a quote appears it is attributed to a role and published with approval.
  • Figures come from a single engagement and are not a forecast of what a different business would see. Volume, data quality and process maturity move them more than the technology does.
  • Baselines were captured before the work started. The measurement window and sample for any figure on this page are available on request.
  • Where a number is illustrative rather than measured, it is labelled as such in the text.
Strategy call

Bring us the loop you can't get to ship. We'll show you how it goes live.

30 minutes. No deck. We map the loop, the data, and the path to production, and tell you honestly if AI is the wrong answer.