Case Study - Resolving the Riskiest Unknown Before Writing a Line of Product Code

A focused four-day spike that tested whether consumer AirPods could deliver clean, surgeon-isolated audio in a loud operating room — before any engineering was committed to the hands-free capture path it would have to support.

Client
Otto
Year
Service
Technical Risk De-risking

The entire hands-free premise depended on one unproven assumption. We resolved it with a four-day spike, before writing a line of the product code that would have depended on the answer.

Overview

The default assumption going in was a well-known iOS limitation: recording from a Bluetooth headset mic forces a "telephone quality" audio profile. For surgical dictation, that's disqualifying — the acoustic detail that distinguishes drug names and implant identifiers lives in exactly the frequency range that mode strips out. Building the entire capture architecture around an assumption that turned out wrong would have meant weeks of wasted engineering, discovered only after the fact.

The problem

The test that mattered wasn't "is the audio audible" — it was whether specific clinically catastrophic failure modes survived transcription: a mistaken laterality, a garbled implant identifier, a misheard drug name. Those aren't the failures a generic audio-quality test surfaces.

Why it took a physician-engineer

Designing a test protocol scored against exactly those hard cases — rather than generic intelligibility — required knowing, clinically, which mistranscriptions are catastrophic and which are merely annoying, and building the entire spike around that distinction from the outset.

Approach

Before any capture-path code was written, the risks were ranked explicitly — seven identified risks, likelihood and impact, the highest being that the "high-quality" mode's media-tuning would preserve exactly the ambient noise it needed to suppress. A single-screen, throwaway test app captured audio and routed telemetry against a fixed test matrix — device model, iOS version, capture mode, app state, distance, and a sustained run for thermal and session stability — against a realistic OR noise bed, not a quiet room.

A deliberate decision to decouple the hardware ergonomics question entirely from validating the note-generation pipeline meant a "no" on hardware would never block proving out the differentiated part of the product.

Four sequential decision gates were defined up front — stream acquisition, isolation in noise, transcription fitness, endurance — with an explicit rule that a partial pass was acceptable everywhere except transcription fitness on the hard tokens, which was non-negotiable because it was the whole point of the exercise.

Under the hood

The spike exercised the high-quality Bluetooth recording mode, which requires a current-generation earbuds model on a current iOS release, with automatic fallback to standard quality when the high-quality link isn't available. It tested voice isolation against media/wide-spectrum tuning directly, since the two modes behave very differently in noise. The outcome fed directly into the shipped product: a live route-telemetry readout — negotiated port, sample rate, quality mode, channel count — built into the real capture screen, so a silent fallback to narrowband audio is visible immediately as a UI signal rather than discovered later as unexplained poor transcription. On a go decision, the validated capture path was implemented as a native Swift module — on-device wake/stop-word detection, a several-second pre-roll ring buffer so an utterance already underway isn't clipped, and a hold-to-dictate manual fallback for when the sterile field makes voice control impractical.

  • Systematic technical risk de-risking
  • Hands-on iOS/AVFoundation execution
  • Clinical risk prioritization
  • Product sequencing under uncertainty
  • Speed under constraint
From open question to go decision
4–5 days
Risks ranked before any code was written
7
Sequential decision gates
4

Outcome

The spike reached a go decision in roughly four to five focused days, with the exact device/OS constraint and a documented fallback plan already in hand before the production capture module's first line was written — the riskiest, least controllable variable in the product resolved on a known timeline instead of discovered mid-build.

More case studies

A Billing Engine That Refuses to Guess

A pure, auditable, replayable determination engine for CMS Remote Therapeutic Monitoring billing — one that blocks a claim rather than emit an uncertain one.

Read more

Making an LLM Prove Every Claim Before It Reaches a Surgeon

An operative-note generation pipeline where a language model may propose a clinical fact, but a deterministic downstream check — independent of the model — decides whether it ever reaches "populated" status.

Read more

Tell us about your project

Our offices

  • Portland
    220 NW 8th Ave
    97209, Portland, Oregon