Reach out

Résumé

Modus V: Neurosurgical Robotic Microscope UX

Modus V: Neurosurgical Robotic Microscope UX

Multi-Modal UX Design: Touchscreen UI, Surgical Voice Control & 10-ft UI

Multi-Modal UX Design: Touchscreen UI, Surgical Voice Control & 10-ft UI

Project role

UX Lead @ Synpative Medical

Target users

Neurosurgeons,

Nurses & support staff

Methods

UX & UI Design
Visual Design
User Testing

Subject matter

Brain & spinal surgery, medical devices

Timeframe

2017 - 2019

Background

In the OR, attention is scarce and hands are often busy. The early Modus experience asked surgeons to split focus across a touchscreen, pedals, and on-screen overlays—while coordinating with scrub nurses and maintaining situational awareness. Through OR shadowing and dry-runs we saw that small UI inconsistencies and ambiguous states could cost precious seconds and trust. The overlay needed to be legible from several feet away, the operator console had to make the next action obvious, and common tasks (focus/zoom/light, alignment, presets) had to be reachable without leaving the field.


What we were solving


  • Reduce context switching between screen, scope, and scrub nurses

  • Make system state (mode, alignment, recording) unmissable at 10-ft via surgical overlay

  • Support hands-busy workflows with reliable voice and large-target touch

  • Ensure traceability and safety for regulated environments

Co-creation and pain point mapping from previous report version to inform redesign efforts
Co-creation and pain point mapping from previous report version to inform redesign efforts

Users & context of use

Targeted A/B user testing with different concepts to hone in on the final design
Targeted A/B user testing with different concepts to hone in on the final design

Modus V in use in an OR

Approach

We treated the redesign as an interaction-model problem, not just a visual refresh. I partnered with neurosurgeons and nursing teams across rounds of usability testing (sim and live observation) to map moments of hesitation, handoffs, and mis-taps. We re-art-directed the UI for the OR: darker chroma to avoid glare, high-contrast controls, and a typographic scale that reads at distance. Controls were reorganized around surgeon mental models—focus, zoom, light front and center; presets & alignment one tap away. Voice became a first-class modality with a constrained grammar, call-and-response confirmations, and clear on-screen feedback so staff know the system heard and acted.


Moves that made the difference


  • 10-ft overlay with large type, iconography that tolerates occlusion, and always-visible mode & safety states

  • Operator console v2: a home hub for Setup → Start → Wrap-up with single-purpose screens and consistent control placement

  • Voice UI: push-to-talk, short verb-noun commands (“Set zoom 60”), explicit confirmations, and fallbacks

  • Spec & QA: component tokens, state charts, and step-by-step scripts for verification/validation and traceable defects

AI-powered localization coupled with human reviews to translate into 5 different languages
AI-powered localization coupled with human reviews to translate into 5 different languages

Operating room shadowing & case context

AI-powered localization coupled with human reviews to translate into 5 different languages
AI-powered localization coupled with human reviews to translate into 5 different languages

Service blueprinting after discovery synthesis

Updated UX/UI for online portal for embryologists to download and share assessments with clinicians and patients
Updated UX/UI for online portal for embryologists to download and share assessments with clinicians and patients

Voice control / microphone testing

AI-powered localization coupled with human reviews to translate into 5 different languages
AI-powered localization coupled with human reviews to translate into 5 different languages

Contextual inquiry & workflow mapping

Solution highlights

  • Setup Wizard streamlines pre-op tasks (case type, connections, draping) with progress & guardrails

  • Procedure Home tiles map to the surgeon’s flow; no hunting for critical controls

  • Surgical Overlay v2 is readable & data rich; color reserved for warnings & patient-critical states

  • Voice Control e.g. "Modus, Zoom In" covers frequent adjustments; feedback toasts on overlay

  • Feedback & Logging: timers, recording indicator, and event logs visible at a glance for the team and for post-case review

Co-creation and pain point mapping from previous report version to inform redesign efforts
Co-creation and pain point mapping from previous report version to inform redesign efforts

Modus V - Simplified touchscreen UI

Targeted A/B user testing with different concepts to hone in on the final design
Targeted A/B user testing with different concepts to hone in on the final design
Targeted A/B user testing with different concepts to hone in on the final design

Modus V - Surgeon or nurse operated

Updated UX/UI for online portal for embryologists to download and share assessments with clinicians and patients
Updated UX/UI for online portal for embryologists to download and share assessments with clinicians and patients
Updated UX/UI for online portal for embryologists to download and share assessments with clinicians and patients

10-ft Surgical overlay UI - voice control & robotic end effector control of key surgical functions

Targeted A/B user testing with different concepts to hone in on the final design
Targeted A/B user testing with different concepts to hone in on the final design
Targeted A/B user testing with different concepts to hone in on the final design

Design to development handoff

Targeted A/B user testing with different concepts to hone in on the final design
Targeted A/B user testing with different concepts to hone in on the final design

Modus Nav UI refresh - Surgical planning

Impact

Post-redesign, surgeons and nurses described the system as “easier to drive without thinking about it.” The combination of 10-ft legibility, predictable control placement, and call-and-response voice reduced back-and-forth and allowed the team to keep eyes on the field. The design package (tokens, specs, state charts) also made implementation and verification more reliable, supporting regulatory submissions.

© 2025 | Justin Kirkey | All Rights Reserved