Case Study · 03

Surgical Planning Platform.

Mixed Reality surgical planning for Microsoft HoloLens. A 0→1 product designed for senior surgeons before spatial computing became mainstream.

Healthcare Mixed Reality Lead Product Designer + Brand Designer Pre-2023 Microsoft HoloLens · Spatial
Key outcomes
70%+
Participating surgeons changed their pre-operative decisions after using Medvisor
Live
On the Microsoft HoloLens Store — one of the earliest MR medical tools for Indian clinicians
0→1
Complete platform from zero — no design, no system, no documentation existed
Pre-AI
Built before Apple Vision Pro was announced — no playbook, no precedent, no reference
Medvisor mixed reality platform

This case study is protected.

I designed a spatial surgical planning product for Microsoft HoloLens, built for senior surgeons in Delhi. Enter the password below or request access.

or
Request sent. I'll follow up within a few hours.
70%+ Decision change
Live HoloLens Store
11 Spatial interaction patterns
0→1 Full platform & brand
01The Product

Surgery, planned
in three dimensions.

Medvisor bridges the gap between a patient's CT scan and the surgeon's pre-operative decision-making. Surgeons put on the HoloLens device, navigate to a patient profile, and access their full 3D CT scan as a manipulable holographic object in physical space.

Before Medvisor, surgeons worked from flat 2D imaging. Same data — different dimension. What changed: seeing a problem in three dimensions, at scale, in space, before the first incision, changes surgical decisions fundamentally.

"This was the most revolutionary product we have ever experienced. It can save many lives." — Delhi Surgeon Team
How Medvisor works
01Patient undergoes CT scan — full body or targeted region (head, neck, waist, legs)
02CT data processed through Unity 3D and transferred into the HoloLens app
03Surgeon puts on HoloLens and opens the patient profile in Medvisor
043D holographic body part appears as a manipulable object in physical space
05Surgeon studies, rotates, plans — pre-op decision made with full spatial context
Concept overview
Spatial clarity before the first incision

Surgeons seeing patient anatomy in mixed reality — before touching a scalpel.

Spatial clarity before the first incision
02The Problem — 0→1

Four unknowns.
One safety-critical product.

This was a complete 0→1 build. A group of senior Delhi surgeons had a clinical hypothesis: if they could interact with a patient's 3D CT data spatially before surgery, their decisions would be more accurate.

The challenges were layered — unknown domain (no prior MR design experience), unknown technology (HoloLens has its own entirely different design system), unknown industry (surgical workflows were new territory), and safety-critical stakes (a design error in a medical tool is not a UX bug — it is a patient safety risk).

Everything had to be learned, then applied correctly, the first time.

Layered constraints
⚠️Zero prior experience in mixed reality or spatial design
⚠️HoloLens design system entirely different from web or mobile
⚠️Surgical workflows and medical UX completely new territory
⚠️Safety-critical stakes — design errors have patient consequences
⚠️No design precedent — nothing to reference or learn from
02.5 — Research · Competitive Analysis

A category dominated
by enterprise and cost.

The mixed-reality surgery market is projected to grow from $8.6B (2025) to $17.2B (2030). Today it is dominated by well-funded, enterprise-sold platforms. Medvisor's significance is one of timing and access — it shipped on the HoloLens Store as an independent product before the AI boom and before Apple Vision Pro existed, achieving a measurable clinical outcome on a fraction of these players' resources.

Swipe to compare →

Criteria Medivis Surgical Theater Augmedics Brainlab Medvisor ↗
Focus Pre-op + intra-op Pre-op rehearsal Intra-op navigation Surgical navigation Pre-op decision support
Platform HoloLens 2 + Vision Pro VR/AR headsets Proprietary AR headset Proprietary + Brainlab MR Microsoft HoloLens (store)
Backing VC-funded, NYC Established, global FDA-cleared, scaled Enterprise giant Independent, India
Strength Real-time + AI, hospital partnerships Patient-specific rehearsal Live intra-op spine leader, 10,000+ surgeries Enterprise integration, scale Early-mover · store-distributed · proven outcome
Key gap Expensive, long hospital sales cycle VR-heavy, neurosurgery-focused, costly Spine-only, not pre-op planning Legacy, expensive, not MR-native Early-stage scope, single surgeon group
Distribution Enterprise hospital sales Enterprise Enterprise / FDA Enterprise Microsoft HoloLens Store — accessible
Clinical outcome Qualitative hospital testimonials Rehearsal value stated 10,000+ AR surgeries Established enterprise results 70%+ of surgeons changed pre-op decisions
Key insight
Every major player sells enterprise, intra-operative, and expensive. Pre-operative decision support, distributed accessibly and proven to change surgeon decisions, was an open lane — and Medvisor entered it years before the category matured.
Where Medvisor wins
Accessibility (store-distributed, not a six-figure enterprise contract), a hard clinical outcome (70%+ decision change), and pioneering timing. The story isn't "we beat Medivis" — it's "we proved the thesis early, independently, with real surgeons, before the giants arrived."
03Learning the HoloLens Design System

Unlearn normal design.
Re-learn spatial design.

Before a single screen was designed, I read Microsoft's full spatial UX documentation — learning principles that have no equivalent in web or mobile design.

Rule 01
3× Pixel Scaling
Spatial interfaces require 3× the standard pixel density for legibility at arm's length. Every element redesigned for spatial reading distance.
Rule 02
Gaze-Based Targeting
No mouse cursor. The user's gaze determines focus. Every interactive element designed for gaze as the primary pointer input.
Rule 03
Air-Tap Interaction
Clickability triggered by finger tap in physical space. Tap zones redesigned for air-tap mechanics at 3D depth — not screen surface.
Rule 04
Environmental Colour
Colour choices affect legibility against any physical backdrop — not just a white screen. Every colour tested in real HoloLens environment conditions.
Rule 05
Voice Commands
Voice as a primary navigation layer throughout the entire system. Every core action mapped to a voice command equivalent.
Rule 06
Gesture Vocabulary
Drag, zoom, object movement in 3D space — all through hand gestures. Full gesture system designed and documented for developer handoff.
Rule 07
Object Anchoring
Keeping 3D medical objects stable in the surgeon's spatial environment while they move around the holographic patient scan.
Rule 08
Hover States in 3D
Standard hover redesigned for air-tap mechanics and gaze dwell time. Proximity and gaze time replace mouse hover entirely.
04Core Design Challenge

No screen boundaries.
No keyboard. No predictable background.

The hardest design decision was not a single call — it was the entire paradigm shift. Every UX convention I had built over years became partially or completely inapplicable in a spatial environment.

"I had to unlearn normal design and re-learn spatial design simultaneously while building for a safety-critical medical application. The margin for error was not 'bad UX' — it was 'a surgeon makes the wrong call.' That responsibility changes how you think about every single decision."

The solution: radical simplicity at every interaction point. In an environment where everything is new and unfamiliar, cognitive load reduction is not a design principle — it is a patient safety principle.

Standard UX — Not applicable here
❌ Everything I Knew
Fixed screen boundaries
Standard click/tap targets
Predictable white or dark background
Keyboard input and standard navigation
Spatial UX — Had to learn from zero
✅ What I Built Instead
No screen — the physical world is the canvas
Gaze and air-tap replace all click behaviour
Colour designed for any physical environment
Voice commands as primary navigation layer
Radical simplicity as a patient safety principle
05The Insight That Changed Direction

Surgeons don't need more data.
They need spatial clarity.

After studying surgical planning workflows with the Delhi surgeon group, one insight became the design foundation: existing pre-operative tools gave surgeons the same data Medvisor did. What they lacked was perspective — the ability to move around a problem, see depth, understand the spatial relationship between affected and healthy tissue.

The entire UX was built around this: not adding features, but removing every barrier between the surgeon and the 3D object in front of them. The interface disappears. The patient's anatomy is what remains.

Spatial Clarity
The one thing 2D imaging couldn't provide — and the entire product was built around delivering it
Depth
Understanding the 3D spatial relationship between affected and healthy tissue before the first incision
06Everything Designed

Brand to spatial platform.
Every layer, from scratch.

Brand & Identity
Brand 01
Medvisor Logo
Combining a stethoscope and HoloLens device in one mark — the identity that positions Medvisor as a medical-technology product, not a generic app.
Brand 02
Full Brand System
Colours, typography, and visual language adapted for spatial display. Environmental colour system designed for mixed reality legibility in any physical setting.
Brand 03
Marketing Landing Page
Product marketing website with device showcase visuals, clinical outcome framing, and surgeon testimonial integration.
HoloLens Application — Core Flows
App 01
Onboarding & Login
First-time device calibration guidance, doctor login, profile setup — designed for surgeons putting on HoloLens in a clinical setting.
App 02
Patient Management
Patient list, search, individual profiling, patient ID system, and CT scan library with multiple scan types per patient.
App 03
3D Scan Viewer
The core product: spatial CT scan interaction. Surgeons rotate, zoom, and move through a full 3D holographic scan in their physical space.
App 04
Surgical Planning Module
Pre-operative surgical plan creation per patient. Document specific tissue areas, planned approach, and required instruments before the procedure.
App 05
Live Connect
Real-time remote doctor-to-patient connection via HoloLens — consultant surgeons guide procedures from a remote location in spatial context.
App 06
Voice + Gesture System
Complete voice command layer + full gesture vocabulary (zoom, move, drag, anchor). Fully documented for developer handoff to Unity team.
Supporting Modules
Supp 01
Documentation Module
Medical notes and records per patient, accessible in spatial environment alongside the 3D scan during pre-op planning.
Supp 02
Medical Objects Library
3D anatomical reference objects for surgical planning — compare healthy anatomy with patient-specific CT data in the same spatial view.
Supp 03
Spatial Guides & Calibration
HoloLens usage guidance within the app. Centerpiece tools for 3D object focus, environment anchoring, and device calibration.
Screens · HoloLens App
Patient Selection
Scan View
Patient Interaction
Features Panel
Logged In View
Medvisor in use
Medvisor in use
Surgeon with HoloLens
Surgeon reviewing scan
Mixed reality surgery
07Design Process

Research first.
Build nothing until you understand the domain.

PhaseDurationKey Activities
Technical Research3 weeksFull Microsoft HoloLens design documentation study · Spatial UX principles · Unity environment constraints · 3× pixel scaling · Gesture vocabulary mapping
Clinical Research2 weeksSurgical workflow consultation with Delhi surgeon group · Pre-operative planning process mapping · Safety-critical design requirements identification
Brand & Identity1 weekLogo design (stethoscope + HoloLens mark) · Colour system for MR environment · Typography adapted for spatial display
Spatial Design6 weeksFull HoloLens application design · Gesture system · Voice command layer · Onboarding · All patient management and clinical screens
Collaboration & Handoff2 weeksDeveloper sessions with the Unity team · 3D object integration design · Marketing landing page and device showcase handoff
Microsoft Mixed Reality Partner · India

"As one of the first Microsoft Mixed Reality Partners in India, we stand at the forefront of innovation in healthcare technology. This recognition not only reflects our technical expertise but also our commitment to pioneering immersive solutions that redefine how doctors learn, plan, and perform. Our collaboration with leading medical professionals underscores the trust placed in our work and the tangible value it brings to real-world clinical settings."

Microsoft
08Outcomes & Metrics

70%+ of surgeons changed
their pre-operative decisions.

This is a clinical outcome, not a UX metric. It means the product demonstrably improved surgical precision for the majority of surgeons who used it. That's not a conversion rate. That's a real-world patient safety outcome.

70%+
Surgeons changed pre-operative decisions after using Medvisor
Live
Microsoft HoloLens Store — launched before Apple Vision Pro's announcement
97%
Surgical professionals who agree HoloLens will have a clinical role (PubMed, 2020)
First
MR medical planning tool available to Indian clinicians on the HoloLens Store
"This was the most revolutionary product we have ever experienced. It can save many lives."
Delhi Surgeon Group · Clinical Validation Feedback
73s
Procedure time improvement per surgery with HoloLens vs conventional monitors (PubMed, 2020)
4.1
OSATS surgical performance score improvement in same peer-reviewed study
2023
Shipped before Apple Vision Pro announced — no MR mainstream playbook existed
0→1
Logo, brand, spatial UI, voice system, gesture vocabulary — everything from zero
09AI in This Project

This project predates
the AI era. Everything was manual.

"There was no AI to help me understand what a surgeon needs before an operation. I had to sit with the doctors, understand the workflow, understand the fear of uncertainty before a critical procedure, and then translate that into a spatial interface. That's the work no tool does for you."
ToolUsed forNote
No AI toolsNot available at time of projectPredates Claude, Figma AI, and mainstream LLM tooling
Microsoft DocsHoloLens design system — full documentation read and applied manually100% human research and interpretation
Surgeon ConsultationSurgical workflow, pre-operative process, patient safety requirementsLearned directly from the clinical team — no shortcut available
Next case study
UnlockTrails
Real-World Experience Platform · Consumer · Travel · US Market
View case study