Research
Our goal is twofold:
Democratize Medical Expertise: Enable real-time remote collaboration for complex cases, AR-guided procedures, and medical training for personnel (like EMTs and nurses) and students, including those in remote or rural areas.
Democratize Low Latency Wireless: Create a practical, deployable system and platform—the LXM stack—that solves the technical barriers preventing the widespread adoption of consistent, low-latency wireless, with applications extending beyond medicine.
We achieve this through end-to-end co-designed architecture that spans medical applications, the XR runtime, the network transport layer, and the wireless service.
Medical Applications
Our goal is to use XR and low latency wireless to bring real-time access to medical experts to assist with complex cases and provide medical training to personnel and students located anywhere, especially remote/rural areas. We consider four use cases of increasing difficulty:
- Congestive Heart Failure Simulation for Medical Education and Training
- Collaborative, Real-Time Medical Training Simulation
- AR-guided medical procedures with distributed XR
- Critical Remote Ultrasound-Guided Drainage Procedure in a Moving Ambulance
XR Runtime
We propose to develop and deploy an XR runtime architecture, ILLIXR-Net, that, for the first time, promotes XR application-runtime-network codesign by enabling the runtime to:
- Tolerate network latency
- Adapt network demand to the network conditions and application requirements
- Inform the application and the network about their requirements, enabling network services aligned with heterogeneous application needs.
Network Transport Layer
Our multi-channel transport protocol introduces a fine-grained steering mechanism—per-packet rather than per-application—that leverages application-level
descriptions of messages’ performance requirements. This solution takes the form of our Latency-Aware Multi-Path Protocol (LAMP).
Wireless Service
The Agora Project will support underlying connectivity that is either cellular (5G) or WiFi. Supporting both provides coverage in more situations: A moving ambulance likely has only 5G service, a point of care in a rural area may have only WiFi, and a hospital in a city may have both. Agora can utilize dual connectivity (5G + WiFi) simultaneously, providing more options to the LAMP which it can use to improve latency or reliability.