design challenge / product design
IRIS: augmented reality interface for NASA astronauts
An intuitive AR system for astronauts supporting their extravehicular operations on Mars.
designed for
Position
Timeline
Tool used
overview
AR Product Designer at NASA SUITS
I participated in NASA's design challenge (SUITS) as part of one of the selected teams across the nation, exploring ways to support astronauts during spacewalks on future Mars missions. I served as an AR Product Designer, contributing to all stages of user interface design, establishing design systems for web and AR, and leading the design and implementation of three AR core features while collaborating with cross-functional teams to meet requirements, design considerations, and technological feasibility. We implemented the design using Unity-MRTK3, conducted usability testing on Microsoft's HoloLens 2, and presented our system at NASA's Johnson Space Center in May 2024.
6 cross-functional teams
I collaborated with 6 cross-functional teams, including design, research, AR engineering, AI engineering, hardware, and business.
3+ Core AR features
My primarily role was leading the design of three core AR Features: Tasklist, Geosampling, and Messaging, collaborating with engineers.
Multimodal interaction
Integrated multimodal interactions—AR, ground control, and voice command—to create accessible and seamless assistance during mission.
Meet IRIS
My Contribution: AR Feature
Tasklist
The simple task view lets astronauts scan tasks and open a pop-up for details. Progressive disclosure keeps the AR interface streamlined. All the button size meets HoloLens 2's requirement.
Geological Sampling
pop-up menu for each data entry allows astronauts to create a new sample and add details effectively. The menu disappears when an option is selected or another entry is pressed. Entries can also be adjusted as needed.
Messaging
Messaging is simplified with default speech-to-text and options for pre-set messages or icons, enabling efficient communication in audio connection loss situations.
Notifications
Notifications for tasks and messages. Urgent alerts highlighted in red for maximum visibility.
Design Considerations
COR: Cardiac Oriented Record
Testing on HoloLens 2, we discovered head-tracking FOV to be a major obstacle in the usability of our application, increasing risks of AR windows being overly cluttered and increasing difficulty to navigate. To resolve this, we developed a Cardiac Orientation Record, orienting screens to astronauts' bodies rather than their heads.
Multi-Modal Interaction
On Mars, astronauts can wear slim-fitting spacesuit gloves, allowing them to directly touch buttons to control interfaces. We also utilized HoloLens 2’s ray system and pinch gestures provide alternative interaction methods.
In addition, to support hands-free control during missions, all selectable elements are labeled and can be operated using the Voice Assistant, VEGA. VEGA is hard-coded to process complex natural language commands, enabling multi-step actions. In case of audio connection loss, it also supports speech-to-text communication to communicate with the team and the control center.
Cross-Platform Interaction
The Astronauts' AR interface is integrated with the Local Mission Control Center (LMCC) web interface, enabling seamless information exchange during missions.
AR/Web Design Systems
Established Design Systems for both Web and AR, accounting for the unique characteristics of each platform and optimizing communication between each other.
takeaways & Reflection
During this proejct, I learned
01
Cross-Team Collaboartion
I worked closely with engineers across software, AI, and hardware to develop design solutions. Through this cross-team collaboration, I learned the importance of clearly articulating my design decisions with strong reasoning, ensuring developers understand the rationale behind the design and can implement it effectively. I also realized that involving developers early in the process leads to better outcomes and smoother integrations.
02
Effectiveness of Design Systems
As designers working in separate feature teams during the first phase of this project, we noticed a lack of coherence across feature designs. To address this, we established concrete design systems for both AR and Web, ensuring alignment among all designers. This also enabled engineers to work more efficiently.
03
Adapting to Technologies
Though I had experience with AR design, the complexity of NASA's Mars Mission was challenging. The interface needed to accommodate multiple open windows tracking the user’s vision, which caused distractions and made navigation difficult—particularly in high-stakes mission scenarios. Through iterative testing, we identified a solution—Cardiac Oriented Record. This experience taught me the importance of adaptability, putting myself in the users' shoes, continuously refining the design, and iterating until we achieved an optimal user experience.
Don't be a stranger!
@2025 Justin Jain Lee
you may enjoy the full view on desktop or laptop
