Title	Details
Roles	Lead Unity Developer & 3D Designer
Tools	Hololens 2, MRTK, MRDL, Unity, Blender, Photoshop
Length	4 days
Project	Lifelines is a collaborative therapy tool to build, visualize, and analyze the story of your life on a 3d timeline with impact moments to bring better understanding and healing. With a literal turn of the wrist, easily access common therapy tools such as an Emotions Wheel, Empty Chair, and EMDR exercises will be available for healing.
Features	Database Storage, 3D Visualization, Hand Tracking, World Tracking, Spatial Sound Design
Impact	Winner for MIT Reality Hackathon 2022.
Collaborators	Bryant Wood, Daniel Sisson, William de Oliveira, & Jenny Fang

Teaser

Info

Lifelines utilizes augmented reality (AR) to revolutionize therapy during the challenging times prompted by COVID-19, addressing the soaring demand for mental health care. This innovative application empowers therapists and patients to collaboratively build, visualize, and analyze life stories on a 3D timeline, highlighting significant moments for deeper understanding and healing. By merging virtual and physical worlds, Lifelines offers an immersive, interactive experience that enhances patient engagement and makes complex therapy tools more accessible, marking a significant step forward in the integration of technology and mental health care.

How we built it

We utilized the Hololens 2 to deploy the LifelinesAR app with the help of MRTK and MRDL as our basis for the project. We worked with Unity to create the immmersive AR experience while using Photoshop and Blender for all 2D and 3D design assets.

Tools: Hololens 2, MRTK, MRDL, Unity, Blender, Photoshop, etc.

Interaction Design

Working with Hololens

In just one day, I led our team’s quick adaptation to Hololens technology, despite all of us being new to it and having varied experience levels in Unity. We focused on learning how to deploy builds to Hololens and started experimenting right away. Using the Microsoft Mixed Reality Toolkit (MRTK) and a shader library, we created engaging effects that activate during user interactions with a 3D timeline of their journey. This was a big step for our team, which includes a product manager, a designer, and three developers, as we had to quickly get up to speed with Hololens. The MRTK workshop was helpful, but it still took us almost a day to get a basic demo running on the Hololens. We also spent considerable time refining our idea to ensure it was achievable within a tight 2.5-day deadline.

Accomplishments that we’re proud of

We’re so excited we have made an AR therapy product to bring a good social impact. One of our missions is to take care of the mind, emotion, and well-being as a whole. Super proud that Lifelines could help people access therapists easily, get better healing; and also helps therapists to communicate with patients better. We also won MIT Reality Hackathon in 2022 under Wellness category. It feels good to be recognized.

Special Thanks to

My wonderful team: Bryant Wood, Daniel Sisson, William de Oliveira, & Jenny Fang

MIT Reality Hackathon (I have made so many connections with many interesting and wonderful people.)