Full-Body UI in AR


Interface designer
Prototyper


N/A


7 months (rough sum of all projects)

PROBLEM
Hollywood and Silicon Valley had portrayed future immersion as a solo and hand-driven experience.

IMPACT
A set of prototypes on full-body gesture interface and shared experiences in AR/VR.

EXECUTION
Many interactive prototypes in Unity 3D
Animation prototypes in After Effects and C4D

Make a wish and contribute to a public AR installation

Wish AR illustrates the future interaction with water fountain/wishing wells, where people can use virtual currency to make a wish, donate to a fund (WWF), and collectively contribute to a public AR installation

Functional prototypes built in Unity 3D. Scene assets modified in C4D.

Join a shared VR space via body motion

Motion XR demonstrates how we can engage in shared VR spaces in public. One can join another's VR world by mimicking the same body movement as the creator of THAT VR world.

Functional prototypes built in Unity 3D.

Rely messages quickly with custom hand gestures

Gesture AI is a 2-week experiment on using machine learning to train custom gestures.

Functional prototypes built in Unity 3D.

Use feet as an AR interface

Explore feet as alternative inputs and test 3 main versions for usability and ergonomics improvement. However, technical limitations with Vuforia and narrow yet passive feet interaction lead to a full body gesture pivot.

Functional prototypes built in Unity 3D.

Full-body interface in AR for kinesthetic pleasure

Body in Motion is a badminton and hip hop dance inspired interface for AR. Users are able to interact with virtual content with body motion that emphasizes on kinesthetic pleasure, rather than pure efficiency.

Functional prototypes built in Unity 3D with Kinect. Animation prototype built with C4D and After Effects.

Exhibition installation (left) with an interactive demo area (right)