MIT Media Lab alum Jinha Lee, who introduced the 3D desktop computer at TED this week, has designed an “augmented online shopping mall” in collaboration with Daewung Kim that enables users to see how different items will look on them.
‘What You Click Is What You Wear‘ uses either a head-mounted or transparent display, like the one Samsung debuted at CES, and a 3D graphic of the item (a watch is used in the video) is then rendered onto the user.
A depth camera attached to the display tracks the user’s movements, while a mobile device held by the user senses their orientation. As you can see in the video, this enables the system to keep the virtual clothing object being modeled in place as if it’s actually being worn.
This technology could allow someone to select different items with their mobile device to try on and then view them from behind the transparent screen to see how they look. Co.Design notes that it’s intended as a working prototype of what’s possible “when information lives in our space.” You can see it in action in the video below: