Intelligent Content Creation Tools for Augmented and Virtual Reality

Duration

36 months

Status

Ongoing

MTC Team

Ayça Takmaz, Dr. Severin Klingler, Dr. Fabio Zünd

Collaborators

Manuel Braunschweiler (ETH MTC), Yukun Dai (ETH MTC), Dr. Steven Poulakos (Disney Research Studios), Violaine Fayolle (Disney Research Studios), Prof. Soo-Mi Choi (Sejong University), Kyoung-Je Park (Perfect Storm Co., Ltd.)

This project tackles several problems in the realm of scene understanding, story technology, artificial intelligence, character animation and authoring UIs. To interact with the user, natural language processing is used, for which we are in close collaboration with another lab at ETH. As a first prototype, we created a virtual museum guide, which can lead the user through a small art exhibition, interact with the paintings and explain various facts about the exhibits to the user. For future prototypes, we want to target scenarios that are tailored towards peoples’ homes, such as characters for kids entertainment or a daily companion / assistant.

The project is a collaboration betweend the Media Technology Center, the Game Technology Center, DisneyResearch|Studios and the Sejong University, in Seoul.