Object Detection and Information Retrieval in Mixed Reality

Abstract

The rapid advances and increasing accessibility of augmented reality (AR) in recent years opened up many new possibilities to incorporate AR into our daily lives. A particularly interesting area for AR is tourism where one can enhance attractions with virtual elements and provide tourists with additional information about the places they are visiting. In this thesis we present our prototype, an AR application which augments various points of interest (POIs) in the city of Zurich by showing images and facts about each POI. We also developed a personalization system which ensures that facts are selected based on user preferences, thus creating a unique and personalized experience for each user. Moreover, we conducted a user study to assess the usability of our prototype and the usefulness of our personalization system.