Alexandria Digital Research Library

Wide-Area Visual Modeling and Tracking for Mobile Augmented Reality

Ventura, Jonathan Daniel
Degree Grantor:
University of California, Santa Barbara. Computer Science
Degree Supervisor:
Tobias Hollerer
Place of Publication:
[Santa Barbara, Calif.]
University of California, Santa Barbara
Creation Date:
Issued Date:
Computer Science
Visual tracking
Mobile computing
Ubiquitous computing
Computer vision
Augmented reality
Dissertations, Academic and Online resources
Ph.D.--University of California, Santa Barbara, 2012

The vision of "Anywhere Augmentation" is to enable a ubiquitous augmented reality experience, indoors and out, by leveraging existing geographic resources and providing tools to easily map new spaces with cheap, off-the-shelf hardware. My work considers the use of panoramic datasets to provide complete and detailed environment models for accurate mobile localization and tracking. I present an end-to-end system which covers modeling, localization and tracking for AR. The implementation is demonstrated with the Apple iPad 2 as a mobile AR tablet, using a remote server for computationally heavy localization queries.

This dissertation discusses the details of my methods and my contributions to outdoor modeling and tracking for AR. Outdoor visual modeling is improved by using the "upright" constraint, which requires that all images be aligned to a common vertical. The resulting model is used to determine the location of a mobile device by matching the camera image to the point cloud. I consider the problem of latency between the mobile device and the localization server, and present strategies to handle this latency. Continuous device localization is achieved by real-time tracking on the mobile device, which is shown to be robust to illumination change. In addition, I evaluate the relationship between modeling effort and localization performance, to determine the feasibility of in situ reconstruction of large spaces by a mobile user. The work leads to insights and future directions for pursuing a state-of-the-art "Anywhere Augmentation" system.

Physical Description:
1 online resource (157 pages)
UCSB electronic theses and dissertations
Catalog System Number:
Inc.icon only.dark In Copyright
Copyright Holder:
Jonathan Ventura
Access: This item is restricted to on-campus access only. Please check our FAQs or contact UCSB Library staff if you need additional assistance.