Alexandria Digital Research Library

An Analysis-Synthesis Approach to the Creative Processing of Video Signals

Author:
Villegas, Javier
Degree Grantor:
University of California, Santa Barbara. Media Arts and Technology
Degree Supervisor:
George Legrady
Place of Publication:
[Santa Barbara, Calif.]
Publisher:
University of California, Santa Barbara
Creation Date:
2012
Issued Date:
2012
Topics:
Engineering, Computer and Multimedia Communications
Keywords:
Cross-synthesis
Animation
Real-Time Installations
Temporal coherence
Analysis - Synthesis
Ambiguous Images
Genres:
Online resources and Dissertations, Academic
Dissertation:
Ph.D.--University of California, Santa Barbara, 2012
Description:

Analysis and synthesis (A/S) approaches are common in multimedia signal processing. Reducing a signal to its constituent parts is relevant because once the signal is analyzed, the set of extracted parameters can be more convenient for storage, finite length representation, transmission or manipulation than the signal in its original form. The community of audio artists have adopted A/S techniques as an important part of their arsenal of technological tools for the creative manipulation of sounds. Parameters can be altered before the synthesis, generating sophisticated sound effects while maintaining the identity of the original signal. Tools such as the tracking phase vocoder allow musicians to manipulate pitch and duration independently or to combine two signals in exotic ways (cross-synthesis). However, a similar emphasis has yet to be pursued for the creative manipulation of video signals. This dissertation describes how A/S approaches can be used to obtain non-photorealistic representations from live video. In this research, new algorithms have been designed to overcome problems like temporal coherence and to extend concepts like the cross-synthesis of two video signals. The creative and narrative possibilities of the developed techniques are used to compose complete pieces divided between short animations and real time installations. Details on the design and implementation of those pieces are included in this document. The pieces, together with the different examples used throughout the dissertation illustrate the versatility and control that can be obtained with A/S approaches and confirm that these sets of techniques can be considered for the creative manipulation of video data.

Physical Description:
1 online resource (135 pages)
Format:
Text
Collection(s):
UCSB electronic theses and dissertations
ARK:
ark:/48907/f3sf2t5b
ISBN:
9781267934451
Catalog System Number:
990039503590203776
Rights:
Inc.icon only.dark In Copyright
Copyright Holder:
Javier Villegas
Access: This item is restricted to on-campus access only. Please check our FAQs or contact UCSB Library staff if you need additional assistance.