Audio and Visual Rendering with Perceptual Foundations - Archive ouverte HAL Access content directly
Theses Year : 2009

Audio and Visual Rendering with Perceptual Foundations

(1)
1
Nicolas Bonneel

Abstract

Realistic visual and audio rendering still remains a technical challenge. Indeed, typical computers do not cope with the increasing complexity of today's virtual environments, both for audio and visuals, and the graphic design of such scenes require talented artists. In the first part of this thesis, we focus on audiovisual rendering algorithms for complex virtual environments which we improve using human perception of combined audio and visual cues. In particular, we developed a full perceptual audiovisual rendering engine integrating an efficient impact sounds rendering improved by using our perception of audiovisual simultaneity, a way to cluster sound sources using human's spatial tolerance between a sound and its visual representation, and a combined level of detail mechanism for both audio and visuals varying the impact sounds quality and the visually rendered material quality of the objects. All our crossmodal effects were supported by the prior work in neuroscience and demonstrated using our own experiments in virtual environments. In a second part, we use information present in photographs in order to guide a visual rendering. We thus provide two different tools to assist “casual artists” such as gamers, or engineers. The first extracts the visual hair appearance from a photograph thus allowing the rapid customization of avatars in virtual environments. The second allows for a fast previewing of 3D scenes reproducing the appearance of an input photograph following a user's 3D sketch. We thus propose a first step toward crossmodal audiovisual rendering algorithms and develop practical tools for non expert users to create virtual worlds using photograph's appearance.
Fichier principal
Vignette du fichier
Thesis.pdf (27.56 Mo) Télécharger le fichier
Loading...

Dates and versions

tel-00432117 , version 1 (13-11-2009)
tel-00432117 , version 2 (15-11-2009)

Identifiers

  • HAL Id : tel-00432117 , version 2

Cite

Nicolas Bonneel. Audio and Visual Rendering with Perceptual Foundations. Human-Computer Interaction [cs.HC]. Université Nice Sophia Antipolis, 2009. English. ⟨NNT : ⟩. ⟨tel-00432117v2⟩

Collections

INRIA INRIA2
349 View
295 Download

Share

Gmail Facebook Twitter LinkedIn More