Beyond Visual Computing: Interactive Auditory Display
- Day - Time: 14 June 2013, h.11:00
- Place: Area della Ricerca CNR di Pisa - Room: A-32
- Ming C. Lin (Department of Computer Science, University of North Carolina at Chapel Hill)
Extending the frontier of visual computing, an interactive auditory display utilizes sound to communicate information to a user and offers an alternative means of visualization. By harnessing the sense of hearing, sound or audio rendering can further enhance a userâ??s experience in a multimodal virtual world. In addition to immersive environments, audio feedback can provide a natural and intuitive human-computer interface for many desktop applications such as computer games, online virtual worlds, visualization, simulation, and training.
In this talk, I will give an overview of our recent work on sound synthesis and sound propagation. These include generating realistic physically-based sounds from rigid body dynamic simulation and liquid sounds based on bubble resonance coupled with fluid simulators. I will also describe new and fast algorithms for sound propagation based on improved numerical techniques and fast geometric sound propagation based on extension of ray-tracing techniques. These algorithms improve the state of the art in sound rendering by at least one to two orders of magnitude and I will demonstrate their performance on interactive sound synthesis and propagation in complex, dynamic environments by utilizing the parallelism of many-core processors and GPUs commonly available on desktop systems.