DescriptionThis presentation provides an overview of improvements to visualization system interactivity. In particular, we discuss enhancements to collaborative communication capabilities, room interactivity and self-awareness, understanding of technical data, and the overall user interface of these visualization systems. In addition, we incorporate and explore various audio rendering techniques, including binaural playback, optimal panning, and target soundfield construction, toward this research goal. These improvements are achieved by integrating speaker arrays, microphone arrays, and other sensors and devices which will advance the KAUST Showcase space. Many of these technologies are applicable to the NexCAVE, IMR, and Cornea environments as well.;;This year much of the equipment for the project was researched, acquired, and built. Specific demonstrations outlining the benefits of speaker array technology were given at KAUST in Jan 2011. Microphone array and speaker array interactivity demonstrations were shown as well. Detailed plans were made regarding the mounting and usage of such systems in the Showcase space at KAUST. These systems will support many other KAUST Visualization team projects and will enhance the KAUST Showcase space and its interactive applications.;;Enhancing the intelligence and interactivity of the Showcase space is a goal that may require multimodal sensors, including head trackers and cameras, which are specified in other visualization projects. Data from these devices can be fused with captured audio signals to provide robust awareness of the state of the room and its occupants, therefore enhancing smart-room capabilities of the Showcase. This information will be used as feedback to the sound system for calibration or target-optimization purposes.
Peter Otto holds appointments at UCSD as Technology Director/Music, and Director of Sonic Arts Research & Development/CalIT2. A musician, educator, software and hardware designer, he invented one of the first control surfaces for Digital Audio Workstations, and recently designed advanced spatial/VR audio systems for CalIT2 (StarCave, HIPerwall and others). Facilities credits include CalIT2's SpatLab, CalIT2's Digital Cinema Theatres, and new acoustical rooms, systems and studios at UCSD Music's Prebys Music Center. Research projects include high-definition multi-channel audio streaming and production systems with CineGrid, an industry/academic digital cinema consortium, and new applications for communications and immersive sound using Wave Field arrays. Otto has designed and written numerous spatial audio software packages, including binaural and multi-channel design and imaging applications.
No resources found.
No links found.