Spatial Audio Virtualization and Gamification for Hearing Assessment and Enhancement
Project Acronym: SAV
Project Number: 101129903
Call: HORIZON-MSCA-2022-SE-01
Type of action: HORIZON TMA MSCA Staff Exchanges
Granting authority: European Research Executive Agency
Project starting date: 1 October 2023
Project end date: 30 September 2027
Project duration: 48 months
Abstract:
Auditory perception can be both challenging and rewarding. In a noisy crowded restaurant, listeners must quickly recalibrate their perception to the acoustic characteristics of the room and constantly switch attention to new speakers throughout a conversation. At the same time, the listening experience is motivating, e.g., when participating in an interesting conversation or enjoying the sounds of the surrounding environment. A major challenge in auditory neuroscience is that the laboratory training procedures and testing tools used to assess hearing abilities are neither rewarding nor representative of the multifaceted experiences of real-world auditory scenes. The goal of the current grant is to use virtual reality and computer game technologies to create advanced tools and models for accurately assessing auditory abilities and their underlying neural mechanisms, and for enhancing them in people with normal and impaired hearing. First, a series of experimental studies will be performed to determine 1) how to achieve a strong percept of externalization in virtual environments, 2) how virtualization can improve our understanding of the cognitive factors that influence performance on auditory perceptual tasks, and 3) how gamified training in virtual environments can enhance spatial and speech perception. Then, models will be developed to describe how gamification and virtualization influence auditory perception in the examined tasks. The results will be used to develop new modules for existing auditory assessment and enhancement tools – “PART” and “Listen” – which were developed by members of the consortium. Finally, workshops will be organized to train new researchers in the use of virtualization and gamification in auditory neuroscience, and to share and disseminate the new results of the project.
Collaborators:
Eleni Vlahou, PANEPISTIMIO THESSALIAS, Greece;
Mathieu Lavandier, ECOLE NATIONALE DES TRAVAUX PUBLICS DE L’ETAT France;
Robert Baumgartner, Piotr Majdak, OESTERREICHISCHE AKADEMIE DER WISSENSCHAFTEN, Austria;
Anja Pahor, UNIVERZA V MARIBORU, Slovenia;
Frederick Gallun, OREGON HEALTH AND SCIENCE UNIVERSITY, United States;
Jorg Buchholz, MACQUARIE UNIVERSITY, Australia;
Jyrki Ahveninen, Athinoula A. Martinos Center for Biomedical Imaging, MASSACHUSETTS GENERAL HOSPITAL/HARVARD MEDICAL SCHOOL, United States;
Virginia Best; Department of Speech, Language & Hearing Sciences, BOSTON UNIVERSITY, United States;
Aaron Seitz, NORTHEASTERN UNIVERSITY, United States.
Slack channel:
(missing 2 letters): https://join.slack.com/t/savboston2024/shared_invite/zt-2a82y7i4z-CiFNMDcYtwVcyPKaMAgp
Acknowledgement:
The project has received funding from the HORIZON-MSCA-2022-SE-01 call (MSCA Staff Exchanges) of the research and innovation programme of Horizon Europe under the Marie Sklodowska-Curie actions grant agreement N° 101129903.