Cognitive neuroscience of auditory and cross-modal perception: Lectures and assignments
Editors: Norbert Kopčo, Frederick Gallun, Beáta Tomoriová, Ľuboš Hládek
This is the web page of the book “Cognitive neuroscience of auditory and cross-modal perception. Lectures and assignments”. It contains the lectures and assignments (along with source code/data) from two workshops that took place in Košice in 2014 and 2015. To receive an electronic copy of the book and assignments files, please email us at kogneuro(at)gmail.com.
Book details
Editors: Norbert Kopčo, Frederick Gallun, Beáta Tomoriová, Ľuboš Hládek
Title: Cognitive neuroscience of auditory and cross-modal perception: Lectures and assignments
Publisher: Pavol Jozef Šafárik University in Košice
Issue year: 2017
Edition: first edition
Number of pages (numbered): 793
ISBN: 978-80-8152-484-4
Publisher’s webpage: https://unibook.upjs.sk/sk/prirodne-vedy/362-cognitive-neuroscience-of-auditory-and-cross-modal-perception-lectures-and-assignments
Annotation
Cognitive neuroscience is a fast developing scientific field which aims at uncovering the neural basis of human perception and cognition. To achieve this goal, cognitive neuroscience uses a variety of tools and approaches ranging from non-invasive brain imaging to psychophysics and neural modeling. Mastering such tools requires skills and knowledge from multiple scientific domains, including neurophysiology, cognitive psychology, and several computational fields.
Over the past several decades, significant advances have been made in particular in the imaging and computational fields, providing us with large amounts of data about the brain function, with tools to analyze them, and, in turn, with a multitude of new advances in our understanding of the neural information processing. This proceedings provides a snapshot of our current knowledge in cognitive neuroscience, focusing on the mechanisms of auditory and cross-modal perception. It contains a collection of introductory lectures, research talks, and lab assignments prepared by invited experts in this field for two editions of a workshop and lecture series on “Cognitive neuroscience of auditory and cross-modal perception” that took place in Košice in 2014 and 2015. It is aimed at students and early-stage researchers interested in obtaining an overview of the basic knowledge, current research questions, and methods used in auditory and cross-modal perceptual research.
Each invited expert prepared one introductory lecture providing overview of his/her expertise, one advanced lecture on a current research topic, and an assignment related to his/her research. These teaching materials are provided in the first two parts of the proceedings. The third part provides abstracts of contributed presentations by the workshop participants. In addition, the accompanying CD and web provides the code and/or data of the assignments. The lectures only contain slides of the individual talks, and thus only provide an outline of the research topics and cannot be used as a textbook. For a reader interested in working on an assignment it is useful to first read through the corresponding lectures by the same author which contain a broader introduction to the selected problem. Most of the assignments code is in MATLAB and requires basic familiarity with this environment.
Additional information about this proceedings is available at http://pcl.upjs.s
Editors
Contents
Lectures
- Spatial hearing: Effect of hearing loss and hearing aids [Best]
- Audibility and spatial hearing [Best, Gallun, Kopčo]
- Six degrees of separation – The portal to auditory perception [Carlile]
- The plastic ear: Perceptual relearning and auditory spatial perception [Carlile]
- Active listening: Speech intelligibility in cocktail party listening [Carlile]
- Hearing in motion [Carlile, Leung, Locke, Burgess]
- Cocktail-party effect deficit in aging: what formant transition processing tells us [Divenyi]
- Phonemic restoration: done by our brain or our tongue? [Divenyi]
- Toward an evolutionary theory of speech: how and why did it develop the way it did [Divenyi]
- What is the cost of simultaneously listening to the “what” and the “when” in speech? [Divenyi]
- Impacts of aging and hearing loss on spatial release from masking [Gallun]
- Exploring the auditory dual-task [Gallun]
- Learning from nature’s experiments: What clinical research can mean for sensory scientists [Gallun]
- Auditory processing dysfunction associated with mild traumatic brain injury and blast exposure [Gallun]
- Modeling Auditory Scene Analysis by multidimensional statistical filtering [Hohmann]
- Modeling cocktail party processing in a multitalker mixture using harmonicity and binaural features [Josupeit, Hohmann, Kopčo]
- Binaural cues in electric hearing: Spectral localization cues in acoustic and electric hearing – Part 1 [Laback]
- Binaural cues in electric hearing: Spectral localization cues in acoustic and electric hearing – Part 2 [Laback]
- Spatial cues and perceptual grouping in electric hearing [Laback]
- Temporal effects in the perception of interaural level differences: Data and model prediction [Laback, Dietz, Ewert]
- On the single neuron computations [Maršálek]
- Coincidence detection in the MSO – computational approaches [Maršálek]
- Cognitive neuroscience of perceptual learning: Specificity and transfer [Seitz]
- Cognitive neuroscience of perceptual learning: Mechanisms guiding learning [Seitz]
- Perceptual Learning; specificity, transfer and how learning is a distributed process [Seitz]
- Brain Training; How to train cognition to yield transfer to real world contexts [Seitz]
- Integration of spatial information across multiple acoustic cues [Stecker]
-
Neuroimaging of spatial hearing, or quantifying human auditory cortical tuning to sound-localization cues with fMRI [Stecker]
-
RESTART theory: discrete sampling of binaural information during envelope fluctuations is a fundamental constraint on binaural processing [Stecker]
-
Neuroimaging of task-dependent spatial processing in human auditory cortex [Stecker, Higgins, McLaughlin, Rinne, Talja]
- Auditory processing capabilities supporting communication in preverbal infants [Winkler]
- Modeling auditory stream segregation by predictive processes [Winkler]
-
Neural and computational models of vision (Part 1: Fundamental problems of vision) [Yazdanbakhsh]
-
Neural and computational models of vision (Part 2: Neural models and their implementation in early vision) [Yazdanbakhsh]
-
Pursuit eye movements and perceived object velocity, potential clinical applications [Yazdanbakhsh]
- Visuospatial memory and where eyes look when the percept changes [Yazdanbakhsh]
Assignments
- MATLAB assignment: Simulating the effect of hearing loss and hearing aids on spatial cues [Best]
- Auditory Modeling Toolbox for MATLAB and analysis of HRTFs [Carlile]
- Instructions for using the STRF toolbox [Divenyi]
- Instructions for using the Distinctive Region Model (DRM) programs [Divenyi]
- Signal detection theory problem set [Gallun]
- Establishing normative ranges of performance using linear functions [Gallun]
- Neural coding, linear regression, convolution [Kopčo]
- Acoustic Simulation of Hearing with Cochlear Implants [Laback]
- MATLAB assignment: Numerical solving of ordinary differential equations, with focus on neuronal simulation [Maršálek]
- Analysis of an fMRI data set using MATLAB [Stecker]
- Psychophysical exploration of binaural cues synchronized to envelope fluctuations: testing the RESTART theory with synthetic and naturalistic sounds. [Stecker]
- Vision – Simulation Assignment 1 [Yazdanbakhsh]
- Vision – Simulation Assignment 2 [Yazdanbakhsh]
- A simple model for replicating the pursuit eye movement and its gain. [Yazdanbakhsh]
Abstracts of contributed presentations
Workshop 2014
- Persistent behavioral and neuronal effects of context-reward contingencies on visual search. [Eštočinová]
- Modelling Auditory Streaming using Non-negative Modulation Pattern Tensor Factorisations [Barker]
- Dynamical Brain: a signal processing tool for analyzing EEG/fMRI brain scans [Jovovic]
- Binaural model of lateralization [Bouse]
- Sound-localization in noise performance is determined by sensitivity to spectral shape [Andéol, Macpherson, Sabin]
- Effect of streaming on localization with a preceding distractor [Andrejková, Kopčo]
- Analysis of non-auditory effects on contextual plasticity in spatial hearing [Marcinek, Kopčo]
- Perceptual and neuronal patterns of auditory distance processing in humans [Kopčo, Eštočinová]
- Visual Adaptation And Spatial Auditory Processing [Lokša, Kopčo]
- Deafness etiology and functional outcomes after cochlear implantation in prelingually deaf children [Varga, Kabátová, Mašindová, Bercíková, Gašperíková, Klimeš, Profant]
- Effects of attention and the presence of multiple cues of concurrent sound segregation on the object-related negativity (ORN) [Kocsis, Winkler, Szalárdy, Bendixen]
- Auditory onsets, landmarks, surprise and salience [Kovács, Coath, Denham, Winkler]
- Individual Differences in Auditory Multi-Stability [Farkas, Denham, Bendixen, Winkler]
- Subjects’ expectations, and the imagery scanning. [Sebena, Dudinsky]
- Cognition of geometry of high-dimensional data – topological structured projection emerging through simulated experiments with self-organized non-Euclidean Manifold learning. [Horváth, Uličný, Brutovský]
- Adaptation to Room Reverberation in Nonnative Phonetic Training [Vlahou, Seitz, Kopčo]
- Audio-visual calibration and plasticity of auditory distance perception [Hládek, Le Dantec, Seitz, Kopčo]
- Audio-Visual spatial fusion varies with eyes’ position and allocentric visual referenceframe. [Hartnagel, Bichot, Sandor, Roumes]
- Modeling of Speech Localization in a Multitalker Mixture Using “Glimpsing” Models of Binaural Processing [Toth, Josupeit, Kopco, Hohmann]
Workshop 2015
- How spectral information triggers sound localization in sagittal planes [Baumgartner,Majdak, Laback]
- Cognitively Inspired Speech Processing For Multimodal Hearing Technology [Abel,Hussain]
- Auditory Distance Perception and DRR-ILD Cues Weighting [Eštočinová, Ahveninen,Huang, Rossi, Kopčo]
- Suggestion of rehabilitative treatment for patients subjected to sight restorativesurgery. [Markaryan]
-
Chirp stimuli for entrainment: chirp up, chirp down and task effects [Voicikas, Niciute, Ruksenas, Griskova-Bulanova]
-
Cross-modal interaction in spatial attention [Špajdel, Kohút, Cimrová, Budáč, Riečanský]
-
Prediction processes in the visual modality – an EEG study [Csifcsák, Balla, Szalóki, Kilencz, Dalos]
-
Early electophysiological correlates of susceptibility to the double-flash illusion [Simon, Csifcsák]
-
Learning of auditory distance with intensity and reverberation cues [Hladek, Seitz, Kopco]
-
Streaming and sound localization with a preceding distractor [Andrejková, Best, Shinn-Cunningham, Kopčo]
-
Visual Adaptation And Spatial Auditory Processing [Lokša, Kopčo]
-
Exposure to Consistent Room Reverberation Facilitates Consonant Perception [Kopčo, Vlahou, Ueno, Shinn-Cunningham]
-
Speech Localization in a Multitalker Reverberant Environment [Toth, Kopco]