Home » Artificial Intelligence and Cognitive Sciences

Artificial Intelligence and Cognitive Sciences

prejsť na slovenčinu / predmet UNV

AICS: Artificial Intelligence and Cognitive Science
UIKV: Umelá inteligencia a kognitívne vedy
Ústav informatiky, Prírodovedecká fakulta
UPJŠ Košice
Summer semester 2022

Lecturer: Norbert Kopčo, norbert.kopco@upjs.sk, Jesenná 5, room T2.16, tel. 234 2450
Teaching assistants: Udbhav Singhal, udbhav.singhal@student.upjs.sk, Jesenná 5, PCL lab (2nd floor).
Lectures: Thursdays 15:40-16:10 via skype (skype account: nkopco)
Labs/Cvičenia: no labs are scheduled. the labs will be in the form of individual consultations (upon request).

NEWS AND UPDATES (for old updates, scroll to the end of page)

2022/4/6
– slides of lecture #9 are available online.
The lecture will take place tomorrow (Thu) at 15:40-16:10 via skype.
– your projects are due this week .
– final exam will take place in the week after the last lecture (i.e., week 10). Agree with Udbhav on date/time. Format will be similar to the midterm exam, covering lectures #6-9.
– link with your current grading was shared via email.
– we are collecting data in different experiments. Alternative to getting a credit is to getting paid 4EUR/hr as a stipend (for any student in Faculty of Science). If you are interested in being a subject in one or more of them (and earning 5% UIKV class credit per experiment) contact me or Udbhav. Also, ask the people for whom you are a subject to let me know so that I give you the credit.

Class contents

Overview of the anatomy, physiology and cognitive processes in the human brain and mind. Description of neural centers and mechanisms underlying some cortical functions (e.g., visual, auditory and sensorimotor cortex, learning and memory). Basic physiological, psychophysical and computational methods used in cognitive neuroscience with emphasis on the application of computational methods in neurophysiological measurements and in the imaging of brain activity (e.g. magnetic resonance). Technical applications of neurocognitive research.

Class contents

Overview of the anatomy, physiology and cognitive processes in the human brain and mind. Description of neural centers and mechanisms underlying some cortical functions (e.g., visual, auditory and sensorimotor cortex, learning and memory). Basic physiological, psychophysical and

Prerequisites

– basics of biology, chemistry, physics
– linear algebra and differential equations
– knowledge of MATLAB or OCTAVE or willingness to learn

Class philosophy and student’s work

The 2021 edition of the class will cover cognitive science lectures from the Intro to Neuroscience class + individual student work in AI. It will be shortened to 9 weeks.

The emphasis will be on individual work during the semester. Attendance at lectures is very important (and will be monitored using an attendance sheet).  During the semester there will be two compulsory written exams, one in the middle (midterm exam) and one at the end of the semester (final exam). Another requirement is to work on a project (essay, model, small experiment, AI project). Based on the points obtained by a student for the project and written exams, a final overall grade will be proposed after the final exam on the final week of classes. Those who want to improve their grade will have an opportunity to sign up for an additional exam (assuming they passed the course / ak dostali zápočet).

Grading

Contribution of the individual tasks to the final grade:
– active participation at the lectures 10%
– project 20%
– midterm exam 35%
– final exam 35%
– extra: 5% of the grade can be earned by the participation on the experiments in the Laboratory of perception and cognition. We will keep you informed about the options.

Penalty in grading and ethics

The number of points earned for projects is reduced by 20% of the maximum value for the project with each week of delay (i.e., you do not have to bother at all after 5 weeks). Delay begins to count on the day following the labs during which the project was supposed to be submitted. Each project, and essay should reflect the work and knowledge of the person who is stated as the author.

Literature

(some texts are available in the electronic form in this folder, accessible with the password mentioned at the lecture)

Primary source of information are the PDF slides of lectures and the book (in Slovak)
Kopčo Norbert (2011) Výpočtová neuroveda (Úvod do modelovania neurofyziologických a behaviorálnych dát), Vydavateľ: Technická univerzita v Košiciach. (abbreviation KVN)

Additional sources:
Gazzaniga M. (ed.): The New Cognitive Neurosciences. 2nd ed. MIT Press. 1999 (available electronically – upon request. Alternatively, for $15 you can get 5-days access and download whichever of more than 400 books available on CogNet. Printed version of the book is in my office)
Purves et al.: Neuroscience. 2nd ed., Sinauer Associates, 1991 (available in fulltext electronically. It is not possible to orient in the book from the contents but you can view the contents and then search for the title of the chapter)
Dayan P and LF Abbott: Theoretical Neuroscience – Computational and Mathematical Modeling of Neural Systems. MIT Press, 2001 (further referred to as TN, available electronically)
Gerstner et al.: Neuronal Dynamics: From single neurons to networks and models of cognition. Camb Univ Press 2014 (free online).
Stillings et al.: Cognitive Science: An Introduction, 2nd ed., MIT Press, 1995 (referred to as CSAI, available electronically)
Wilson RA a FC Keil: The MIT Encyclopedia of the Cognitive Sciences. MIT Press, 1999 (MITECS available electronically)
Rybár J, Beňušková Ľ a Kvasnička V: Kognitívne vedy. Kalligram, 2002 (referred to as RKV, the copy is in my office)
Posner, M: Foundations of Cognitive Science. MIT Press, 1989 (the copy is in my office)
Kandel ER, Schwartz JH a TM Jessell: Principles of Neural Science. McGraw -Hill, 2000 (the copy is in my office)
Novák M, Faber J a O Kufudaki: Neuronové sítě a informační systémy živých organismů. Grada, 1993 (referred to as NS, available electronically)
Marek Dobeš: Základy neuropsychológie.(available electronically)
Levine DS: Introduction to neural and cognitive modeling. Lawrence Erlbaum 1991 (the copy is in my office)
Hertz J, Krogh A and Palmer RG: Introduction to the theory of neural computation. Addison-Wesley 1991 (HKP, the copy is in my office)
Kopčo Norbert (2011) Výpočtová a kognitívna neuroveda (Návody na cvičenia), Vydavateľ: Technická univerzita v Košiciach.
Kvasnička V and Clementis L (2014) Kognitívna veda v kontexte informatických vied. Slovenská technická univerzita v Bratislave

Projects

Detailed information regarding projects for IntroNeuro class can be found here. Here, you have the additional options of
– watch at least 5 lectures of your choice from the MIT AI class https://ocw.mit.edu/courses/electrical-engineering-and-computer-science/6-034-artificial-intelligence-fall-2010/ (one per week) and write a summary of each lecture watched (around 500 words) with your commentary on it
– choose a topic of your choice in AI from the MIT class that has a problem set and write a detailed review on the topic and do the MIT  problem set on it
working on 3 VKN1 assignments (see section labs), or— 3 assignments from the Intro to neurosci class
– a project on a topic from the VKN1 class (see the VKN  web)

Schedule and grading:
Week 3: Approved topic of the project (20% of the grade). Each group will write what topic they have chosen and what sources they plan to use. Only when I approve the topic you can work on it.

Week 9: project submitted (80% of the grade)

Schedule of lectures:

Week 1: 17.2. Introduction to neuroscience and cognitive science (slides in PDF EN; SK; animations/demos mentioned in the lectures are available in protected folder)
Structure of the class and requirements, What is neuroscience, What is cognitive psychology and cognitive science,
What is computational neuroscience and neural modeling, Examples of neural models at different levels
Literature: KVN (Chapter 1 Introduction, possibly also Chapter 2), TN (Preface), Preface to RKV, Chapter by M. Dobeš about Cognitive psychologyCSAI chapter 1 (possibly also chapters 2 a 3)

Week 2: 24.2. Overview of the anatomy and of the functions of central nervous system (CNS) (slides in PDF EN, SK)
Overview of the anatomy, functions and historical theories about CNS funtioning. Introduction to mathematical methods of modeling of neurophysiological data.
Literature: KVN (Chapters 2,3), NS (pages 19-35, 142-150), PNS (Chapters 1 and 19),
R. Wessel, C. Koch, F. Gabbiani (1996) Coding of time-varying electric field amplitude modulations in a wave-type electric fish. J Neurophysiol 75:2280-93 (1996),
Daugman J (2001) “Brain metaphor and brain theory.”
Additional literature:
Web book Neuroscience: The Organization of the Nervous SystemNeural SystemsThe Subdivisions of the Central Nervous System
PNS (Chapter 1 The brain and behavior and 19 Integration of sensory and motor function)

Hubel DH and Wiesel TN (1959) Receptive fields of single neurones in the cat’s striate cortex. The Journal of Physiology 148, 574–591
DENISE GELLENE David Hubel, Nobel-Winning Scientist, Dies at 87, New York Times

Week 3: 3.3. Methods of study in neuroscience. Sensory, motor and association brain areas. (slides in PDF EN, SK)
Literature: NS (Chapter 1 Mozek a metody zkoumani…)
Videos from the celebration of the 25th anniversary of the introduction of fMRI in cognitive neuroscience in 2016 containing also an explanation of the method
Demo Videos of Visual Cognitive Disordes including from Bob Rafal

Week 4(8): 10.3. Psychology of memory and learning (slides in PDF EN, SK)
Gluck MA, Myers CE (2000) Gateway to Memory. MIT Press. Chapter 2: Introduction
Corkin, S. (2002) What’s new with the amnesic patient H.M.? Nature Reviews Neuroscience 3, 153-160.
Articles related to current controversy about patient H.M.
New York Timesreaction of MIT BCS.
Christopher Nolan (2000) Memento. Quite interesting (action) movie about the man suffering from anterograde amnesia (he will lose the ability to remember anything new in long term)

Week 5(9): 18.3. Vision: Introduction. Perception of brightness, contours, color. BCS/FCS model. Perception of size and distance.  (slides in PDF EN, SK)
Literature: CSAI chapters 12.1, 12.3, 12.5
Web: Flash demo with series of visual illusions and explanations what they tell us about processing of visual information in the brain (from University in Bangore, original link), Large collection of visual illusions IllusionWorks
Grossberg, S. and Todorovic, D. (1988). Neural dynamics of 1-D and 2-D brightness perception: A unified model of classical and recent phenomena.Perception & Psychophysics, 43, 241-277

Week 6(10): 25.3. Hearing and auditory cognition (slides in PDF EN, SK)
Literature: Grantham, D.W. (1995). Spatial hearing and related phenomena. In B.C.J. Moore (ed.), Hearing. Academic: London, pp. 297-345
Hartman, W.M. (1999) How We Localize Sound. Physics Today.
Fechner GT (1860) Elements of psychophysics
Wilson RA a FC Keil (1999) The MIT Encyclopedia of the Cognitive Sciences. Keywords: „Auditory physiology:, „Audition“
Supplementary links:
Video introduction to auditory research our lab
Deutch D (2020) Musical Illusions and Phantom Words. Video presented at 2020 meeting of LA chapter of Acoustical Society of America.
Dr. William Brownell- ‘From Sound to Action Potentials – A Tour of the Inner Ear’ Association for Research in Otolaryngology seminar (abstract).
Auditory mailing-list’s list of CDs and webs with auditory demonstrations and illusions. We have plenty of them in the lab:
CD accompanying the book Brian_Moore__Perceptual_consequences_of_cochlear_damageDiana_Deutsch_Musical_Illusions_And_ParadoxesDuda_Auditory_localization_demonstrationsHoutsma_Auditory_demonstrations (some available here)

Week 7(11): 1.4. Language, psycholinguistics, production and perception of speech. (slides in PDF EN, SK)
Literature: CSAI chapter 6, MITECS keywords Speech processing, RKN chapter 4.
Gick B & Derrick D Aero-tactile integration in speech perception. Nature 462, 502-504.

Week 8(12): 8.4. Attention (slides in PDF EN, SK)
Literature: Pashler HE (1997) Psychology of Attention. MIT Press. Chapter 1: Introduction. Chapter 2: Selective attention.
Behrmann, M. & Haimson, C. (1999) The cognitive neuroscience of visual attention. Curr Opin Neurobiol 9, 158-63
Parasuraman R (2000) The Attentive Brain. Kapitola 1: The attentive brain: Issues and prospects. MIT Press.
Michael Posner on the anatomy of attentional networks – a historical perspective (Youtube video)
Kopčo, N, A Ler, and B Shinn-Cunningham (2001). “Effect of auditory cuing on azimuthal localization accuracy,” J. Acoust. Soc. Am. 109(5), 2377 ( poster in PDF)
Zatorre RJ, Mondor TA and Evans AC (1999) Auditory Attention to Space and Frequency Activates Similar Cerebral Systems. NeuroImage 10:544-554
James W. (1890) The Principles of Psychology. Chapter 11: Attention.
Lavanya Viswanathan and Ennio Mingolla Attention in Depth
Rensink’s demos of the „change blindness“ effect

Phylishin Z (2000) Situating vision in the world. Trends in Cognitive Sciences. 4(5):197-207.
Web: Demos of visual attention from Visual Attention Lab at Rutgers.
DVD demos in the lab: Visual Awareness Demonstrations from Dan Simons lab

Week 9(13) : 15.4. Crossmodal interactions (hearing, vision, touch). (slides in PDF EN, SK)
Literature:
Web: Seeing through Sound.

Talk: Amedi A (2022) Healing the brain via Multisensory technologies and using these technologies to better understand the brain 
Bor et al. (2014) Adults Can Be Trained to Acquire Synesthetic Experiences. Nature Scientific Reports, 4, Article number: 7089
Additional literature: Our paper about crossmodal interactions / ventriloquism effect in humans and apes:
Kopco, N, I-F Lin, BG Shinn-Cunningham, and JM Groh 
(2009). Reference frame of the ventriloquism aftereffect. Journal of Neuroscience, 29(44):13809-13814
Kopčo N, Lokša P, Lin I-F, Groh J, Shinn-Cunningham B (2019). Hemisphere-Specific Properties of the Ventriloquism Aftereffect. Journal of the Acoustical Society of America, 146, EL177 doi.org/10.1121/1.5123176

(Week 14: combined w/ Lecture 9(13)) Other topics of study of brain and mind (consciousness, emotions, motivation, decision making, reasoning)
Literature: Keyword Emotions from Purves et al.: Neuroscience.
PICARD, R. W. (1997) Affective Computing. The MIT Press.
Chapter by M. Dobeš about Cognitive psychology

Schedule of Exams

(individually scheduled with TF)
Week 5: written exam 1 (covering lectures 1-5)
Week 9: written exam 2 (covering lectures 6-9),
submit the project,
finalizing the grading

Useful links (if you find other useful links, you can send them to me)

World organizations: Cognitive neuroscience societyCognitive science societySociety for neuroscienceHuman Brain Mapping, auditory and multimodal: Association for research in otolaryngologyAcoustical Society of AmericaEuropean Acoustics AssociationInternational Multisensory Research Forum
Slovak/czech/central-european related links: Cognitive science at UKom (+ http://www.meicogsci.eu/ with Vienna / BP / Ljublana), Neuroscience at Neurobio institute at SAV KE (also at Institute of social sciences and Institute of expermental physics) KE, Conference Cognition and artificial lifehttp://cognitivescience.cz/Society for cognitive science and philosophy.
Neuroscience in general: facts and figuresmore factsbiophysicsNobel prizessimulator of Goldmann’s equationelectrophysiology,
Hearing: EarLab
Vision: spatiotemporal receptive fields in LGN and V1sensitivity to orientation
Neuroanatomy:  3D anatomy of the brainbrain museumbrain anatomy
Modeling: overview of the simulation softwareGenesis The Virtual BrainTwo Ears
Guide to MATLABOCTAVE (free software compatible with MATLAB): interactive introduction to MATLAB Onramp (click on the image in the section “Learn Interactively”)original documentationvideo Getting startedshort intro in czech languagefrom MIT in english.
Mathematics: statistics (in slovak)MathWorldNumerical recipes
Language hints: Short dictionary of slovak languageMedical dictionary (in czech)English-czech medical dictionary (not always available)
Interviews and popularization lectures: Fresh Air with Oliver Sacks (author of the book The man who mistook his wife for a hat)

OLDER NEWS

..

2022/2/28
– the video of the last lecture is available in the skype group (do not download or share it)
– slides of lecture #3 are available online. The lecture will take place on Thursday. We agreed on starting at 15:40. But, it might be that I will only be able to start at 16:00 (or possibly even later; but that’s unlikely). So, do you prefer to start at 16:00 or shall we move it again to Friday? But now it would have to be in the afternoon, e.g., at 14:00 or later. Which one do you prefer?
– your project proposals are due in Week 3 by the end of the day of the lecture (i.e., Thursday)

2022/2/20
– the video of the last lecture is available in the skype group (do not download or share it)
– slides of lecture #2 are available online. The lecture will again take place on Friday at 7:30 via skype
– afterwards we are planning to return to the Thursday 15:20 time slot, but we might shift it to 15:40 so that you can join from home
– your project proposals are due in Week 3
2022/2/16
First lecture will take place on Friday, 18 Feb at 7:30 via skype (for link see your email)
Slides for lecture 1 is available here.
For various reasons (mainly since I originally had external speakers to cover AI topics that are unable to present their lectures) the class will be focused on Cognitive Science and you will have an opportunity to work on AI topics individually as part of your project within the class.
Specifically:
– there will be 9 lectures focused on Cognitive Science (it will be a selection of the Compuptational & COgnitive Neuroscience lectures (VKN1) lectures from https://pcl.upjs.sk/unv_eng/ – the web also has a Slovak version),
– there will be 2 written exams (midterm and final) scheduled for the weeks 5 and 9 (covering the material in the lectures)
– there are no labs (cvicenia) for AICS, so we will skip the UNV/VKN1 assignments (but, if you want to work on them individually, that is
encouraged. Just let us know and Udbhav will consult you on them/grade them for you)
– you will individually work on one project during the semester. The project options are described below in the section Projects.
The lectures will be in Slovak (unless you prefer them in English), since Udbhav already knows the material. But, your projects will have to be in English so that he can grade them.
You can always write / ask in Slovak.

2022/3/9
– slides of lecture #4 are available online.
– The lecture will again take place tomorrow (Thu) at 15:40-16:10 via skype. We will first finish lecture #3.
– your project proposals were due in Week 3. I haven’t seen emails with them (checking with Udbhav whether he did)
– reminder that: we need to schedule the midterm exam for week 6 (ideally, Mon-Wed; or Fri of week 5)
– we are collecting data in different experiments. If you are interested in being a subject in one or more of them (and earning 5% UIKV class credit per experiment) contact me or Udbhav.

2022/3/9
– slides of lecture #5 are available online.
– The lecture will again take place tomorrow (Thu) at 15:40-16:10 via skype. We will first finish lecture #4.
– your project proposals have been approved. Note that if you are going through the MIT lectures, you should be doing it continuously during the semester, not all at once.
– midterm exam is to take place in the week after lecture 5, and it will cover the content of lectures 1-5 (discuss the day that works with you with Udbhav: ideally, Mon-Wed; or Fri of week 5)
– we are collecting data in different experiments. If you are interested in being a subject in one or more of them (and earning 5% UIKV class credit per experiment) contact me or Udbhav.

2022/3/23
– slides of lecture #6 are available online.
– The lecture will again take place tomorrow (Thu) at 15:40-16:10 via skype.
– your project proposals have been approved. Note that if you are going through the assignments or the MIT lectures, you should be doing it continuously during the semester, not all at once.
– midterm exam is graded. Let me know whether you are fine with me sharing your grading among yourselves.
– we are collecting data in different experiments. If you are interested in being a subject in one or more of them (and earning 5% UIKV class credit per experiment) contact me or Udbhav. Also, ask the people for whom you are a subject to let me know so that I give you the credit.

2022/3/30
– slides of lecture #7 are available online.
– The lecture will take place tomorrow (Thu) at 15:40-16:10 via skype.
– your projects are due in week 9.
– final exam will take place in the week after the last lecture (i.e., week 10). Agree with Udbhav on date/time. Format will be similar to the midterm exam, covering lectures #6-9.
– link with your current grading will be shared via email.
– we are collecting data in different experiments. If you are interested in being a subject in one or more of them (and earning 5% UIKV class credit per experiment) contact me or Udbhav. Also, ask the people for whom you are a subject to let me know so that I give you the credit.

2022/4/6
– slides of lecture #8 are available online.
– The lecture will take place tomorrow (Thu) at 15:40-16:10 via skype.
– your projects are due in week 9.
– final exam will take place in the week after the last lecture (i.e., week 10). Agree with Udbhav on date/time. Format will be similar to the midterm exam, covering lectures #6-9.
– link with your current grading was shared via email.
– we are collecting data in different experiments. Alternative to getting a credit is to getting paid 4EUR/hr as a stipend (for any student in Faculty of Science). If you are interested in being a subject in one or more of them (and earning 5% UIKV class credit per experiment) contact me or Udbhav. Also, ask the people for whom you are a subject to let me know so that I give you the credit.