Information-Theoretic Models of Language Processing

1. Course Information

Lecture times MTWRF 1-2:30pm
Lecture Location MWRF: SBSG 1517; T: SSPB 1222

2. Instructor Information

3. Course Description

Human language processing is the process by which a person transforms an input linguistic signal (audio, text, etc.) into a representation of meaning during comprehension, or transforms a representation of meaning into linguistic output during production. Information theory is the mathematical theory of information and communication. We will develop simple information-theoretic models that can explain some aspects of human language comprehension, with a focus on explaining eyetracking data in which eye movements are taken as an index of the mental processes that comprehenders are performing.

4. Course Format

Course time will be spent on lectures, discussions, exercises, and demos. You will follow along and perform small group exercises in CoLab notebooks.

5. Intended audience

This course is intended for linguists and cognitive scientists of all backgrounds. The course assumes familiarity with the Python programming language, but only minimal familiarity with statistics, probability, information theory, etc.

6. Schedule (subject to modification)

Day Topic Notebook Link
8/1 Information Theory link
8/2 Word Frequencies link
8/3 Eyetracking Data link
8/4 Probabilistic Language Models link
8/5 Surprisal Theory link

7. Resources

Author: Richard Futrell

Created: 2022-08-05 Fri 10:20