Schedule

Topics more than two weeks ahead are PRELIMINARY. Details will change

Note that links for slides for future classes go to a placeholder (or may go to a previous semester). If I haven’t put up the slides for a class we’ve had, remind me.

Jurafsky & Martin= J&M If there’s no link, the chapter is available on Latte

Dates Topic Reading Assignments
01/14
Overview of Speech and the Industry NLP Commercialization in the past 25 years Read and annotate Makhoul and Schwartz paper
01/17
Speech Recognizer Architecture Kaldi Tutorial (will be assigning specific sections later)  
01/21

Kaldi Tutorial

 

  PA1: Kaldi Y/N tutorial, due 1/28
01/24
Phonetics and Front End Feature Extraction J&M Phonetics,   J&M Ch. 9.1, 9.3
CMU Spectograms, Cepstrum, etc
Kaldi compiled
01/28
WFSTs; OpenFST QuickTour Speech Recognition with WFST, Mohri
Weighted AutomataOpen FST Tutorial; WFSTs in Speech Recognition, Hannemann
Kaldi Y/N tutorial due
01/31
Language Modeling; Perplexity J&M Language Modeling PA2: Statistic Language Model, due 2/11
02/04
More Perplexity, Bash SRILM site; SRILM 2001; SRILM at 16  
02/07
HMMs and Viterbi J&M HMMs, Andrew Moore, CMU, HMM Tutorial,Eisner paper, Eisner spreadsheet  
02/11
More Kaldi, bash, …   SLM due
02/14
GMMs & OUCH; Pronunciation modeling

J&M Ch 7 

OUCH:  Don’t multiply lightly

Kaldi RM Quiz (due 2/25) & PA3 (due 2/28)
02/17
Winter Break    
02/21
Winter Break    
02/25
Evaluating Speech Reco; Jurafsky: Chatbots Jurafsky, Dialog and Chatbots Kaldi RM quiz due
02/28
“Advanced” Dialog; Dialog Toolkits Comparison AT&T Spoken Dialog Kaldi RM programming due
03/03
Building with DialogFlow; MultiWoz data set DialogFlow NLP Tool  
03/06
Working with the data.   Speech Final Quiz due
03/10

Designing DF agents

   
03/13
Programming DF back-end   PA4: Dialog application 
03/17
Discourse and Dialog   Dialog application first check-in
03/20
     
03/24
No class    
03/27

Dialogflow  application presentations

  Dialog application due
03/31
Sounding Board: A Socialbot Alexa Prize Winner University of Washington; AlexaPrize 2017 & 2018 Select paper for research
04/03
Dialog State Tracking   Final project selection
04/07
No class    
04/10
No class    
04/14
     
04/17
Class presentations    
04/21
Class presentations    
04/24
Dialog research    
04/28
Dialog research    
TBD Final Project Presentation   Group Reflections