LING 592B: Speech Processing / FALL 2021

This course is a mixed undergraduate/graduate course that focuses on the following UMass Linguistics departmental student learning objectives: ability to reason analytically about language, basic quantitative and computational competence in language research, ability to communicate about language, and ability to work as an effective member of a team. The purpose of this course is for you to:

Calendar

Current Week

Week Date Topic Class HW to do
12 Tu 11/16 CNNs
Th 11/18 Research questions slides Go through Mandarin tone slides and papers, explore data

Upcoming Weeks (tentative)

Week Date Topic Class HW to do
13 Tu 11/23
Th 11/25 Thanksgiving break (no school)
14 Tu 11/30 Final project presentations
Th 12/02
15 Tu 12/07

Past Weeks

Week Date Topic Class HW to do
01 Th 09/02 Intro RQ, syllabus, slides Due by class Tu 09/07: Read syllabus, install Python 3/Anaconda (instructions), install latest version of Praat, sign up for Github account, work through the version control with Git tutorial (make sure you follow the setup instructions) and the introduction sequence of learn git branching interactive tutorial and make sure you can work with the various Github repositories for class
02 Tu 09/07 Digital signals, sampling RQ, slides, nb
Th 09/09 RQ, nb PS1 due Th 09/18 11:59PM
03 Tu 09/14 The time domain; Fourier synthesis nb, RQs in nb Work on PS1 due 09/16 11:59pm
Th 09/16 nb, RQs in nb, slides Work through Who is Fourier? Ch. 1-3 or Ch.1 of Osgood (2007), due Tu 09/21, PS2 due 09/23 11:59pm
04 Tu 09/21 Specta, Fourier synthesis, aliasing RQs, slides, nb Keep working on PS2 due 09/23 11:59pm
Th 09/23 Moving towards Fourier transform RQs: slides 20-22, slides (updated from Tues!), nb Work through this interactive Fourier Transform tutorial for a review and watch 3 Blue 1 Brown's Fourier Transform video (you can also watch 3 Blue 1 Brown's Fourier series video for a slightly different perspective on the Fourier series)
05 Tu 09/28 The frequency domain; computing spectra and spectrograms, cepstrum RQs: Finish Additive Synthesis exercise (slide 8 from slides today) and also do exercise on re-expressing sinusoids in terms of complex exponentials (Slide 38 from today), slides, nb
Th 09/30 Work on PS3 due 10/7 11:59PM
06 Tu 10/05 F0 detection, windowing, convolution RQ in slides (slide 3), slides Work on PS3 due 10/7 11:59PM
Th 10/07 nb, RQs in notebook HW: Watch Alex Acero Deep Learning and Speech recognition overview talk and read Jurafsky and Martin chapter on HMMs by class time next Thursday, 10/14, leave questions/comments in Slack hw channel
07 Tu 10/12 The cepstrum RQs in slides, nb HW: Watch Alex Acero Deep Learning and Speech recognition overview talk and read Jurafsky and Martin chapter on HMMs by class time next Thursday, 10/14, leave questions/comments in Slack hw channel
Th 10/14 Connecting speech perception and acoustic feature extraction Updated slides and nb from Tues, some demo experiments in lieu of RQs PS4 due 10/28 11:59PM
08 Tu 10/19 Acoustic feature extraction and auditory connections Work on PS4 due 10/28 11:59PM
Th 10/21 Intro to neural nets: the perceptron nb
09 Tu 10/26 Finish up perceptron, neural nets intro nb Work on PS4 due 10/28 11:59PM
Th 10/28 Finite state transducers
10 Tu 11/02 More on HMMs, FSTs slides Grokking backprop (see slack)
Th 11/04 Generative adversial networks and convolutional neural networks for sound change (Cerys's research project)
11 Tu 11/09 Convolutional neural networks slides
Th 11/11 Veteran's Day (no school)

Selected Resources

Fourier transform

Good introductory texts

Classic more advanced texts

Neural nets

Audio processing in python

Data processing

Signal processing