2.04: Visual Training Flashcards
T/F: Lipreading and Speechreading are the same.
False.
The process of using visual signal for recognizing speech
Lipreading
Speech recognition using BOTH auditory and visual cues; any available cues are used
Speechreading
Besides lip movement, what are some visual cues used in speechreading?
Facial expressions
Gestures
Body Postures
Contextual Cues
5 Factors that Influence Lipreading
Visibility Rapidity Coarticualtion & Stress Visemes a & Homophones (sparse/dense lexical neighborhood) Talker Effects
What percentage of speech sounds are not visible on the mouth?
60%
What percentage of words are recognized when lipreading?
20%
Which features are not visible at all?
Voicing, /h/
Which phonological features are most visible?
labials, lip rounding, interdentals, labiodentals
Which phonological features are less visible?
vowels, silibants, velars, palatals
How fast is typical speech?
150-250 wpm, 4-7 syllables per sec, 15 phonemes per sec
How fast is the eye able to distinguish mouth movements?
9-10 discrete mouth movements per second
Sounds may look different depending on ________________ and _______________ contexts.
phonetic; linguistic
coarticulation & stress
Group of speech sounds that look identical on the lips (and give examples)
Visemes (/b/, /m/, /p/)
Group of words that look the same on the mouth
Homophenes
What percentage of English words are homophenes?
40%-60%
Speaking characteristics that vary from one person to the next
Talker Effects
What are some talker effects?
Regional Accents
Mouth/Lip Movement
Expressiveness
With speechreading, the auditory component provides what information?
voicing
envelope
manner
With speechreading, the visual component provides what information?
place of articulation
emotions
message type
Which phonemes are typically most difficult to hear and why?
Consonants (high frequency & low intensity)
Voiceless phonemes
This occurs when information from the auditory and the visual signal combine to form a unified percept
Audio-Visual Integration
What are the stages of Audio-Visual Integration?
Perceive auditory/visual signal
Integrate two signals
Discrete phonetic/lexical decisions
Words that “compete” as a match in speechreading
Members of a Lexical Neighborhood