Audiovisual speech perception and Speech reading Flashcards
Lipreading:Definitions
Lipreading: A person relies only on the visual signal from the person’s face to recognize speech
Speechreading: Definitions
Speechreading: The person attends to both visual and auditory cues as well as the talkers facial expressions and gestures
Speechreading
Important for communication, even with normal hearing
fMRI studies show that when trying to recognize speech using visual signal only, the auditory cortex of the brain lights up
People with hearing loss rely more on the visual signal for speech recognition than people with normal hearing
The greater the hearing loss, the more the person will rely on visual information
This is what most people do
Use whatever audio you have and use some visual cues as well
Lipreading Performance
Huge range in performance
Why are some people better at lipreading than others?
Variables that do not have predictive power
Variables that do have predictive power
Variables that may or may not
No audio just lipreading
Huge range of performance
There are predictors of who will be good and who won’t
Variables: No predictive power
Performance can not be predicted by…
Intelligence
Educational achievement
Presence of and duration of acquired hearing loss
Age at hearing loss onset
Gender
SES
Variables: DO Have Predictive power
Cognitive Skills
Visual word decoding
Working memory
Lexical identification speech
Phonological processing
Verbal inference making
Age
Younger adults vs. older adults?
Type of hearing loss
These variable do have predictive power in who will be a better lipreader
Audiovisual integration
The ability to integrate across modalities is a principal factor contributing to individual differences in visual enhancement (Sommers & Sawyer, 2001).
Some thought there’s a stage where integration occurs
Five models of audio-visual integration in speech perception:
Lipreading shifts from
Eyes shift from eyes, nose and mouth
Depends on what information they were seeking
Ex: Looking for prosodic cues- read upper half of face
Most people recognize 20% of words they see
Lipreading Difficulties
Visibility of Sounds
Some speech sounds are not associated with mouth movements
Rapidity of Speech
Sometimes too fast for the eye to see
Coarticulation and stress effects
Appearance changes based on what’s on either side of the word, or stressed
Visemes and homophones
Many words/sounds appear the same on the face
Talker effects
Visual settings
Often the visual conditions are far from being optimal.
Lipreading is hard because….
Not all speech sounds are associated with mouth movements
We talk fast
We blend our words together
A lot of the sounds we produce look the same on the lips (b and p)
Effects of Residual Hearing
Every little bit helps!
Even minimal residual hearing can….
Extract suprasegmentals
Can give info about syllabic structure
Voicing
Semantics
Factors that Affect Speechreading
Talker
Message
Speechreading environment and communication situation
Speechreader
The Talker
Facial Expressions
Diction
Body language
Speech rate
Familiarity to speechreader
Accent
Facial characteristics
Speech prosody
Objects in or over the mouth
The talker
Someone that is monotone is really hard for a person with an HA to interpret what is going on
Body language yields insight into how they feel
The faster the talker the harder it is for a person to lipread
Speech prosody someone monotone is hard to lipread
Objects in or over the mouth gum, hands
Talk loud and clear (CLEAR SPEECH)
The Message
Length
Syntactic complexity
Frequency of word usage
Context
The message one is trying to convey
Length (no is easy to lipread)
Basic sentences are easy to understand cat went outside
Calculus, physics, run on sentences are hard to understand
Context clues
Environment
Viewing angle
Distance
Background noise
Room acoustics
Distractions
Environment
Not a lot of background noise
Room acoustics
Distance from speaker as well as angle
Think of a classroom and where a student should be seated in the classroom if they have an HL
Speech Reader
Lipreading skill
Residual hearing
Use of appropriate amplification
Stress profile
Attentiveness
Fatigue
Motivation to understand
Language skills
Uncorrected vision impairment
Person receiving information
Some people are better than others
The more residual hearing the better
The person needs the appropriate amplification that is programed correctly
Attentiveness
Is the person providing eye-contact
Fatigue
If you are tired you will speech read worse
A person with a vision loss will do a lot worse
