5 The Hearing Brain and Voice Perception Flashcards

(79 cards)

1
Q

what does voice reveal about you

A

Voice hints at how social you are - introverts and extroverts
Your trustworthiness - deep pitch at end of word in men
Higher pitch at end of word in woman
When saying hello
Trust worthy
Stressed - vocal cords tighten - disorganised speech
Speaking slowly - in control - indicator keep emotional in check

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

what is voice dependent on

A

Voice is dependent on vocal tract
Parameters of voice dependent on anatomy
Dependent on physical state - vocal tract vibrates differently

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

study about voice revealing a lot about you

A

N = 320 participants rated social traits on “hello” spoken by 64 people
High consistency

If voices convey no information, ratings on these social traits would be random.

But Cronbach Alpha (a measure for interrater agreeableness) suggests that people consistently agree on whether a voice sounds attractive or confident.
We seem to associate voices with social traits on a collective level.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Many social traits are related and can be mapped to two principle
components, what are they?

A

In both genders,

The 1st Principle Component is highly correlated with Trustworthiness;

The 2nd Principle Component is highly correlated with Dominance.

they are independent of eachother

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

what can a hello tell us

A

From a simple “hello” we can quickly assess the speaker’s personality and decide whether and how to approach them.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

how are voices transmitted

A

• Voices are transmitted via vibrations of the air.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

what are the 3 parameters voices can be decribed as

A

pitch
intensity
tempo

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

what is pitch

A

high or low
fundamental frequency

Female or male
Stressed or sad
Vibrations of energy 
Vibrates a lot - higher frequency - high pitch
Vibrates slowly - low
How fast energy oscillates
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

pitch - vibrates alot

A

high voice

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

pitch - vibrates slow

A

low voice

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

what is intensity

A

amplitude
How far the peaks and troughs are in the voice
Loud - high

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

intenisty- loud

A

high peaks low troughs

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

intensity - quiet

A

small peaks and troughs

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

what is tempo

A

speed

how fast you talk

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

when you enjoy something

A

pitch up
intensity down
tempo down

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

when you experience elation

A

pitch up
intensity up
tempo down

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

when experience sadness

A

pitch down
intensity down
tempo down

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

when experience grief

A

pitch up
intensity up
tempo up

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

different emotions are experiences differently

A

distinct acoustic profiles

Software to analyse voice
Different emotions have different acoustic profiles
Elations increase different amount in comparison to grievances

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

can all emotions be reliably dinstinguished from each other

A

no

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

german people speaking - can the vocal emotional expressions be recognised by people from a different culture?

A

Record saying pseudosentences in different emotions
Emotion is not very clearly distinguished from other emotions
Their performance in detecting German emotions are low in comparison to European counterparts
Measures how consistent they’ve judged these emotions between pps
Indonesia - confused by German emotions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

Indonesian and german

A

Some vocal emotions are shared cross cultures

Others may be influenced by culture- and language-specific factors

joy is most ambiguous emotion

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

what do voices convey information

A

Voices convey important socio-emotional information

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

can information be accurately decoded by the brain

A

This information can be accurately decoded by the brain:
• There must be specialised neural architecture to process voice
• And different processing pathways for different aspects of voice

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
fMRI assumptions
Increased neural activity needs more oxygen and glucose fMRI detects changes in blood oxygen levels, which indirectly reflects the changes in neural activity fMRI allows us to study cognitive activity in vivo, without causing any harm to the brain based on assumption when brain working hard need more oxygen and glucose
26
what does the temporal voice area (TVA) show in voice perception
Listening to voices vs. non-vocal sounds elicits increased bilateral neural activity in the temporal cortices It provides objective evidence that there are brain regions dedicated for voice processing
27
what is neural adaptation in speaker adaptation
Neural Adaptation: a gradual decrease over time in the responsiveness of the sensory system to a constant stimulus Some brain regions will adapt to repeating speaker identity in the voice some brain areas will adapt to repeating syllable in the voice belin, zatorre , 2003
28
how to undersrand which part of brain responds to speaker identity
Understands which part of brain area responds to speaker identity Repeat over and over - brain gets adapted to it and it no longer bothers you - e.g. constant fan Exhaust the responsiveness of sensory system Speaker identity - respond less when same speaker Repeat syllables - brain area that responds to syllables will adapt - different speakers but same syllables
29
which brain area adapts to the repeating speaker identity in the voice
Speaker identity Right side of brain - anterior part of temporal lobe Part of the brain that responds to the person
30
what did grandjean et al 2005 find
participants pay attention to the angry voices and the left audio right voice area selectivey responses to angry speech
31
Are the Voice Areas necessary for voice processing?
Correlation is not causation cannot say whether brain area is causally libked to voice processing
32
Is voice processing correlated with or caused by the activity in the Temporal Voice Areas?
We can test the effects of a disruption to the Voice Areas on the performance of voice recognition using Transcranial Magnetic Stimulation (TMS)
33
Are the Voice Areas necessary for voice processing- right temporal ?
Right temporal TMS impairs voice detection TMS to individual Voice Areas impairs accuracy in voice/nonvoice discrimination compared to TMS to the Control Site Low-level loudness discrimination is not affected by TMS to the Voice Areas.
34
what isnt affected bt TMS in voice areas
Low-level loudness discrimination is not affected by TMS to the Voice Areas.
35
what does TMS to individual voice areas impair
TMS to individual Voice Areas impairs accuracy in voice/nonvoice discrimination compared to TMS to the Control Site
36
what can voices tell us
• Voices can tell us who you are and how you feel • Speaking identity and vocal emotion are processed in different regions of the Temporal Voice Areas.
37
where are speaking identities and vocal emotions processed
• Speaking identity and vocal emotion are processed in different regions of the Temporal Voice Areas.
38
top down processing in speech perception
Speech is a continuous signal that does not have punctuation or spaces brain can extract linguistic units even when speech is a continuous signal
39
what is top down processing in speech perception
Focuses on useful info while suppressing the noise
40
what is bottom up processing in speech perception
takes in all external stimuli
41
top down processing in brain processing
Brain - brain is predicting and directing behaviour in terms of how you interact with the environment - use what you know before about information from outside
42
vocoded speech demonstrating speech perception
Natural full voice - energy distribution into different bands - stripes coherent within different roles Speech perception - eliminate all other noises - top down processing Brain focuses on particular voice and suppresses others
43
is speech processing left lateralised
yes
44
brocas patients
two patients cant speak Both patients - left frontal part of brain - damage Important in speech production
45
wernikes patient
cant understand speech Wernickes - cannot understand Speech comprehension problem Left posterior part of brain which connects temporal and parietal lobe
46
speech
spectral info - full | intellibigibility- full
47
rotated speech
spectral info - full intelligiblity - bad mirror image of first one preserves energy levels but inverted
48
vocoded speech
intelligible spectral - bad intelligible - partial
49
rotated vocoded speech
spectral info - bad | intelligibility - bad
50
what does wernikes and brocas produce
double dissociation
51
what are the findings of vocoded intellibible speech in left temporal regions
Left temporal regions responded to intelligible speech more than rotated, unintelligible speech.
52
what are the findings of vocoded intellibible speech in right temporal regions
Right temporal regions responded to spectrally rich speech more than vocoded speech.
53
what is the acoustic uncertainty principle
time - trade off - frequecy less precise in time more precise in frequency more precise in time less precise in frewquency
54
is left side more specialised in processing temporal info
yes
55
is right slide more specialised in processing pitch and spectral
yes
56
in music whats more important
spectral/pitch more important than temporal
57
what more important in speech
temporal more important than spectral Doesn’t matter whether female stressed Only matters syllables, pauses whether makes sense
58
what processing does speech recognition depend on
top down processes
59
where is speech primarily processed
in the left hemisphere
60
what are right temporal regions more specialised in processing
time information
61
right temporal areas are more specialised in processing
spectral information
62
what is the mcgurk effect
ba da va Sent to temporal lobe trying to predict the sound coming out Brain trying to predict
63
if percieving ka and hearing pa
Combine the two - engage in auditory the most but also the motor region Predict what the man is trying to say - motor system to simulate what man is trying to say increased involvement of motor system in percieving mcgurk effects
64
is speech perception complemented by speech production
yes
65
How does the brain segment continuous speech signal into separate syllables and words?
Neural oscillations for speech segmentation brain oscillations concide with the speed of talking
66
most human languages have the syballic rate of
4.5hz
67
Speech perception is informed by top-down predictions from the motor system (predicting what the speech is likely to be)
true
68
The motor system may modulate neural oscillations which facilitate the segmentation of speech signal
true
69
what is the optimal oscilation reflecting the average syllabic rate
Optimal oscillations = 4.5Hz which reflects the average syllabic rate across human languages
70
speech is processed in a network what are the two pathways
Speech is processed in a network • Dorsal “how” pathway • Ventral “what” pathway
71
what is the dorsal pathway
how
72
what is the ventral pathway
what
73
auditory motor connectivity
mcgurk illusions | neural oscillations
74
angular gyrus
phonological buffer
75
percieved gestures
posterior STS
76
heschls gyrus
primary auditory cortex
77
speech recognition
anterior STS
78
semantic knowledge
temporal pole
79
brocas area
planning of speech production