Week 10- Synaesthesia & Idiosyncratic perception Flashcards

1
Q

First documented case of synaesthesia

A

-Georg Tobias Ludwig Sachs
-Born in modern day Austria (1786)
-Was an albino who was writing a doctorate about his experiences
-In one chapter he goes off topic and starts talking about synaesthesia specifically that ideas appear in colours to him and that things like numbers, colours, days of the week appear in colours.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Early definitions of synaesthesia

A

-Term was coined by French neurophysiologist Vulpian in 1866 who referred to it as the melding of the senses

-Galton (1881) called it “visions of sane persons.”

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What else other than labelling synaesthesia as “visions of sane persons” did Galton contribute?

A

-Noted it was seen in “ a certain portion of the population”

-Noted in ran in families

Described three types for synaesthesia:
-sound-colour associations
-number/letter- colour associations
-Number forms

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What are number forms

A

-An automatic, involuntary arrangement of numbers into spatial dimensions

-Galton called them “visualized numerals” i.e. people experience numbers not just in sequences but each actually occupying space in an arrangement (think back to the slide diagram)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Controversary with synaesthesia in the early days

A

-Often met with skepticism

-Being thought it was another kind of hallucination, an overactive imagination or potentially that individuals were just making up their experiences

-Wasn’t a subject of serious scientific study for most of the 20th century

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Explosion of interest of synaesthesia research

A

-Midway through the 20th century there was a huge rise in public awareness for synaesthesia as people began to share their experiences through books

-The first tests of phenomenology of synaesthesia (e.g. content, specificity and constancy of synaesthetic experiences) then occurred in the later part of the 20th century

-These occurred as people became interested in the link between creativity and cognitive ability and the advent of brain imaging technology (e.g. fMRI) allowed for such research.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Phenomenology

A

Study of consciousness or human experience

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What is synaesthesia?

A

-A “joining of the senses”

-When one sensory stimulus evokes two or more specific, consistent, involuntary, concurrent perceptual experiences

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

In synaesthesia what are the words used to describe the trigger stimulus and the response stimulus?

A

-Trigger stimulus: inducer
-Response stimulus: concurrent

So an inducer will trigger the concurrent
e.g. if shapes elicit tastes for you then shapes are the inducer in this case and taste the concurrent

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What portion of the population have synaesthesia?

A

0.1-4% of the population (would put more faith in the higher end of that scale)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Which gender experiences more synaesthesia?

A

Women > men [but range 1:1 to 6:1]

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Why is there so much variability in population estimates of synaesthesia and across genders?

A

-Traditionally has been a lot of stigma with synaesthesia so people not wanting to come forward and accept the ‘label’

  • Response bias has reduced as stigma has decreased.

-Difficulties in defining synaesthesia makes drawing the line of what counts as synaesthesia hard

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Is synaesthesia purely congentially?

A

-Synaesthesia often runs and families and seems to be congenital but not always….

  • ‘adventitious synaesthesia’ e.g. mediation, sensory deprivation, drugs

-‘induced synaesthesia’

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Common types of synaesthesia

A

Grapheme to colour
tone to colour (chromesthesia)
taste to touch
visual motion to sound

Note: always written in the format inducer to concurrent

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What is a grapheme?

A

-A number or letter

Grapheme to colour is the most common type of synaesthesia by far!

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Bidirectional synaesthesia? Example?

A

-Usually the relationship between the inducer and concurrent is unidirectional i.e. the inducer elicits the concurrent

-However, there are cases where the relationship between the inducer and concurrent can go both ways in the same individual (indicated by a double headed arrow)

-Example:
lexical <~> gustatory

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Kandinsky

A

-Russian artist whose paintings were knowing as being an ‘orchestra of colour’

-Gave vivid accounts of his synaesthesia in letters

-Had chromesthesia (i.e. tone to colour synaesthesia) that appeared to be bidirectional

-An AI has been made to mimick the experience of a Kandinsky painting as described by him (writings, colour theories etc.). Although giving the subjectivity of qualia this will never be entirely accurate.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Synaesthesia pairings

A

-Pairings can be highly individualized (specific) & consistent throughout life

-May be:
1) completely arbitrary e.g. 7= light blue with a nice, calm personality
2) semantically influenced e.g. Barbara elicits rhubarb
3) heightened levels of common cross-modal associations e.g. low-pitch sounds elicit darker colours

-Pairings are concurrent e.g. if a shape triggers a sound, both are experienced. Because of this depending on the paring experiences can overlay: for example, if the number 7 induces blue, but I write it in grey with pencil then an individual would see both the grey 7 and the blue 7 ‘overtop’.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Development of Synaesthesia? Is it something you are born with or acquire?

A

-Could be learned by early childhood experience

An example of this is the fridge magnets (Withhold & Winawer, 2006, 2013):

-There was a popular fridge magnet set that had every 6 letters with a particular pattern of colours and then this repeated again and again for the whole alphabet.
-The idea is that people who learnt to read with this set may have deep ingrained associations between certain colours and certain letters.
-These individuals may have gone on to develop grapheme- colour synaesthesia
-Interestingly studies have found that there is a high portion of grapheme-colour synaesthetes that report learning to read with this fridge magnet set and can even present it as evidence!
-There is also lots of overlap between the colours they see for certain letters and the actual fridge magnet colours. In 2015, a study of graheme-colour synaesthetes found that 15% have experiences that highly align with the magnet set.

GUY LOVES THIS STORY IT’S “HIS FAVOURITE STORY IN SCIENCE” SO EXPECT TO BE ASKED ABOUT IT

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Association learning in synaesthesia

A

-Remember semantically influence synaesthesia
e.g. Barbara elicts rhubarb

-Pairings are very seldom random. For instance, high-frequency graphemes pair with high-frequency colours (A> red). And tone-colour pairings frequently associate based on scales (e.g. low-pitch =dark colour, high-pitch= light colour)

-Semantic associations must be learnt and other non-random parings are likely shaped by experience. These examples therefore, provide further evidence (aside from the fridge magnets) that synaesthesia may not be purely congenital/ genetic in nature.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Is Synaesthesia just association learning?

A

-Stories like the fridge magnets have lead to people questioning the legitimacy of the synaesthetic experience i.e. Is not just learned associations?
Couldn’t we all do that?

-If this is true then why do people report vivid qualia? They report a sensory component (seeing/ hearing/ tasting) the concurrent beyond just simply picturing or thinking it.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

Important distinction: associative and projective synaesthesia

A

-Some people with synaesthesia report seeing a concurrent colour as “floating in their mind’s eye” = associative synaesthesia

-Others report the concurrent as “projected onto the inducer” = projective synaesthesia
(for example, think about the number 7 drawn in grey with the blue overlaid like in the lecture slides)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

Bouba- Kiki effect: hints that synaesthesia isn’t entirely learned

A

-Present shapes and ask which is “Bouba” and which is “Kiki”

-Over 95% will identify the curvy shape as “Bouba” and the point shape as “Kiki”.

-This effect starts in infancy and is seen across cultures. Indicating a predisposition to sound-shape correspondence

-This is not the same as synaesthesia of course but what it is demonstrating is that we might have a predisposition for making certain associations

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

Further evidence for a predisposition to certain associations

A

-Bouba-Kiki effect
-People with/ without grapheme-colour synaesthesia tend to be biased when making letter-colour associations e.g. a=red, b=blue, c= yellow

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

Colour blindness: evidence against experience driving synaesthesia

A

-Grapheme-colour blindness in a congenitally “colour-blind person”

-Music-colour synaesthesia in a congenitally “colour-blind person”

-No experience of colour!

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

Brain imagining and synaesthesia

A

-PET, fMRI

-Paulesu et al. (1995): blindfolded synaesthetic participants presented with spoken words… activation of speech areas AND visual cortex (Not seen in controls)

-Nunn et al. (2002): present grapheme, get activity in V4 and V8 (again, not in controls). Note V4= colour perception, V8= grapheme perception

-Both of these are evidence for a sensory basis of synaesthesia (i.e. additional wiring in the brain triggering concurrent sensory experience)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

Brain electrophysiology and synaesthesia

A

-Beeli et al. (2008) looked at “event-related potentials” measurements of brain electrical responses to a stimulus

-ERP seen in V4 100-150ms after seeing a grapheme or hearing a sound- far too fast for language processing (> 300ms)

-Again consistent with a sensory basis to synaesthesia

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
28
Q

Evidence of synaesthesia: psychophysics

A

-Several ways of looking at altered processing via reaction times

e.g. A synaesthetic Stroop test: get someone with grapheme-colour synaesthesia to say the ink colour of a number. They will be slower if this colour is incongruent with their concurrent perception as will see two colours (the concurrent on top of the original ink colour). Will be slower than control!

e.g. Perceptual grouping: What shape are the 2s arranged in? Grapheme-colour synesthete scan use the evoked colour differences to rapidly group and segregate the 2s from the 5s and distinguish the Gestalt triangle. Will be faster than control!

-Both of these are consistent with a sensory basis in synaesthesia

-NOTE: Only for projective not associative. There will be much less of an effect on response times for associative synaesthesia.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
29
Q

Why is the evidence for Synaesthesia controversial?

A

-Even with imaging, electrophysiology and psychophysics you are still matching activity/ performance with a subjective self- report measure

-Because of this can’t infer causality i.e. can’t know whether the performance being observed is linked to synaesthetic experience

-Additionally, still no evidence of perceiving versus use of imagery versus neither

-Role of attention? (e.g. colours only appear after attending to grapheme- psychophysics experiments reflect improved attention?)

-Role of motivation? (trying to prove that you have synaesthesia so maybe more motivated to do well in tasks like the perceptual grouping task and so increased performance is not related to synaesthetic experience)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
30
Q

Synaesthetic Stroop Test

A

get someone with grapheme-colour synaesthesia to say the ink colour of a number. They will be slower if this colour is incongruent with their concurrent perception as will see two colours (the concurrent on top of the original ink colour). Will be slower than control!

ONLY PROJECTIVE

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
31
Q

Perceptual Grouping

A

What shape are the 2s arranged in? Grapheme-colour synesthete scan use the evoked colour differences to rapidly group and segregate the 2s from the 5s and distinguish the Gestalt triangle. Will be faster than control!

ONLY PROJECTIVE

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
32
Q

Synaesthesia : How does it happen?

A

-One incoming sensory stimuli needs to result in coordinated neural activity in two (or more) cortical regions

Two hypothesis for how this occurs….
-Anatomically connected in some people but not in others (cross-activation hypothesis)
-Anatomically connected in everyone but usually inhibited, but in certain people there is disinhibition (disinhibition hypothesis).

33
Q

Cross-activation hypothesis

A

-For synaesthesia to occur one incoming sensory stimuli needs to result in coordinated neural activity in two (or more) cortical regions

-In the cross-activation hypothesis these regions are anatomically connected in some people but not in others i.e. some people have the ability for synaesthesia and others don’t.

34
Q

Disinhibition hypotheiss

A

-For synaesthesia to occur one incoming sensory stimuli needs to result in coordinated neural activity in two (or more) cortical regions

-In the disinhibition hypothesis these regions are anatomically connected in everyone but usually inhibited, but in certain people there is disinhibition (disinhibition hypothesis). This takes the stance that anyone has the ‘potential’ for synaesthesia.

35
Q

Support for the cross-activation hypothesis?

A

-Grapheme & colour areas (V4 & V8) both lie in fusiform gyrus: greater structural connectivity in this area for individuals with grapheme-colour synaesthesia (note: only for projective)

-Also, greater connectivity between auditory & visual areas in music-colour synaesthesia

-Hanggi et al. (2011) in grapheme-colour synaesthesia there is enhanced connectivity within and between many regions i.e. increased connectivity is not just between inducer (V8)/ concurrent (V4) -related areas. Implies that there is general ‘over-connectivity in synaesthetic brains.

36
Q

Why might there be hyperconnectivity in the brain of someone with synaesthesia?

A

-Maybe lack of pruning during the critical period?

37
Q

Example of pruning during the critical period? What is the term for this?

A

-Closure of phoneme libraries in infancy

-Term: “Perceptual narrowing” - basic idea is if we don’t use it, we lose it! Many phoneme discriminations are eliminated during infancy, at the same time we are “pruning” neural connections. Connections that are simulated through language exposure are strengthened and those rarely stimulated are pruned away.

38
Q

What effect would a lack of pruning have on the phoneme libraries of those with synaesthesia?

A

-If synaesthesia= less pruning, should also see less perceptual narrowing (i.e. able to make discriminations that would have been lost in a non-synaesthetic population)

-Maurer et al. (2020): ability to discern non-native phonemes lost at 6-8 months.

-Adults with synaesthesia outperform non-synaesthetic controls at discrimination these sounds: due to residual cortical connectivity? (support for the cross-activation hypothesis).

39
Q

Support for the disinhibition hypothesis

A

-Adventitious and induced amnesia i.e. that everyone has the capability of synaesthesia

-Studies showing a role for the parietal cortex (an integrator/ association area). e.g. Colizoli et al. (2017): training with coloured letters impairs performance on synaesthetic Stroop test and increases activity of parietal cortex after presenting inducer.

-If the parietal cortex is invovled then synaesthesia cannot be soley due to cross-activation of sensory cortices

40
Q

How does the disinhibition hypothesis work?

A

-The idea is that activation of the concurrent-related brain areas is caused by the disinhibition of feedback to these areas from a “multisensory” area e.g. the parietal cortex.

-No synaesthesia= only one sensory cortex active

-Synaesthesia= parietal cortex feeds back to concurrently activate 2 or more areas.

41
Q

Neufeld et al. (2012)
fMRI study of auditory-visual synthaesia (chromesthesia)

A

-fMRI study of auditory-visual synaesthesia (aka chromesthesia)

-NO differences in connectivity of AC and visual areas compared to controls (i.e. not evidence of cross-activation)

-Instead, evidence of increased connectivity between left inferior parietal cortex with the left primary auditory and right primary visual cortex (supports disinhibition hypothesis as it appears that the parietal cortex is feeding back into both regions at the same time!)

42
Q

Could both the cross-activation and disinhibition hypotheses be correct?

A

-One could explain projective synaesthesia (cross-activation)

-One could explain associative synaesthesia (disinhibition)

-Or alternatively could cross-activation be “within modality” (e.g. grapheme-colour) but disinhibition be “between modality’?

-Maybe different forms of synaesthesia rely on both mechanism but to varying degrees?

43
Q

Is evidence for a sensory basis to synaesthesia for both projective and associative?

A

Only projective

44
Q

Synaesthesia and mental imagery

A

-Is associative synaesthesia really synaesthetic or is it just a form of mental imagery?

-Mental imagery is when you conjure an imagine in your head of something e.g. close your eyes and picture a banana.

-Mental imagery in lay mans terms = imagining

45
Q

Scientific definition of mental imagery

A

Perceptual representation not triggered by direct sensory input

46
Q

Contrast between synaesthesia and mental imagery when considering the scientific definition of mental imagery

A

-Mental imagery = Perceptual representation not triggered by direct sensory input

-Synaesthesia is triggered by a sensory input it’s just from another modality/ submodality (this holds true for both projective and associative synaesthesia… FOR NOW!)

-And mental imagery can be voluntary or involuntary whereas synaesthesia is involuntary/ automatic.

47
Q

Example of playing a song and picturing a singer’s face to illustrate difficultly in determining the difference between mental imagery and associative synaesthesia

A

-Inducer is from one modality (song) and results in a concurrent image from another modality (picturing the face).

-This would be involuntary

-Have a sensory trigger (auditory)

-If we go back to the definition of mental imagery: Perceptual representation not triggered by direct sensory input and is voluntary or involuntary this description does not match up. Therefore, is it associative synaesthesia????

-NO, difference is likely vividness

48
Q

Vividness and mental imagery

A

-Gustave Fechner (1860) : first studies of mental imagery. Found a huge range of vividness in recall

-Galton (1907): similar results. Most participants report imagery but not all see things in vivid details (colours, patterns…)

-On the other hand mental imagery in synaesthesia is VIVID. e.g. Barnett & Newell (2008): people with synaesthesia score MUCH higher than controls on visual imagery self-report scales.

49
Q

So, is synaesthesia just vivid mental imagery?

A
  1. fMRI studies of synaesthesia cannot control for mental imagery i.e. you cannot tell someone to not think about the concurrent. Additionally, there are cases of synaesthesia that are triggered not by sensory input but by imaging sensory input.
  2. People have proposed that forms of synaesthesia like number form might just be vivid imagery as people with number form synaesthesia score MUCH higher than controls on visual imagery self-report scales (Price, 2009).
50
Q

Number form synaesthesia and mental imagery

A

-People with number form synaesthesia score MUCH higher than controls on visual imagery self-report scales (Price, 2009).

-Spatial classification is known to play an important part in the way children to categorize the world. So the hypothesis is that spatial representations of sequences such as numbers (e.g. clockface) or the months of the year (e.g. calendar) may, for some people with a tendency for strong visual imagery, be consolidation into automatized mental images

51
Q

People with synaesthesia report that their experiences feel different from when they just picture things

A

-This is specific to projective synaesthesia

52
Q

Is enhanced imagery vividness for people with synaesthesia across all modalities?

A

-People with synaesthesia only show enhanced imagery vividness for the modality of the concurrent (spiller et al.)

-For example, lexical-gustatory synaesthesia subjects have more vivid gustatory mental imagery, but not more vivid imagery for shapes, numbers etc.

53
Q

Two explanations of the link between synaesthesia and mental imagery:

A

-Associative synaesthesia is the product of enhance imagery in a specific modality

Or…

-Enhanced imagery specifically in the modality of the concurrent is the product of associative synaesthesia: a practice effect of sorts due to repeatedly experiencing the concurrent (Spiller et al., 2015). This could be the result of enhanced perception generally in that specific modality (Banissy et al., 2009).

CHICKEN OR EGG

54
Q

Evidence that maybe vivid imagery doesn’t explain associative synaesthesia

A

-Self-report of visual imagery is heightened in projectors relative to associators (Amsel et al., 2017)

-There is a report of synaesthesia in people with aphantasia (condition of having little or no mental imagery) and 989.2% of aphantasia synaesthetes e.g. Olivier Sacks are associators!!! Therefore, the idea that associative synaesthesia is just enhanced visual imagery is somewhat flawed.

55
Q

Maybe heightened imagery is not so prevalent in synaesthesia as previous studies have suggested?

A

-There is a potential for self-report to bias responses. e.g. heightened imagery = more awareness of synaesthesia = more likely to volunteer for studies on synaesthesia

  • In fact if you don’t ask for people with synaesthesia, you don’t see heightened imagery (Brang & Ahn, 2019). Suggests that before studies have just been preferentially capturing a certain portion of the synaesthetic population.

-Additionally, if we look at advertisements for studies wanting people with synaesthesia they often don’t do a good job at encompassing everything that it means to be a synesthete thus might be very easy to recruit only a certain type.

56
Q

Example of a perfect advertisement to recruit people with synaesthesia

A

-When you read, do you see colours on the page or in your mind? Or can you hear colours? Do certain sounds create a visual colour moazaic for you? Or perhaps you have seen numbers arranged in a certain pattern in space. Or event better… can you taste words? If you say yes to any of the above you might have synaesthesia!

Important of this is that it is capturing both associative and projective synaesthesia (particularly so in first sentence) and multiple forms (e.g. grapheme-colour, chromesthesia, number form…)

57
Q

Simmer (2013)
4 subcategories of Synaesthesia

A

-New hypothesis: there are 4 subcategories of synaesthesia rather than just the two broad categories of projective and associative.

-Some associators see images in the mind’s eye, some are just ‘aware’ of the concurrent (“see-associators” and “know-associators” – aphantasic synaesthetes fall into latter category)

-Likewise, projectors are divided into “surface-projectors” with superimposed concurrents, and “space-projectors” with concurrents experienced elsewhere in external space (after Ward, 2013)

58
Q

Hyperphantasia + link to synaesthesia

A

What is Hyperphantasia:

-At the end of the mental imagery spectrum

-Condition of having abundant/extreme mental imagery (‘as vivid as real seeing’)

Link to synaesthesia:

-Elevated rate of synaesthesia (20%: Zeman et al., 2020)

-Contributes to “surface-projection” in grapheme-colour synaesthesia?

-Contributes to “space-projection” in other forms?

59
Q

Continuum of imagery from non to extremely vivid

A

– Synaesthesia subtypes organised along this spectrum

Going from aphantasia (no mental imagery) — vague/ faint— vivid— Hyperphantasia (extremely vivid mental imagery):

know-associator— see associator— surface/space projector (modality/ submodaility specific (note: spans across both vivid and Hyperphantasia)

There is a good diagram in notes (slide 52)

60
Q

Nikola Tesla

A

-Images accompanied by strong flashes of lights

-“When a word was spoken, the image of the object would present itself so vividly in my vision, that I could not tell whether it was real or not”

-He never drew plans for his inventions, he just visualized then built them

61
Q

Links between aphantasia & Hyperphantasia and synaesthesia

A

-Aphantasia = lower sensory sensitivity, across all modalities (Dance et al., 2021)

-Anecdotally, Hyperphantasia = higher sensory sensitivity

-And synaesthesia? Higher sensory sensitivity

62
Q

Would hyperphantasia be like having a super power?

A

-Linked to creativity, mnemonic ability……. and uncontrollable, visceral experience of imagined sensation

-Fine if you truly feel like you’re hearing a song that’s in your head. Fine if you vividly feel you’re seeing the painting you’re thinking of

-BUT… could have negative consequences. What if you got an annoying song stuck in your head? What if you pictured a traumatic event from your past? What if you imagined someone in pain?

63
Q

PSYC323 definition of synaesthesia + why we need it?

A

Definition: When one sensory stimulus evokes two or more specific, consistent, involuntary, concurrent perceptual experiences

-Other definitions according to website don’t do a particular good job.

-Considered a neurological condition, but no official definition. No entry in DSM or in ICD classifications, and with good reason as synaesthesia is not a disease/ syndrome/ disorder.

-So who decides what is/isn’t synaesthesia? : not having a definition is problematic!

64
Q

Things people agree on in how to define synaesthesia

A

-Almost everyone agrees on the inducer-concurrent relationship

-Almost everyone agrees this relationship is sensory i.e. either the inducer or concurrent is a sensory experience… but is this accurate???

65
Q

Is synaesthesia sensory?

A

-Remember Daniel Tammet

-Every positive integer from 1-10,000 has its own unique shape, colour, texture and feel (289 is “particularly ugly”, apparently). Also, 117 is “a handsome number. It’s tall, it’s a lanky number, a
little bit wobbly: there is nothing inherently sensory about these descriptions- more conceptual as opposed to sensory.

-Additionally, Daniel Tammet reports having emotional responses to numbers. Other synaesthetes report numbers having personalities.

-So, if you can have sensory, cognitive, or emotional responses to inducers: this raises questions about the definition of synaesthesia and what ‘counts.’

66
Q

Bor et al. (2011): fMRI study of Daniel Tammet’s brain during grapheme presentation

A

-NO activation of V4! : suggests his concurrent experience is not sensory but a more abstract and conceptual form of synaesthesia

-And he’s not alone. Hupé et al (2012): no grapheme-evoked activity in V4 in 10 grapheme-colour synaesthetes

67
Q

Higher and low synaesthesia

A

-Recall: associators & projectors experience concurrents differently

-High & low synaesthetes have different types of inducer

-For grapheme-colour “high” synaesthetes the shape of the digit doesn’t induce the concurrent, the concept/meaning of the letter does

-Big implications here – consider music. What is the inducer? Pitch? Timbre? Or meaning?

-Keep in mind this means it is possible to have a lower synaesthete that sees colours in the ‘mind’s eye’, or a higher synaesthete that is a projector.

68
Q

So a concept trigger trigger synaesthetic experience?

A

-Yes. E.g. days of the week/month evoking colour
sensation (Simner, 2009). One of the most common
forms of synaesthesia does not have a sensory inducer!

-And just thinking about the inducer can induce the
concurrent in some cases (Nikolić, 2011)

69
Q

Revised definition of synaesthesia

A

-‘Synaesthesia is a phenomenon in which a mental activation of a certain concept or idea is associated consistently with a certain perception-like experience’ (Nikolić, 2009, p. 28).

-Means inducer could be sensory or conceptual

-“Synaesthesia as an ideaesthesia” (Jürgens & Nikolić, 2012)

70
Q

Implications of ideaesthesia

A

-Means synaesthetes are not pre-disposed to synaesthesia as previously thought

-Instead, synaesthetes learn to assign meanings to certain stimuli to strengthen their knowledge and understanding of abstract concepts (van Leeuwen et al., 2015).

-Useful way for kids to learn & make sense of abstract processes? (musical notes, letters….)

71
Q

Emotional inducers?

A

-If synaesthesia can be purely sensory/perceptual, or
can be triggered by a concept or idea, what else counts as synaesthesia under the new definition?

-Ward (2006): case report of GW, a synaesthete who perceives concurrent colours triggered by emotional inducers

-Note: hard to determine whether it is actually the emotion triggering the concurrent or the concept e.g. GW experiences synaesthetic colours after seeing the word “love” but is this an emotion or concept?

72
Q

Emotional concurrents? What issues does this raise

A

-For example, is misophonia simply a form of synaesthesia? One difference is misophonia reaches a diagnostic threshold but maybe it’s not actually that different??

-If it is, then isn’t any emotional response to music also synaesthetic? Are we all synaesthetes to a certain degree?

73
Q

Is it suitable to have one definition for synaesthesia?

A

-There are so many disparate forms of synaesthesia

-Maybe it is better to class them all separately?

74
Q

Why do we care about synaesthesia?

A

-Can help us understand multisensory integration in people who don’t have synaesthesia and how to use to our advantage (e.g. traffic lights incorporating both visual and auditory information)

-Cross-modal correspondence: people perceive correspondence across sensory modalities
e.g. Bouba- Kiki effect shows correspondence between shape and sound.
e.g. low-pitch sound= big, high-pitch sound= small

-Non-synaesthetes and synaesthetes make cross-modal pairings from colour, music, emotion, pitch-height and pitch size using similar ‘mental rules’

-Visual dominance effects

e.g. many people struggle when verbally describing odours (or use highly specialized language) fragrance companies communicate perfume smell through colour. Scharf and Volkmer (2000): People’s expectations of perfume:
- intensity: dark red > pastel green
- sweetness: dark red > pastel green
- freshness: pastel green > dark red

e.g. Hine (1995): 7-up lemon-lime drink add 15% more yellow to the can (mostly green). Customers complain the recipe has changed (more lemon)

75
Q

Cross-modal correspondence

A

People perceive correspondence across sensory modalities
e.g. Bouba- Kiki effect shows correspondence between shape and sound.
e.g. low-pitch sound= big, high-pitch sound= small

-Boring (1942): perception in all of the senses seems to share some specific dimensions
* Intensity (weak-strong)
* Duration (short-long)
* Spatial location (near-far)

-Therefore, makes sense that we ‘bind’ events from different modalities if they’re telling us the same thing?

-Non-synaesthetes and synaesthetes make cross-modal pairings from colour, music, emotion, pitch-height and pitch size using similar ‘mental rules’

76
Q

Visual dominance effects

A

e.g. many people struggle when verbally describing odours (or use highly specialized language) fragrance companies communicate perfume smell through colour. Scharf and Volkmer (2000): People’s expectations of perfume:
- intensity: dark red > pastel green
- sweetness: dark red > pastel green
- freshness: pastel green > dark red

e.g. Hine (1995): 7-up lemon-lime drink add 15% more yellow to the can (mostly green). Customers complain the recipe has changed (more lemon)

77
Q

Non-synaesthetes and synaesthetes make cross-modal pairings from colour, music, emotion, pitch-height and pitch size using similar ‘mental rules’

A

-Matching pitch with lightness in sound colour synaesthetes and non-synaesthetes
(Ward et al., 2006; Isbilen & Krumhansl, 2016)

-There is a graph on slide 77: But basically there is similar trajectory in both populations : little bit of divergence at the upper end of the spectrum (higher pitches correspond to greater intensity lightness for synaesthetes compared to controls)

78
Q

Separation between inducer and concurrent pairings and cross-modal associations? How might understanding this be useful?

A

-Automaticity, general consistency, and specificity of inducer and congruent pairings are what set synaesthesia apart from normal cross-modal associations (Ward et al., 2006a)

-But these could all follow from learning – the ‘rules’ for synaesthesia may be the same as cross-modal coupling, just that the effects are more vivid?

And if we could learn those rules…. it could be useful
* Creativity, metaphor, numerical memory, visuospatial learning, multisensory processing…