lecture 7 - sentence processing Flashcards

1
Q

Language
Meaning influenced by:

A
  • Semantics –meanings of words
  • Syntax – themes (who, what, to whom)
  • Pragmatics – influence of context on how you understand things
    Understand and communicate meaning
    Looking at comprehension and production
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Sentence processing

A
  • Immediacy – how quickly we attain info
  • Lexical ambiguity – multiple meanings of same word
  • Syntactic ambiguity – how sentence with same words can have two different interpretations
    How do people recognize words in context? How do they construct a syntactic analysis of words in context? How are these processes related to the construction of a coherent semantic interpretation of a sentence?
    How we acquire the meaning of comprehension
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Phoneme restoration
Warren (1970)

A

It was found that the *eel was on the…
axle / table / fishing rod / orange.
Perceive wheel, meal, reel, or peel
Great study, but retrospective
Exactly the same acoustic input, but perception influenced by surrounding semantic context.
Ability to restore missing phonemes so good that subjects typically don’t know what’s missing.
Speech perception influenced by context – helps out with identification of phonemes.
About how your mind fills in the blank phonemes missing from input. Read sentences to people with missing phoneme and it had one of 4 endings. Depending on ending the phoneme was heard differently
Retrospective – only test people on what they are hearing after they have heard the sentence

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Eye movements in sentence comprehension

A
  • Reading - word fixation – look at where people are looking on words while reading
  • Listening - object fixation – visual world experiment – a scenero and sentence and look at where looking on screen while hearing sentence
    One way to study what’s happening during sentence processing in reading
    Eye movements during reading,
    by courtesy from SMI : www.mpi.nl/world/tg/eye-tracking/ eye-tracking.htm
    Max Planck Institute for Psycholinguistics
    Girl reading demo:
    Dot size is how long looking at word – reading is not a smooth transition – dot is ahead of pronounciation – what ur looking at precedes pronouncation as takes a while to produce the utterance – quantitauve info
    http://www.youtube.com/watch?v=VFIZDZwdf-0
    Looking at language comprehension while people are listening or reading the sentence – look at eye movements – 2 study types
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Effect of context on reading time
(Morris, 1994)

A

The friend talked as the person/barber trimmed the moustache after lunch.
Fixation time on moustache shorter after barber than person
Immediacy of interpretation - integrate words as they are received
Morris (1994) measured eye fixations in several kinds of sentences. How long to process moustache?
1. Control sentence, sensible but few preceding cues.
2. Idea of sentence is related to target word.
Results: less time for 3; target word interpreted when encountered, not delayed.
NEED TO STUDY SENTENCE PROCESSING AS IT HAPPENS
Ptps Read sentences – read barber or person. Effect of context
Demonstartes immediacy of interpretation – when we listen or read we intergrate the words into meaning as we recive the info. We don’t wait until person has finished sentence and then gather things up and make sense of it.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What else has immediacy of interpretation?

A

Search engines also have immediacy of interpretation – it predicts whats coming up next – like we do
Why do we have the immediacy principle?
* Why not wait until the sentence is finished?
* Working Memory constraints
* Speed
If we did wait it would devoid ambiguities.
WM constraints – cant remeber sentences that are 15-20 words long. Most people remember 8. there are limits on our memory so we generate meaning as we go alomg
Speed – faster to understand what someone is saying if we process it as we go along. If at end takes longer to derive sentence meaning. Helpful in evolutionaruy terms eg for warnings

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Lexical ambiguity

A

Lexical ambiguity (polysemy)
Noun - bank - river
Noun - bank - money
The fisherman waited by the bank for an hour.
The loan manager waited by the bank for an hour.
After the rain, the bank was very wet and muddy.
* Meaning dominance? – eg financial bank more likely
* Multiple access? – look at both
* Selective access? – may look at both equally then select one later on
What happens when you encounter word with more than one meaning?
Immediacy of interpretation means you will try start processing it.
What does that processing involve?
Will you access both meanings of the word, or just the meaning which is relevant?
When individual words have more than one meaning
Mind needs way of identifiying correct meaning
At end of sentence know the meaning not at start – effect of context
Not always an effect of context

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Swinney (1979)

A
  • Do we activate multiple meanings of ambiguous words?
    Or just the single meaning?
  • If multiple meanings of a word are activated
  • Related senses of both meanings should be primed
    Quick to respond to both meanings
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Cross-modal priming
(Swinney, 1979)

A

“he found spiders, roaches and other bugs
in the corner of his room.” –> spy
Word or nonword?
For years the building had been plagued with problems. The man was not surprised when he found spiders, roaches and other bugs_ in the corner of his room.
Auditory PRIME, visual PROBE (lexical decision); also ANT, SEW
Played people sentences in earphones – then presented a word visually and asked ptps if it was a word or non word – a lexical descion task visually – decide if in mental dictionary
Two modality – oral and visual

“he found spiders, roaches and other bugs
in the corner of his room.”
* ambiguous prime word – “bugs”
(insect / spy listening device)
* Relevant probe – ANT
* Irrelevant probe - SPY
* Unrelated probe - SEW
* Word or nonword?
Ambiguous prime word – bugs – as insect or spy device
Relevant to intended sense of word bug
Irrelavnat as irrelevant to intended mesning but not to unintended

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Swinney (1979)
Immediate probe -

A

“he found spiders, roaches and other bugs [probe]
in the corner of his room.” —> spy - word or nonword?
Late probe -
“he found spiders, roaches and other bugs
in the corner [probe] of his room.” —> spy - word or nonword?
Two factors – type of probe and when probe come up
Immediate – probe straight after bug
Late – probe later on in sentence

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Swinney (1979)
Hypothesis of experiment

A
  • If multiple meanings of a word are activated
  • Related senses of both meanings should be primed
    Quick to respond to both meanings

Swinney (1979)
“he found spiders, roaches and other bugs [probe]
in the corner of his room.”

LOOK AT GRAPH

Immediate probe –Supported hypothesis
Unrelated probe takes longest time to respond to
Relevant probe shortest
Irrelvant also quite fast
Immeditaely after you are activating multiple senses

Swinney (1979)
“he found spiders, roaches and other bugs [probe]
in the corner of his room.”
Activation has gone down

LOOK AT GRAPH

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Summary
Swinney (1979)

A
  • Multiple meanings accessed
    • Context quickly rejects inappropriate senses
  • Are multiple meanings always accessed?
  • What happens when one meaning is more frequent than the other?
    • Duffy, Morris & Rayner, 1988
      See essential reading in Whitney (Chapter 7).
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Syntactic ambiguity

A
  • Flying planes can be dangerous.
  • John saw the man on the mountain with a telescope.
  • I saw an elephant in my pyjamas
    Ambiguity associated with entire sentences
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Syntax

A
  • Parsing
    Break down the sentence into syntactic components and structure

eg John kicked bill
John = agent
kicked = theme
bill = recipient

When we hear a sentence we break it down into syntactic componenets – parsing
Look for an agent – things that’s doing something
Theme – whats happening
Recipient – whats having something done to them
Depends on order of words

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

thematic roles

A

Agent - the instigator of an action (corresponding to the subject, usually animate)
Theme - The thing that has a particular location or change of location
Recipient - The person receiving the theme
Location - Where the theme is
Source - Where the theme is coming from
Goal - Where the theme is moving to
Time - Time of the event
Instrument - The thing used in causing the event

  • What are the roles?
  • Who is doing what to whom?
  • Who is the agent?
    So how do you figure out the roles? If you know the meaning of the words, you can assign them a grammatical category, and that’s going to help
    If we can identify what the subject of the sentence is, then we can likely identify the agent of the sentence. Similarly the obejct etc.
    So to a large part, thematic role assignment corresponds to identifying syntactic constituents
    Thematic roles of events of sentence
    Need to know
    Roles
    Who is doing what
    Agent
    Depends on what sentence is we extract different roles
    Have to have an agent and a theme
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Syntactic rules of language
Phrase structure rules

A
  • Specify how words can be combined in the language
  • Expressed formally
  • Speakers of the language have tacit knowledge - implicitly
    Each language has some of their own syntactic rules
17
Q

Syntax in production

A
  • Compose sentence so that thematic roles correspond to what you want to communicate
    John kicked Bill
    Bill kicked John
    So must know syntactic rules
18
Q

Syntax in comprehension

A
  • Decompose sentence so that thematic roles correspond to what the speaker wants to communicate
    John kicked Bill
    Bill kicked John
    So must know syntactic rules
19
Q

Phrase structure rules

A
  • Abstract rules that specify allowable strings of words in language
  • Nouns (N), Verbs (V), Verb Phrase (VP)…
  • Sample
    • S-> NP VP
    • VP -> VP (NP)
    • VP ® V (NP)
    • NP -> (det)N
      S = sentence
      () = optional
      Knowing rules means can construct tree structures

the dog ate the bone
S
/. \
NP. VP
/. . /. \
D. N. V. NP
|. |. |. /. \
the dog. ate D. N
|. |
the. bone

20
Q

Syntactic ambiguity

A
  • Multiple syntactic trees (parses) – corresponding to same sentences
    Multiple thematic role assignment – to same sentence

look at example in notes!!!!!!!!

In the first case, and elephant in my pyjamas is combined together to form a noun phrase of their own, but in the second case, they do not.
Tree structure is different for different parses and different thematic assignmnets
How are we able to deal with ambiguity in sentences and how do we break it down eg garden path sentences

21
Q

Garden path

A
  • The old man the boats. – if think of man as verb it makes sense
  • The horse raced past the barn fell.
    Immediate interpretation!
    based on the idea that a path in a garden is very pleasant, so someone who is brought along it can be deceived without noticing it
    http://idioms.thefreedictionary.com/lead+down+the+garden+path 27 Feb 2007
    http://www.nilssonstudio.com/leif/10/2291/2291s_iris_path_.jpg 4 March 2008
    Leif Nilsson, Garden Path with Iris
    Hard to get interpretaions due to immediate interpretation – brain takes you down wrong routes of interpretation
22
Q

Garden Path Model of Parsing
(Frazier, 1987)

A

Build a simple tree
* Late closure—keep words together
* Minimal attachment—minimise structure
Break sentences down by building simplistic syntactic tree you can

23
Q

Late Closure

A

Incorporate a word into the syntactic phrase that is currently being processed – trying to minimise effort – group each word

look at trees in notes!!!!!

late closure, is to minimize effort by incorporating a word into the syntactic phrase that is currently being processed, that is, group each word with the previous one if possible. This strategy explains the difficulty people have with “The old man the boats”, because late closure groups man with the preceding words in a noun phrase, whereas the correct parse needs man at the start of a new verb phrase.

24
Q

minimal attachment - prefer fewer nodes

A

trees in notes !!!!!!!!!

In the first case, and elephant in my pyjamas is combined together to form a noun phrase of their own, but in the second case, they do not.
Second case is more complex compared to first
People like to break it down in simplist possible way

25
What are minimal attachment and late closure?
Strategies the processor follows when forming the syntactic tree
26
The strategies can be wrong…
* Initial parsing preferences * Later information contradicts initial preference Garden path sentences
27
a test of minimal attachment
(Rayner, Carlson & Frazier, 1983) Attachment - Minimal The spy saw the cop with binoculars but the cop didn’t see him. Non-minimal The spy saw the cop with the revolver but the cop didn’t see him. If you followed minimal attachment to follow the second sentence, you’d interpret it to mean that the spy saw the cop using a revolver to see through. So then you’d have to backtrack and undo your initial interpretation. Whereas you wouldn’t if you understood the first sentence using minimal attachment. Rayner, Carlson & Frazier, 1983 Eye tracking As predicted by minimal attachment Present people with 2 sorts of sentences – one with crrect meaning obeying minimal attachment and one not People in eye tracking – non minimal attachment had more backtracking to earlier parts of sentence
28
evidence for minimal attachment
attachment - minimal backtrack - no The spy saw the cop with the binoculars ... attachment - Non- minimal backtrack - Yes The spy saw the cop with the revolver ...
29
another test - Taraban & McClelland, 1988
Attachment - minimal The couple admired the house with a friend but knew that it was over-priced. non-minimal The couple admired the house with a garden but knew that it was over-priced. T&M argues the semantic expectations lead you to expect some information about what the spy used to see with. Semantic context leads to the expectation that some information about the house will be given. In the first case, the sentence follows minimal attachment but violates the semantic expectation. In the second, the sentence violates minimal attatchment but follows semantics. Taraban & McClelland, 1988 Similar structure to previous examples Frazier’s parsing strategy predicts that minimal attachment parses will be considered first and therefore should be faster. For some sentences those predictions are right, but Taraban & McClelland showed that the predictions are wrong for other sentences. Semantics favour info about house So, it doesn’t look like syntax finishes one parse, gives it to semantics, and then tries another one next if necessary. Semantics seems to interact with syntactic parsing more than that. There seem to be two ways to explain this.
30
trouble for minimal attachment
The couple admired the house with a friend ... attachment - Minimal backtrack - Yes The couple admired the house with a garden ... attachment - Non-minimal backtrack - No So, it doesn’t look like syntax finishes one parse, gives it to semantics, and then tries another one next if necessary. Semantics seems to interact with syntactic parsing more than that. There seem to be two ways to explain this. Couple with friend http://tbn0.google.com/images?q=tbn:F_EUW52gAjmdMM:http://bp1.blogger.com/_itKXWJIFGGU/RoKl0wueOwI/AAAAAAAAAY8/twvtPkLGFgg/s320/ashton-holding-hands-with-demi-and-penelope.jpg 6 Nov 2008
31
Garden path model
* Amazing question: how do we parse sentences when there is ambiguity? Not clear whether LC or MA is the answer, but certainly a lot of data to explain.
32
Summary
* Immediacy * Lexical ambiguity Syntactic ambiguity
33
sentence comprehension
Some psycholinguists (e.g., Frazier, 1989; Swinney, 1979), following Chomsky (1981b), argue that initial lexical access and syntactic parsing are autonomous, unaffected by prior semantic information or background knowledge. Other researchers (e.g., Taraban & McClelland, 1988; Trueswell et al., 1994), aligning with challenges to Chomsky (e.g., Langacker, 1988), claim that semantic information guides lexical access and syntactic analysis, viewing processing at lexical, syntactic, and semantic levels as highly interactive. The modular versus interactive debate centers on differences in information flow. A related question concerns the coordination of semantic and pragmatic factors. For instance, when reading a metaphor, literal processing might precede pragmatic interpretation, or pragmatic factors might influence semantic analysis early on, enabling simultaneous literal and metaphoric comprehension (Gibbs, 1994; Glucksberg, 1991). Sentence comprehension appears to proceed in stages—from lexical access to pragmatic analysis—with earlier stages working independently. Three possibilities arise: Each stage is distinct and autonomous; Stages are fully interactive, with semantic and pragmatic information available throughout; A mixed model, where early stages like lexical access are autonomous but later ones are interactive. Investigating these processes is challenging because comprehension is rapid and largely automatic. To explore these mental events, we must first study methods for investigating sentence processing, followed by a review of data on modular versus interactive processing.
34
how can we study sentence processing?
Concise Summary: Sentence Comprehension and Ambiguity in Psycholinguistics Comprehension and Memory: People often recall the meaning or situation described by a sentence rather than its exact wording. This suggests world knowledge plays a strong role in sentence comprehension. Influence of Prior Knowledge: Studies like Fillenbaum's show that people paraphrase anomalous sentences into more logical forms without realizing it, indicating that understanding is shaped by expectations and real-world knowledge. Immediacy of Interpretation: Sentence processing happens word-by-word, not after receiving the full sentence. This helps manage working memory constraints but can lead to misinterpretation (e.g., garden-path sentences). Ambiguity and Parsing: Lexical ambiguity (e.g., “bug”) and syntactic ambiguity (e.g., “warned” in different contexts) are common and informative for studying comprehension. Sentence processing involves quickly integrating words semantically and syntactically, but not always completely before moving on. Modular vs. Interactive Models: Modular view: Initial processing is syntactic and independent of context; semantic info comes later. Interactive view: Context can influence early interpretation, even affecting which word meanings are activated. Research Methods: Techniques like semantic priming and eye-tracking (e.g., fixation durations) help reveal real-time comprehension processes, especially in ambiguous or garden-path sentences. Ecological Validity: While some criticize ambiguity-focused research as artificial, ambiguity is actually common in natural language, making such studies relevant to understanding everyday sentence comprehension.
35
Ambiguity and the question of modularity
he reason that many of the studies of sentence processing make use of one form of ambiguity or another is because the major views of sentence processing clash most sharply when ambiguity is considered. On the one hand, a strictly modular view assumes that separate processors analyze lexical, syntactic, and semantic information, and that semantic information cannot influence our initial lexical or syntactic analysis even if a word or a syntactic structure is ambiguous. On the other hand, an interactive view sees the resolution of both lexical and syntactic ambiguity as being a matter of constraints based on simultaneous consideration of lexical, syntactic, and semantic information.
36
Lexical ambiguity
Swinney (1979) studied how people process lexical ambiguity using sentences containing ambiguous words like bug. Participants heard sentences and were shown a visual target word for a lexical decision task immediately or shortly after hearing the ambiguous word. Results showed both meanings (e.g., insect and spy) were briefly activated, but only the contextually appropriate meaning remained active after a short delay. This supports the modular view: initial lexical access is context-independent, and context influences meaning afterward. However, later studies found context can influence initial access, depending on: Meaning dominance – how frequent each meaning is in general language use. Strength of context – how strongly the sentence suggests a particular meaning. For instance: In sentence (8) "I opened a checking account at the bank", only the dominant financial meaning of bank is activated. In sentence (9) "The fisherman waited by the bank", both meanings may be activated briefly due to weaker support for the subordinate (riverbank) meaning. Simpson, Tabossi, and others showed that selective access occurs when a strong context supports the dominant meaning, while multiple access occurs when context is weak or the subordinate meaning is intended. Duffy et al. (1988) used eye-tracking to measure reading times for ambiguous words. They manipulated: Whether the word was equibiased (two equally common meanings) or nonequibiased (dominant and subordinate meanings). Whether disambiguating context came before or after the ambiguous word. Findings: When context came before the ambiguous word: Nonequibiased words (with subordinate meanings intended) showed longer reading times, reflecting multiple access. Equibiased words showed no slowdown, suggesting selective access helped by context. When context came after the ambiguous word: Equibiased words were read more slowly than unambiguous words, indicating both meanings were accessed. Nonequibiased words showed no initial slowdown, but later context (favoring the subordinate meaning) caused slower reading in the resolution region. Conclusion: Lexical access is influenced by both bottom-up factors (meaning dominance) and top-down context, but context effects are limited. The findings support a hybrid view: early processing is generally modular, but strong context can guide meaning selection under certain conditions.
37
syntactic ambiguity
Modular View of Parsing Rayner and colleagues (Frazier & Rayner, 1982, 1987) proposed a modular view, where syntactic parsing operates independently of semantic processing—at least initially. When a sentence is ambiguous, the parser commits to one syntactic interpretation without immediate semantic input unless comprehension fails. Parsing Strategies Late Closure Definition: New elements are attached to the most recent clause or phrase. Example: In “Martin had a date with the sister of the teacher who was named…”, “who was named” is usually attached to “the teacher.” Evidence: Eye-tracking studies (Frazier & Rayner, 1982) showed that readers spend more time parsing garden-path sentences like: (12) “Since Jay always jogs a mile seems like a short distance…” Misinterpretation due to assuming “a mile” is the object of “jogs.” Cross-linguistic Evidence: English speakers tend to use late closure, but Spanish speakers often attach clauses to earlier noun phrases. Minimal Attachment Definition: Prefer syntactic structures with the fewest nodes (i.e., simplest). Example: In “The spy saw the cop with binoculars…”, the default interpretation is that the spy had the binoculars. Evidence: Eye movement data (Rayner et al., 1983) shows delayed comprehension when minimal attachment leads to incorrect interpretation (e.g., when "with a revolver" creates an implausible reading). Challenges: Semantic context may drive interpretation more than syntax (Taraban & McClelland, 1988). Role of Semantics Evidence against strict modularity: Readers use semantic context to adjust parsing decisions. In sentences like (15–16) and (17–20), comprehension difficulty varies depending on the plausibility of the subject performing the verb (e.g., inanimate nouns like “evidence” influence parsing). Trueswell et al. (1994): Garden-path effects are stronger when semantic expectations are violated. Interactive vs. Modular Debate Some models (e.g., “syntax proposes, semantics disposes”) allow for a syntactic module that generates structures, which semantics then quickly evaluates (Altmann & Steedman, 1988). The faster nonsyntactic information is used, the harder it is to uphold a strictly modular view.
38
beyond the modularity debate - new evidence
Recent research has expanded beyond written language to explore spoken language processing, offering new insights into whether syntactic parsing is modular or influenced by broader context. Tanenhaus and colleagues developed an eye-tracking method to monitor how listeners process spoken instructions in real-time visual contexts. For example, in the ambiguous sentence "Put the saltshaker on the envelope in the bowl," listeners used visual cues to disambiguate syntactic structure before minimal attachment could lead them astray. Eye movements showed listeners quickly looked at the correct referents, indicating they used visual context early to influence syntactic parsing. This evidence challenges strictly modular views by showing that nonsyntactic information (like visual context) can influence initial syntactic decisions. A follow-up experiment confirmed that when visual context didn't clarify the referent, listeners initially misparsed the sentence, supporting the idea that parsing is sensitive to available cues. In addition to visual input, prosody (intonation and pauses) also helps listeners parse sentences correctly. For instance, a pause in the sentence "After Bill left, Tamara returned home" helps avoid a garden-path misinterpretation. Overall, these findings suggest that sentence processing is flexible and interactive, rapidly integrating visual, prosodic, syntactic, and semantic information, rather than being strictly modular or bottom-up.