Presentations

Abstract

Prominent theories of predictive language processing assume that language production processes are used to anticipate upcoming linguistic input during comprehension (Dell & Chang, 2014; Pickering & Garrod, 2013). Here, we explored the converse case: Does a task set including production in addition to comprehension encourage prediction, compared to a task only including comprehension? To test this hypothesis, participants carried out a cross-modal naming task (Exp 1a), a self-paced reading task (Exp1 b) that did not include overt production, and a task (Exp 1c) in which naming and reading trials were evenly interleaved. We used the same predictable (N = 40) and non-predictable (N = 40) sentences in all three tasks. The sentences consisted of a fixed agent, a transitive verb and a predictable or non-predictable target word (The man breaks a glass vs. The man borrows a glass). The mean cloze probability in the predictable sentences was .39 (ranging from .06 to .8; zero in the non-predictable sentences). A total of 162 volunteers took part in the experiment which was run in a between-participants design. In Exp 1a, fifty-four participants listened to recordings of the sentences which ended right before the spoken target word. Coinciding with the end of the playback, a picture of the target word was shown which the participants were asked to name as fast as possible. Analyses of their naming latencies revealed a statistically significant naming advantage of 108 ms on predictable over non-predictable trials. Moreover, we found that the objects’ naming advantage was predicted by the target words’ cloze probability in the sentences (r = .347, p = .038). In Exp 1b, 54 participants were asked to read the same sentences in a self-paced fashion. To allow for testing of potential spillover effects, we added a neutral prepositional phrase (breaks a glass from the collection/borrows a glass from the neighbor) to each sentence. The sentences were read word-by-word, advancing by pushing the space bar. On 30% of the trials, comprehension questions were used to keep up participants' focus on comprehending the sentences. Analyses of their spillover region reading times revealed a numerical advantage (8 ms; tspillover = -1.1, n.s.) in the predictable as compared to the non-predictable condition. Importantly, the analysis of participants' responses to the comprehension questions, showed that they understood the sentences (mean accuracy = 93%). In Exp 1c, the task comprised 50% naming trials and 50% reading trials which appeared in random order. Fifty-four participants named and read the same objects and sentences as in the previous versions. The results showed a naming advantage on predictable over non-predictable items (99 ms) and a positive correlation between the items’ cloze probability and their naming advantage (r = .322, p = .055). Crucially, the post-target reading time analysis showed that with naming trials and reading trials interleaved, there was also a statistically reliable prediction effect on reading trials. Participants were 19 ms faster at reading the spillover region on predictable relative to non-predictable items (tspillover = -2.624). To summarize, although we used the same sentences in all sub-experiments, we observed effects of prediction only when the task set involved production. In the reading only experiment (Exp 1b), no evidence for anticipation was obtained although participants clearly understood the sentences and the same sentences yielded reading facilitation when interleaved with naming trials (Exp 1c). This suggests that predictive language processing can be modulated by the comprehenders’ task set. When the task set involves language production, as is often the case in natural conversation, comprehenders appear to engage in prediction to a stronger degree than in pure comprehension tasks. In our discussion, we will discuss the notion that language production may engage prediction, because being able to predict words another person is about to say might optimize the comprehension process and enable smooth turn-taking.

Abstract

A substantial body of literature has shown that readers and listeners often anticipate information. An open question concerns the mechanisms underlying predictive language processing. Multiple mechanisms have been suggested. One proposal is that comprehenders use event knowledge to predict upcoming words. Other theoretical frameworks propose that predictions are made based on simple word associations. In a recent EEG study, Metusalem and colleagues reported evidence for the modulating influence of event knowledge on prediction. They examined the degree to which event knowledge is activated during sentence comprehension. Their participants read two sentences, establishing an event scenario, which were followed by a final sentence containing one of three target words: a highly expected word, a semantically unexpected word that was related to the described event, or a semantically unexpected and event-unrelated word (see Figure, for an example). Analyses of participants’ ERPs elicited by the target words revealed a three-way split with regard to the amplitude of the N400 elicited by the different types of target: the expected targets elicited the smallest N400, the unexpected and event-unrelated targets elicited the largest N400. Importantly, the amplitude of the N400 elicited by the unexpected but event-related targets was significantly attenuated relative to the amplitude of the N400 elicited by the unexpected and event-unrelated targets. Metusalem et al. concluded that event knowledge is immediately available to constrain on-line language processing. Based on a post-hoc analysis, the authors rejected the possibility that the results could be explained by simple word associations. In the present study, we addressed the role of simple word associations in discourse comprehension more directly. Specifically, we explored the contribution of associative priming to the graded N400 pattern seen in Metusalem et al’s study. We conducted two EEG experiments. In Experiment 1, we reran Metusalem and colleagues’ context manipulation and closely replicated their results. In Experiment 2, we selected two words from the event-establishing sentences which were most strongly associated with the unexpected but event-related targets in the final sentences. Each of the two associates was then placed in a neutral carrier sentence. We controlled that none of the other words in these carrier sentences was associatively related to the target words. Importantly, the two carrier sentences did not build up a coherent event. We recorded EEG while participants read the carrier sentences followed by the same final sentences as in Experiment 1. The results showed that as in Experiment 1 the amplitude of the N400 elicited by both types of unexpected target words was larger than the N400 elicited by the highly expected target. Moreover, we found a global tendency towards the critical difference between event-related and event-unrelated unexpected targets which reached statistical significance only at parietal electrodes over the right hemisphere. Because the difference between event-related and event-unrelated conditions was larger when the sentences formed a coherent event compared to when they did not, our results suggest that associative priming alone cannot account for the N400 pattern observed in our Experiment 1 (and in the study by Metusalem et al.). However, because part of the effect remained, probably due to associative facilitation, the findings demonstrate that during discourse reading both event knowledge activation and simple word associations jointly contribute to the prediction process. The results highlight that multiple mechanisms underlie predictive language processing.

Abstract

Janssen and Barber (2012) reported two studies on the production of complex noun phrases (Spanish and French noun-adjective and noun-noun phrases). They found that production latencies depended only on the frequencies of the phrases, but not on the frequencies of the individual words. This pattern may be seen as evidence for lexical storage of phrases and against the traditional “words & rules” view of the representation of linguistic knowledge. We will discuss a series of experiments on the production of Dutch adjective-noun phrases. We replicated the phrase frequency effect seen by Janssen and Barber, but also found a robust effect of the frequency of the first word of the phrase. We argue that the phrase frequency effect arises during the conceptual preparation of the utterance and that the results are consistent with the view that phrases are composed by combining individual words, in line with the “words & rules” view.

Abstract

Frequent and predictable words are generally pronounced with less effort and are therefore acoustically more reduced than less frequent or unpredictable words. Local predictability can be operationalised by Transitional Probability (TP), which indicates how likely a word is to occur given its immediate context. We investigated whether and how probabilistic reduction effects on word durations change with adult age when reading aloud content words embedded in sentences.
The results showed equally large frequency effects on verb and noun durations for both younger (Mage = 20 years) and older (Mage = 68 years) adults. Backward TP also affected word duration for younger and older adults alike. ForwardTP, however, had no significant effect on word duration in either age group.
Our results resemble earlier findings of more robust BackwardTP effects compared to ForwardTP effects. Furthermore, unlike often reported decline in predictive processing with aging, probabilistic reduction effects remain stable across adulthood.

Abstract

A recurring criticism in the field of psycholinguistics and is the lack of ecological validity of experimental designs. For example, many experiments on sentence comprehension are conducted enclosed booths, where sentences are presented word by word on a computer screen. In addition, very often participants are instructed to make judgments that relate directly to the experimental manipulation. Thus, the contexts in which these processes are studied is quite restricted, which calls into question the generalizability of the results to more naturalistic environments. A possible solution to this problem is the use of virtual reality (VR) in psycholinguistic experiments. By immersing participants into a virtual environment, ecological validity can be increased while experimental control is maintained.
In the current experiment we combine electroencephalography (EEG) and VR to look at semantic processing in a more naturalistic setting. During the experiment, participants move through a visually rich virtual restaurant. Tables and avatars are placed in the restaurant and participants are instructed to stop at each table and look at the object (e.g. a plate with a steak) in front of the avatar. Then, the avatar will produce an utterance to accompany the object (e.g. “I think this steak is very nice”), in which the noun will either match (e.g. steak) or mismatch (e.g. mandarin) with the item on the table. Based on previous research, we predict a modulation of the N400, which should be larger in the mismatch than the match condition. Implications of the use of virtual reality for experimental research will be discussed.

Abstract

Fluctuations in pupil size have been shown to reflect variations in processing demands during language
comprehension. Increases in pupil diameter have been observed as a consequence of syntactic anomalies
(Schluroff 1982), increased syntactic complexity (Just & Carpenter 1993) and lexical ambiguity (Ben-
Nun 1986). An issue that has not received attention is whether pupil size also varies due to pragmatic
manipulations. In a pupillometry experiment, we investigated whether pupil diameter is sensitive to
increased processing demands as a result of comprehending an indirect request versus a statement. During
natural conversation, communication is often indirect. For example, in an appropriate context, ''It'' cold in
here'' is a request to shut the window, rather than a statement about room temperature (Holtgraves 1994).
We tested 49 Dutch participants (mean age = 20.8). They were presented with 120 picture-sentence
combinations that could either be interpreted as an indirect request (a picture of a window with the
sentence ''it's hot here'') or as a statement (a picture of a window with the sentence ''it's nice here''). The
indirect requests were non-conventional, i.e. they did not contain directive propositional content and were
not directly related to the underlying felicity conditions (Holtgraves 2002). In order to verify that the
indirect requests were recognized, participants were asked to decide after each combination whether or
not they heard a request. Based on the hypothesis that understanding this type of indirect utterances
requires additional inferences to be made on the part of the listener (e.g., Holtgraves 2002; Searle 1975;
Van Ackeren et al. 2012), we predicted a larger pupil diameter for indirect requests than statements. The
data were analyzed using linear mixed-effects models in R, which allow for simultaneous inclusion of
participants and items as random factors (Baayen, Davidson, & Bates 2008). The results revealed a larger
mean pupil size and a larger peak pupil size for indirect requests as compared to statements. In line with
previous studies on pupil size and language comprehension (e.g., Just & Carpenter 1993), this difference
was observed within a 1.5 second window after critical word onset. We suggest that the increase in pupil
size reflects additional on-line processing demands for the comprehension of non-conventional indirect
requests as compared to statements. This supports the idea that comprehending this type of indirect
request requires capacity demanding inferencing on the part of the listener. In addition, this study
demonstrates the usefulness of pupillometry as a tool for experimental research in pragmatics.

Abstract

Fluctuations in pupil size have been shown to reflect variations in processing demands during language
comprehension. Increases in pupil diameter have been observed as a consequence of syntactic anomalies
(Schluroff 1982), increased syntactic complexity (Just & Carpenter 1993) and lexical ambiguity (Ben-
Nun 1986). An issue that has not received attention is whether pupil size also varies due to pragmatic
manipulations. In a pupillometry experiment, we investigated whether pupil diameter is sensitive to
increased processing demands as a result of comprehending an indirect request versus a statement. During
natural conversation, communication is often indirect. For example, in an appropriate context, ''It'' cold in
here'' is a request to shut the window, rather than a statement about room temperature (Holtgraves 1994).
We tested 49 Dutch participants (mean age = 20.8). They were presented with 120 picture-sentence
combinations that could either be interpreted as an indirect request (a picture of a window with the
sentence ''it's hot here'') or as a statement (a picture of a window with the sentence ''it's nice here''). The
indirect requests were non-conventional, i.e. they did not contain directive propositional content and were
not directly related to the underlying felicity conditions (Holtgraves 2002). In order to verify that the
indirect requests were recognized, participants were asked to decide after each combination whether or
not they heard a request. Based on the hypothesis that understanding this type of indirect utterances
requires additional inferences to be made on the part of the listener (e.g., Holtgraves 2002; Searle 1975;
Van Ackeren et al. 2012), we predicted a larger pupil diameter for indirect requests than statements. The
data were analyzed using linear mixed-effects models in R, which allow for simultaneous inclusion of
participants and items as random factors (Baayen, Davidson, & Bates 2008). The results revealed a larger
mean pupil size and a larger peak pupil size for indirect requests as compared to statements. In line with
previous studies on pupil size and language comprehension (e.g., Just & Carpenter 1993), this difference
was observed within a 1.5 second window after critical word onset. We suggest that the increase in pupil
size reflects additional on-line processing demands for the comprehension of non-conventional indirect
requests as compared to statements. This supports the idea that comprehending this type of indirect
request requires capacity demanding inferencing on the part of the listener. In addition, this study
demonstrates the usefulness of pupillometry as a tool for experimental research in pragmatics.

Abstract

If message and sentence planning are closely linked processes, planning scope may vary depending on what speakers want to say and how they say it. We compared speakers’ gaze pattern to pictures in displays eliciting sentences like “The lion and the tiger are above the basket” when speakers were a) more familiar or less familiar with the spatial layout of these displays, and b) more familiar or less familiar with the phrasal structures used in these sentences. Familiarity with spatial layout was induced by presenting prime trials with a similar or dissimilar layout of pictures (“The bell and the nail are above/below the crutch”) before the target trial, and familiarity with sentence structure was manipulated via structural priming (prime trials elicited sentences like “The bell and the nail are above the crutch” or “The bell is above the nail and the crutch”). When describing pictures on target trials, speakers looked earlier at the second object (tiger) when they were familiar with both the spatial layout and sentence structure, but speech onsets were reduced (structural priming) only when both spatial layout and sentence structure were repeated. The results show that linguistic planning is facilitated by congruence between message-level and sentence-level structure.

Abstract

Studies of lexical access in speech planning often use priming or interference paradigms, where a target picture is combined with a written prime or distracter word. A difficulty in interpreting the results of studies using interference paradigms with clearly visible distracters is that effects arising during lexical access cannot be distinguished from effects arising during self-monitoring. A difficulty with using masked priming paradigms is that the effects tend to be small and fragile. We report a series of picture naming experiments using both the conventional masked priming procedure and the sandwich priming procedure first used in lexical decision experiments by Lupker and masked prime the participants are briefly (i.e., 33 ms) presented the name of the target picture. Although neither categorically nor phonologically related primes significantly affected picture naming in the traditional masked priming experiments, in the sandwich priming experiments: (a) categorically related primes (e.g. “dog-cat”) interfered more than unrelated distracters with picture naming and (b) phonologically related primes (“mat-cat”) facilitated picture naming. The theoretical implications of these findings will be discussed. Lupker, S.J., & Davis, C.J. (2009). Sandwich priming: A method for overcoming the limitations of masked priming by reducing lexical competition effects. Journal of Experimental Psychology: Learning, Memory, & Cognition, 35, 618-639.

Abstract

Models of the mental representation of morphologically complex words traditionally fall into one of two categories, Single-Route or Dual-Route models. The former further distinguish between Full-Listing (e.g. Butterworth, 1983) and Decomposition (e.g. Taft & Forster, 1976), while the latter assume different systems governing the access of mono- vs. polymorphemic words (e.g. Pinker & Prince, 1994; Pinker & Ullman, 2002). One of the main arguments against decomposition and continuous online computations is the cognitive resources this process would require. Turning this reasoning around, taxing someone's working memory capacities should then uniquely affect the computation of bimorphemic verb forms. We tested this hypothesis on 48 Dutch native speakers with a lexical decision task, comparing reaction times for Dutch regular past tense forms to frequency-matched irregular past tense forms, both under low and under high cognitive load. We found that frequency influenced reactions to monomorphemic but not to bimorphemic forms (F(1, 47) = 4.734, p = .035), favoring a listing account for the former but a computational procedure for the latter forms. This interaction, however, was present only for a certain group of people (F(1, 23) = 6.279, p = .02), namely those whose reaction times were hardly affected by the load manipulation and who thus may be thought of as having larger working memory capacities. On the other hand, participants who showed a strong load effect had no interaction between number of morphemes and frequency (F(1, 23) = .575, ns), indicating that they process monomorphemic and bimorphemic forms in a similar manner. It seems that cognitive capacities influence the storage of and access to polymorphemic verb forms. While people with greater working memory skills use these resources to compute morphologically complex inflections on-line, people with smaller cognitive capacities seem to rely on a list-like storage for bimorphemic forms as well.

Abstract

Speakers clearly differ in how quickly they can retrieve words from the mental lexicon, but little is known about the sources of this variability. The present study investigated the relationship between speakers’ executive control abilities and their speed of picture naming. In two experiments, adult speakers of British English named line drawings of objects and actions. Three main components of executive control - updating, shifting of attention, and inhibiting - were assessed using the operation-span, number-letter shifting, and stop-signal task, respectively (see Myake et al.,2000 ). Reaction times (RT) to action and object pictures were highly correlated. Ex-Gaussian analyses of the RT distributions showed that the speakers’ updating scores correlated with the tau parameter of the RT distributions, i.e. predicted the proportions of slow responses in action and object naming. The inhibiting scores correlated with the mean RTs, whereas the scores obtained in the number-letter shifting task were uncorrelated to the RTs. These results indicate that the executive control abilities of updating and inhibiting contribute to the speed of naming objects and actions. Theories of word production may require modification to take account of these findings.

Abstract

a bitter rain – two silences beneath the one umbrella Is the connotative meaning of texts readily available or is it gleaned at an extra cognitive cost? The eye-movements of 31 English native speakers (10 male, mean age 21 years) were recorded while reading 24 haiku, 12 in the original/symbolic version, and 12 in a modified version where the most symbolic word (the keyword ‘bitter’ in the example) was replaced by a more literal word (‘loud’) reducing the text’s symbolic purport. The effects of keyword substitutions were measured globally, comparing total reading times for the two haiku types, and locally, examining the first pass gaze durations and dwell times on a word closely connected to the keyword, the referent ‘silences’, and on the last word, ‘umbrella’, to examine wrap-up processes. First pass duration showed no effects of the substitution. However, dwell time on referents and last-word regions, and total reading time were significantly longer for the original than for the altered haiku, suggesting that the connotative meaning of the texts was not available immediately but only through re-reading of the texts. The implications of these findings are discussed in relation to the literature on the processing of inferences in symbolic texts.

Abstract

a bitter rain – two silences beneath the one umbrella Is the connotative meaning of a text readily available or is it accessed only after re-examining a text? Thirtyone English native speakers (10 male, mean age 21) read 24 haiku, 12 in their original/symbolic version and 12 in a version in which the most symbolic word (the keyword "bitter" in the example above) was replaced by a more literal word ("loud"), reducing the text’s symbolic purport. Participants' eye movements were recorded using the eye-tracker EyeLink 1000. The effect of the word substitution was measured globally, by comparing the total reading times for the two haiku types, and locally, by examining first pass duration and dwell time on a word closely connected to the keyword (the referent, "silences") and on the last word ("umbrella"), as this might show wrap-up processes. First pass durations showed no effects of the substitution. However, total reading time and dwell time on both the referent and the last-word regions were significantly longer for haiku with the original keyword than for haiku with the altered keyword. These findings suggest that the texts’ connotative meaning was not available immediately but only through re-reading of the texts.

Abstract

When children learn their native language, they have to deal with a confusing array of dependencies between various elements in an utterance. Some of these dependencies may be adjacent to one another whereas others can be separated by considerable intervening material. In this study, we investigate whether both types of dependencies can be learned together, similarly to the task facing young children. Statistical learning of adjacent dependencies (probability = .17) and non-adjacent dependencies (probability = 1.0) was assessed in two experiments using a modified serial-reaction-time task. The results showed (i) increasing online sensitivity to both dependency types during training, (ii) better nonadjacency than adjacency learning, and (iii) nonadjacency learning being highly correlated with adjacency learning, suggesting that adjacency and non-adjacency learning can occur in parallel and might be subserved by a common statistical learning mechanism. An overnight break between two training sessions helped the online learning performance of slower learners to approach that of faster learners, but the same amount of training without such a break (a 15-min interval) did not, suggesting that memory consolidation may play a role in statistical learning of complex statistical patterns, especially for slower learners.