Publications

Abstract

Rhythm and language-related traits are phenotypically correlated, but their genetic overlap is largely unknown. Here, we leveraged two large-scale genome-wide association studies performed to shed light on the shared genetics of rhythm (N=606,825) and dyslexia (N=1,138,870). Our results reveal an intricate shared genetic and neurobiological architecture, and lay groundwork for resolving longstanding debates about the potential co-evolution of human language and musical traits.

Abstract

Introduction

Children's early language and communication skills are efficiently measured using parent report, for example, communicative development inventories (CDIs). These have scalable potential to determine risk of later language delay, and associations between delay and risk factors such as prematurity and poverty. However, there may be measurement difficulties in parent reports, including anomalous directions of association between child age/socioeconomic status and reported language. Findings vary on whether parents may report older infants as having smaller vocabularies than younger infants, for example.

Methods

We analysed data from the UK Communicative Development Inventory (Words and Gestures); UK-CDI (W&G) to determine whether anomalous associations would be replicated in this population, and/or with gesture. In total 1204 families of children aged 8–18 months (598 girls, matched to UK population for income, parental education and ethnicity as far as possible) completed Vocabulary and Gesture scales of the UK-CDI (W&G).

Results

Overall scores on the Gesture scale showed more significant relationships with biological risk factors including prematurity than did Vocabulary scores. Gesture also showed more straightforward relationships with social risk factors including income. Relationships between vocabulary and social risk factors were less straightforward; some at-risk groups reported higher vocabulary scores than other groups.

Discussion

We conclude that vocabulary report may be less accurate than gesture for this age. Parents have greater knowledge of language than gesture milestones, hence may report expectations for vocabulary, not observed vocabulary. We also conclude that gesture should be included in early language scales partly because of its greater, more straightforward association with many risk factors for language delay.

Abstract

Humans engage with music for various reasons that range from emotional regulation and relaxation to social bonding. While there are large inter-individual differences in how much humans enjoy music, little is known about the origins of those differences. Here, we disentangle the genetic factors underlying such variation. We collect data on several facets of music reward sensitivity, as measured by the Barcelona Music Reward Questionnaire, plus music perceptual abilities and general reward sensitivity from a large sample of Swedish twins (N = 9169; 2305 complete pairs). We estimate that genetic effects contribute up to 54% of the variability in music reward sensitivity, with 70% of these effects being independent of music perceptual abilities and general reward sensitivity. Furthermore, multivariate analyses show that genetic and environmental influences on the different facets of music reward sensitivity are partly distinct, uncovering distinct pathways to music enjoyment and different patterns of genetic associations with objectively assessed music perceptual abilities. These results paint a complex picture in which partially distinct sources of variation contribute to different aspects of musical enjoyment.

Abstract

The theory that language acquisition is guided and constrained by inborn linguistic knowledge is assessed. Specifically, the "no negative evidence" view, the belief that linguistic theory should be restricted in such a way that the grammars it allows can be learned by children on the basis of positive evidence only, is explored. Child language data are cited in order to investigate influential innatist approaches to language acquisition. Baker's view that children are innately constrained in significant ways with respect to language acquisition is evaluated. Evidence indicates that children persistently make overgeneralizations of the sort that violate the constrained view of language acquisition. Since children eventually do develop correct adult grammar, they must have other mechanisms for cutting back on these overgeneralizations. Thus, any hypothesized constraints cannot be justified on grounds that without them the child would end up with overly general grammar. It is necessary to explicate the mechanisms by which children eliminate their tendency toward overgeneralization.

Abstract

When faced with an ambiguous novel word such as ‘ranana’, how do listeners decide whether they heard a mispronunciation of a familiar target (‘banana’) or a label for an unfamiliar novel item? We examined this question by combining visual-world eye-tracking with an offline forced-choice judgment paradigm. In two studies, we show evidence that participants entertain repair and novel label interpretations of novel words that were created by editing a familiar target word in multiple phonetic features (Experiment 1) or a single phonetic feature (Experiment 2). Repair (‘ranana’ = a banana) and learning (‘ranana’ = a novel referent) were both common interpretation strategies, and learning was strongly associated with visual attention to the novel image after it was referred to in a sentence. This indicates that repair and learning are both valid strategies for understanding novel words that depend upon a set of similar mechanisms, and suggests that attention during listening is causally related to whether one learns or repairs.

Abstract

Language processing is rapidly incremental, but evidence bearing upon this assumption comes from very few languages. In this paper we report on a study of incremental processing in Murrinhpatha, a polysynthetic Australian language, which expresses complex sentence-level meanings in a single verb, the full meaning of which is not clear until the final morph. Forty native Murrinhpatha speakers participated in a visual world eyetracking experiment in which they viewed two complex scenes as they heard a verb describing one of the scenes. The scenes were selected so that the verb describing the target scene had either no overlap with a possible description of the competitor image, or overlapped from the start (onset overlap) or at the end of the verb (rhyme overlap). The results showed that, despite meaning only being clear at the end of the verb, Murrinhpatha speakers made incremental predictions that differed across conditions. The findings demonstrate that processing in polysynthetic languages is rapid and incremental, yet unlike in commonly studied languages like English, speakers make parsing predictions based on information associated with bound morphs rather than discrete words.

Abstract

Human communication is inherently multimodal. Auditory speech, but also visual cues can be used to understand another talker. Most studies of audiovisual speech perception have focused on the perception of speech segments (i.e., speech sounds). However, less is known about the influence of visual information on the perception of suprasegmental aspects of speech like lexical stress. In two experiments, we investigated the influence of different visual cues (e.g., facial articulatory cues and beat gestures) on the audiovisual perception of lexical stress. We presented auditory lexical stress continua of disyllabic Dutch stress pairs together with videos of a speaker producing stress on the first or second syllable (e.g., articulating VOORnaam or voorNAAM). Moreover, we combined and fully crossed the face of the speaker producing lexical stress on either syllable with a gesturing body producing a beat gesture on either the first or second syllable. Results showed that people successfully used visual articulatory cues to stress in muted videos. However, in audiovisual conditions, we were not able to find an effect of visual articulatory cues. In contrast, we found that the temporal alignment of beat gestures with speech robustly influenced participants' perception of lexical stress. These results highlight the importance of considering suprasegmental aspects of language in multimodal contexts.

Abstract

Expressions of politeness such as 'please' are prominent elements of interactional conduct that are explicitly targeted in early socialization and are subject to cultural expectations around socially desirable behavior. Yet their specific interactional functions remain poorly understood. Using conversation analysis supplemented with systematic coding, this study investigates when and where interactants use 'please' in everyday requests. We find that 'please' is rare, occurring in only 7 percent of request attempts. Interactants use 'please' to manage face-threats when a request is ill fitted to its immediate interactional context. Within this, we identify two environments in which 'please' prototypically occurs. First, 'please' is used when the requestee has demonstrated unwillingness to comply. Second, 'please' is used when the request is intrusive due to its incompatibility with the requestee’s engagement in a competing action trajectory. Our findings advance research on politeness and extend Goffman’s theory of face-work, with particular salience for scholarship on request behavior.

Abstract

Dyslexia is a learning difficulty with neurodevelopmental origins, manifesting as reduced accuracy and speed in reading and spelling. It is substantially heritable and frequently co-occurs with other neurodevelopmental conditions, particularly attention deficit-hyperactivity disorder (ADHD). Here, we investigate the genetic structure underlying dyslexia and a range of psychiatric traits using results from genome-wide association studies of dyslexia, ADHD, autism, anorexia nervosa, anxiety, bipolar disorder, major depressive disorder, obsessive compulsive disorder,
schizophrenia, and Tourette syndrome. Genomic Structural Equation Modelling (GenomicSEM) showed heightened support for a model consisting of five correlated latent genomic factors described as: F1) compulsive disorders (including obsessive-compulsive disorder, anorexia nervosa, Tourette syndrome), F2) psychotic disorder (including bipolar disorder, schizophrenia), F3) internalising disorders (including anxiety disorder, major depressive disorder), F4) neurodevelopmental traits (including autism, ADHD), and F5) attention and learning difficulties (including ADHD, dyslexia). ADHD loaded more strongly on the attention and learning difficulties latent factor (F5) than on the neurodevelopmental traits latent factor (F4). The attention and learning difficulties latent factor (F5) was positively correlated with internalising disorders (.40), neurodevelopmental traits (.25) and psychotic disorders (.17) latent factors, and negatively correlated with the compulsive disorders (–.16) latent factor. These factor correlations are mirrored in genetic correlations observed between the attention and learning difficulties latent factor and other cognitive, psychological and wellbeing traits. We further investigated genetic variants underlying both dyslexia and ADHD, which implicated 49 loci (40 not previously found in GWAS of the individual traits) mapping to 174 genes (121 not found in GWAS of individual traits) as potential pleiotropic variants. Our study confirms the increased genetic relation between dyslexia and ADHD versus other psychiatric traits and uncovers novel pleiotropic variants affecting both traits. In future, analyses including additional co-occurring traits such as dyscalculia and dyspraxia will allow a clearer definition of the attention and learning difficulties latent factor, yielding further insights into factor structure and pleiotropic effects.

Abstract

Studies of perception have long shown that the brain adds information to its sensory analysis of the physical environment. A touchstone example for humans is language use: to comprehend a physical signal like speech, the brain must add linguistic knowledge, including syntax. Yet, syntactic rules and representations are widely assumed to be atemporal (i.e., abstract and not bound by time), so they must be translated into time-varying signals for speech comprehension and production. Here, we test 3 different models of the temporal spell-out of syntactic structure against brain activity of people listening to Dutch stories: an integratory bottom-up parser, a predictive top-down parser, and a mildly predictive left-corner parser. These models build exactly the same structure but differ in when syntactic information is added by the brain—this difference is captured in the (temporal distribution of the) complexity metric “incremental node count.” Using temporal response function models with both acoustic and information-theoretic control predictors, node counts were regressed against source-reconstructed delta-band activity acquired with magnetoencephalography. Neural dynamics in left frontal and temporal regions most strongly reflect node counts derived by the top-down method, which postulates syntax early in time, suggesting that predictive structure building is an important component of Dutch sentence comprehension. The absence of strong effects of the left-corner model further suggests that its mildly predictive strategy does not represent Dutch language comprehension well, in contrast to what has been found for English. Understanding when the brain projects its knowledge of syntax onto speech, and whether this is done in language-specific ways, will inform and constrain the development of mechanistic models of syntactic structure building in the brain.

Abstract

Infants acquire whatever language is spoken in the environment into which they are born. The mental capability of the newborn child is not biased in any way towards the acquisition of one human language rather than another. Because psychologists who attempt to model the process of language comprehension are interested in the structure of the human mind, rather than in the properties of individual languages, strategies which they incorporate in their models are presumed to be universal, not language-specific. In other words, strategies of comprehension are presumed to be characteristic of the human language processing system, rather than, say, the French, English, or Igbo language processing systems. We report here, however, on a comprehension strategy which appears to be used by native speakers of French but not by native speakers of English.

Abstract

Psycholinguists are saddled with a paradox. Their aim is to construct a model of human language processing, which will hold equally well for the processing of any language, but this aim cannot be achieved just by doing experiments in any language. They have to compare processing of many languages, and actively search for effects which are specific to a single language, even though a model which is itself specific to a single language is really the last thing they want.

Abstract

In four experiments, listeners’ response times to detect vowel targets in spoken input were measured. The first three experiments were conducted in English. In two, one using real words and the other, nonwords, detection accuracy was low, targets in initial syllables were detected more slowly than targets in final syllables, and both response time and missed-response rate were inversely correlated with vowel duration. In a third experiment, the speech context for some subjects included all English vowels, while for others, only five relatively distinct vowels occurred. This manipulation had essentially no effect, and the same response pattern was again observed. A fourth experiment, conducted in Spanish, replicated the results in the first three experiments, except that miss rate was here unrelated to vowel duration. We propose that listeners’ responses to vowel targets in naturally spoken input are effectively cautious, reflecting realistic appreciation of vowel variability in natural context.

Abstract

A long-standing question in language development concerns the nature of the relationship between early lexical and grammatical knowledge. The very strong correlation between the two has led some to argue that lexical and grammatical knowledge may be inseparable, consistent with psycholinguistic theories that eschew a distinction between the two systems. However, little research has explicitly examined whether early lexical and grammatical knowledge are statistically separable. Moreover, there are two under-appreciated methodological challenges in such research. First, the relationship between lexical and grammatical knowledge may change during development. Second, non-linear mappings between true and observed scores on scales of lexical and grammatical knowledge could lead to spurious multidimensionality. In the present study, we overcome these challenges by using vocabulary and grammar data from several developmental time points and a statistical method robust to such non-linear mappings. In Study 1, we examined item-level vocabulary and grammar data from two American English samples from a large online repository of data from studies employing a commonly used language development scale. We found clear evidence that vocabulary and grammar were separable by two years of age. In Study 2, we combined data from two longitudinal studies of language acquisition that used the same scale (at 18/19, 21, 24 and 30 months) and found evidence that vocabulary and grammar were, under some conditions, separable by 18 months. Results indicate that, while there is clearly a very strong relationship between vocabulary and grammar knowledge in early language development, the two are separable. Implications for the mechanisms underlying language development are discussed.

Abstract

This chapter introduces the origins and development of our current anatomical terminology. It scrutinizes the historical evolution and etymological significance of the over 1900 official anatomical terms in the current nomenclature, underscoring their impact on the contemporary comprehension of cognitive neuroanatomy. The chapter traces unification efforts from the Basel Nomina Anatomica in 1895 to the 1998 Terminologia Anatomica, noting challenges arising from outdated terminology in light of recent anatomical advancements.

Highlighting the influence of terminologies on interpretations of brain anatomy, the chapter explores several anatomical mapping methods such as surface, sectional, connectional, and functional anatomy. It illuminates discrepancies and controversies, exemplified by divergent interpretations of the number of brain lobes and the definitions of 'Broca' and 'Wernicke' areas.

The chapter explores anatomical terms' historical and cultural underpinnings, encompassing mythonyms, eponyms, and cultural influences on nomenclature. It critically examines the implications of these terminologies on contemporary research and shows that Large Language Models mirror these discrepancies. It underscores the need for more inclusive and culturally sensitive approaches in anatomical education.

Lastly, we advocate for updating anatomical nomenclature, suggesting that a deeper understanding of these terminologies could provide insights and aid in resolving ongoing debates in the field. This examination sheds light on historical knowledge and emphasizes the dynamic interplay between language, culture, and anatomy in shaping our comprehension of the neurobiology of the brain and how we navigate neuroanatomy in the 21st century.

Abstract

The human brain is an intricate network of cortical regions interconnected by white matter pathways, dynamically supporting cognitive functions. While cortical asymmetries have been consistently reported, the asymmetry of white matter connections remains less explored. This chapter provides a brief overview of asymmetries observed at the cortical, subcortical, cytoarchitectural, and receptor levels before exploring the detailed connectional anatomy of the human brain. It thoroughly examines the lateralization and interindividual variability of 56 distinct white matter tracts, offering a comprehensive review of their structural characteristics and interindividual variability. Additionally, we provide an extensive update on the asymmetry of a wide range of white matter tracts using high-resolution data from the Human Connectome Project (7T HCP www.humanconnectome.org). Future research and advanced quantitative analyses are crucial to understanding fully how asymmetry contributes to interindividual variability. This comprehensive exploration enhances our understanding of white matter organization and its potential implications for brain function.

Abstract

We report four experiments investigating the effect of prosody on listening comprehension in 11-13-year-old children. Across all experiments, participants listened to short object descriptions and answered content-based questions about said objects. In Experiments 1-3, the descriptions were read in an emotionally positive or neutral tone of voice. In Experiment 4, the descriptions were read by a neutral human voice or by text-to-speech software. The results from Experiments 1-3 consistently showed higher accuracy (i.e. more correct answers to the questions) when the descriptions were read using positive prosody. Experiment 4 found higher accuracy for the human voice compared to the text-to-speech recordings. The human voice was also rated as more pleasant and easier to understand than the text-to-speech voice. In sum, this study found that positive, compared to neutral, prosody, and a human voice, compared to artificial speech synthesis, can improve listening comprehension, showcasing the role of prosody in listening comprehension.

Abstract

Increasing evidence suggests that interlocutors use visual communicative signals to form predictions about unfolding utterances, but there is little data on the predictive potential of facial signals in conversation. In an online experiment with virtual agents, we examine whether facial signals produced by an addressee may allow speakers to anticipate the response to a question before it is given. Participants (n = 80) viewed videos of short conversation fragments between two virtual humans. Each fragment ended with the Questioner asking a question, followed by a pause during which the Responder looked either straight at the Questioner (baseline), or averted their gaze, or accompanied the straight gaze with one of the following facial signals: brow raise, brow frown, nose wrinkle, smile, squint, mouth corner pulled back (dimpler). Participants then indicated on a 6-point scale whether they expected a “yes” or “no” response. Analyses revealed that all signals received different ratings relative to the baseline: brow raises, dimplers, and smiles were associated with more positive responses, gaze aversions, brow frowns, nose wrinkles, and squints with more negative responses. Qur findings show that interlocutors may form strong associations between facial signals and upcoming responses to questions, highlighting their predictive potential in face-to-face conversation.

Abstract

Previous research has suggested the importance of relational language and working memory in children’s relational reasoning. The tendency to use language (e.g., using more relational than object-focused language, prioritizing focal objects over background in linguistic descriptions) could reflect children’s biases toward the relational versus object-based solutions in a relational match-to-sample (RMTS) task. In the lack of any apparent object match as a foil option, object-focused children might rely on other cognitive mechanisms (i.e., working memory) to choose a relational match in the RMTS task. The current study examined the interactive roles of language- and working memory-related sources of variation in Turkish-learning preschoolers’ relational reasoning. We collected data from 4- and 5-year-olds (N = 41) via Zoom in the RMTS task, a scene description task, and a backward word span task. Generalized binomial mixed effects models revealed that children who used more relational language and background-focused scene descriptions performed worse in the relational reasoning task. Furthermore, children with less frequent relational language use and focal object descriptions of the scenes benefited more from working memory to succeed in the relational reasoning task. These results suggest additional working memory demands for object-focused children to choose relational matches in the RMTS task, highlighting the importance of examining the interactive effects of different cognitive mechanisms on relational reasoning.

Abstract

Face-to-face communication is not only about ‘what’ is said but also ‘how’ it is said, both in speech and bodily signals. Beat gestures are rhythmic hand movements that typically accompany prosodic prominence in con-versation. Yet, it is still unclear how beat gestures influence language comprehension. On the one hand, beat gestures may share the same functional role of focus markers as prosodic prominence. Accordingly, they would drive attention towards the concurrent speech and highlight its content. On the other hand, beat gestures may trigger inferences of high speaker confidence, generate the expectation that the sentence content is correct and thereby elicit the commitment to the truth of the statement. This study directly disentangled the two hypotheses by evaluating additive and interactive effects of prosodic prominence and beat gestures on language comprehension. Participants watched videos of a speaker uttering sentences and judged whether each sentence was true or false. Sentences sometimes contained a world knowledge violation that may go unnoticed (‘semantic illusion’). Combining beat gestures with prosodic prominence led to a higher degree of semantic illusion, making more world knowledge violations go unnoticed during language comprehension. These results challenge current theories proposing that beat gestures are visual focus markers. To the contrary, they suggest that beat gestures automatically trigger inferences of high speaker confidence and thereby elicit the commitment to the truth of the statement, in line with Grice’s cooperative principle in conversation. More broadly, our findings also highlight the influence of metacognition on language comprehension in face-to-face ommunication.

Abstract

The brain is the most magnificent structure, and we are only at the cusp of unraveling some of its complexity. Neuroanatomy is the best tool to map the brain's structural complexity. As such, neuroanatomy is not just an academic exercise; it serves our fundamental understanding of the neurobiology of cognition and improves clinical practice. A deepened anatomical understanding has advanced our conceptual grasp of the evolution of the brain, interindividual variability of cognition in health and disease, and the conceptual shift toward the emergence of cognition. For the past 20 years, diffusion imaging tractography has dramatically facilitated these advances by enabling the study of the delicate networks that orchestrate brain processes (for review, see Thiebaut de Schotten and Forkel, 2022). Several steps are consistent across all studied populations and brain states (health/disease) when analyzing tractography data. We discuss various considerations for dissections across populations and give practical tips on common pitfalls and features to improve the visualization of the dissections. We briefly discuss specific considerations for manual dissections in nonhuman primates. Lastly, we provide an atlas of regions of interest (ROIs) for the most commonly delineated white matter connections in the human brain.

Abstract

Lateralization is a defining characteristic of the human brain, often studied through localized approaches that focus on interhemispheric differences between homologous pairs of regions. It is also important to emphasize an integrative perspective of global brain asymmetry, in which hemispheric differences are understood through global patterns across the entire brain.

Abstract

Finding and facilitating commonalities between the linguistic behaviors of large language models and humans could lead to major breakthroughs in our understanding of the acquisition, processing, and evolution of language. However, most findings on human–LLM similarity can be attributed to training on human data. The field of emergent machine-to-machine communication provides an ideal testbed for discovering which pressures are neural agents naturally exposed to when learning to communicate in isolation, without any human language to start with. Here, we review three cases where mismatches between the emergent linguistic behavior of neural agents and humans were resolved thanks to introducing theoretically-motivated inductive biases. By contrasting humans, large language models, and emergent communication agents, we then identify key pressures at play for language learning and emergence: communicative success, production effort, learnability, and other psycho-/sociolinguistic factors. We discuss their implications and relevance to the field of language evolution and acquisition. By mapping out the necessary inductive biases that make agents' emergent languages more human-like, we not only shed light on the underlying principles of human cognition and communication, but also inform and improve the very use of these models as valuable scientific tools for studying language learning, processing, use, and representation more broadly.

Abstract

Children need to learn the demands of their native language in the early vocabulary development phase. In this dynamic process, parental multimodal input may shape neurodevelopmental trajectories while also being tailored by child-related factors. Moving beyond typically characterized group profiles, in this article, we synthesize growing evidence on the effects of parental multimodal input (amount, quality, or absence), domain-specific input (space and math), and language-specific input (causal verbs and sound symbols) on preterm, full-term, and deaf children's early vocabulary development, focusing primarily on research with children learning Turkish and Turkish Sign Language. We advocate for a theoretical perspective, integrating neonatal characteristics and parental input, and acknowledging the unique constraints of languages.

Abstract

When language abilities in aphasia are assessed in clinical and research settings, the standard practice is to examine each language of a multilingual person separately. But many multilingual individuals, with and without aphasia, mix their languages regularly when they communicate with other speakers who share their languages. We applied a novel approach to scoring language production of a multilingual person with aphasia. Our aim was to discover whether the assessment outcome would differ meaningfully when we count accurate responses in only the target language of the assessment session versus when we apply a translanguaging framework, that is, count all accurate responses, regardless of the language in which they were produced. The participant is a Farsi-German-English speaking woman with chronic moderate aphasia. We examined the participant’s performance on two picture-naming tasks, an answering wh-question task, and an elicited narrative task. The results demonstrated that scores in English, the participant’s third-learned and least-impaired language did not differ between the two scoring methods. Performance in German, the participant’s moderately impaired second language benefited from translanguaging-based scoring across the board. In Farsi, her weakest language post-CVA, the participant’s scores were higher under the translanguaging-based scoring approach in some but not all of the tasks. Our findings suggest that whether a translanguaging-based scoring makes a difference in the results obtained depends on relative language abilities and on pragmatic constraints, with additional influence of the linguistic distances between the languages in question.

Abstract

Lexical-semantic processing impairments in aphasic patients with left hemisphere lesions and non-aphasic patients with right hemisphere lesions were investigated by recording event-related brain potentials (ERPs) while subjects listened to auditorily presented word pairs. The word pairs consisted of unrelated words, or words that were related in meaning. The related words were either associatively related, e.g. 'bread-butter', or were members of the same semantic category without being associatively related, e.g. 'churchvilla '. The latter relationships are assumed to be more distant than the former ones. The most relevant ERP component in this study is the N400. In elderly control subjects, the N400 amplitude to associatively and semantically related word targets is reduced relative to the N400 elicited by unrelated targets. Compared with this normal N400 effect, the different patient groups showed the following pattern of results: aphasic patients with only minor comprehension deficits (high comprehenders) showed N400 effects of a similar size as the control subjects. In aphasic patients with more severe comprehension deficits (low comprehenders) a clear reduction in the N400 effects was obtained, both for the associative and the semantic word pairs. The patients with right hemisphere lesions showed a normal N400 effect for the associatively related targets, but a trend towards a reduced N400 effect for the semantically related word pairs. A dissociation between the N400 results in the word pair paradigm and P300 results in a classical tone oddball task indicated that the N400 effects were not an aspecific consequence of brain lesion, but were related to the nature of the language comprehension impairment. The conclusions drawn from the ERP results are that comprehension deficits in the aphasic patients are due to an impairment in integrating individual word meanings into an overall meaning representation. Right hemisphere patients are more specifically impaired in the processing of semantically more distant relationships, suggesting the involvement of the right hemisphere in semantically coarse coding.

Abstract

Background

Neurodevelopmental conditions are highly heritable. Recent studies have shown that genomic heritability estimates can be confounded by genetic effects mediated via the environment (indirect genetic effects). However, the relative importance of direct versus indirect genetic effects on early variability in traits related to neurodevelopmental conditions is unknown.

Methods

The sample included up to 24,692 parent-offspring trios from the Norwegian MoBa cohort. We use Trio-GCTA to estimate latent direct and indirect genetic effects on mother-reported neurodevelopmental traits at age of 3 years (restricted and repetitive behaviors and interests, inattention, hyperactivity, language, social, and motor development). Further, we investigate to what extent direct and indirect effects are attributable to common genetic variants associated with autism, ADHD, developmental dyslexia, educational attainment, and cognitive ability using polygenic scores (PGS) in regression modeling.

Results

We find evidence for contributions of direct and indirect latent common genetic effects to inattention (direct: explaining 4.8% of variance, indirect: 6.7%) hyperactivity (direct: 1.3%, indirect: 9.6%), and restricted and repetitive behaviors (direct: 0.8%, indirect: 7.3%). Direct effects best explained variation in social and communication, language, and motor development (5.1%–5.7%). Direct genetic effects on inattention were captured by PGS for ADHD, educational attainment, and cognitive ability, whereas direct genetic effects on language development were captured by cognitive ability, educational attainment, and autism PGS. Indirect genetic effects on neurodevelopmental traits were primarily captured by educational attainment and/or cognitive ability PGS.

Conclusions

Results were consistent with differential contributions to neurodevelopmental traits in early childhood from direct and indirect genetic effects. Indirect effects were particularly important for hyperactivity and restricted and repetitive behaviors and interests and may be linked to genetic variation associated with cognition and educational attainment. Our findings illustrate the importance of within-family methods for disentangling genetic processes that influence early neurodevelopmental traits, even when identifiable associations are small.

Abstract

Individual differences in using language are prevalent in our daily lives. Language skills are often assessed in vocational (predominantly written language) and diagnostic contexts. Not much is known, however, about individual differences in spoken language skills. The lack of research is in part due to the lack of suitable test instruments. We introduce the Individual Differences in Language Skills (IDLaS-NL) test battery, a set of 31 behavioural tests that can be used to capture variability in language and relevant general cognitive skills in adult speakers of Dutch. The battery was designed to measure word and sentence production and comprehension skills, linguistic knowledge, nonverbal processing speed, working memory, and nonverbal reasoning. The present article outlines the structure of the battery, describes the materials and procedure of each test, and evaluates the battery’s factor structure based on the results of a sample of 748 Dutch adults, aged between 18 and 30 years, most of them students. The analyses demonstrate that the battery has good construct validity and can be reliably administered both in the lab and via the internet. We therefore recommend the battery as a valuable new tool to assess individual differences in language knowledge and skills; this future work may include linking language skills to other aspects of human cognition and life outcomes.

Abstract

Repair is a core building block of human communication, allowing us to address problems of understanding in conversation. Past research has uncovered the basic mechanisms by which interactants signal and solve such problems. However, the focus has been on verbal interaction, neglecting the fact that human communication is inherently multimodal. Here, we focus on a visual signal particularly prevalent in signalling problems of understanding: eyebrow furrows and raises. We present, first, a corpus study showing that differences in eyebrow actions (furrows versus raises) were systematically associated with differences in the format of verbal repair initiations. Second, we present a follow-up study using an avatar that allowed us to test the causal consequences of addressee eyebrow movements, zooming into the effect of eyebrow furrows as signals of trouble in understanding in particular. The results revealed that addressees’ eyebrow furrows have a striking effect on speakers’ speech, leading speakers to produce answers to questions several seconds longer than when not perceiving addressee eyebrow furrows while speaking. Together, the findings demonstrate that eyebrow movements play a communicative role in initiating repair during conversation rather than being merely epiphenomenal and that their occurrence can critically influence linguistic behaviour. Thus, eyebrow movements should be considered core coordination devices in human conversational interaction.

Abstract

We introduce a new method for measuring prediction and language-vision interactions: tracking the trajectories of hand-reaching movements in Virtual Reality (VR) environments. Spatiotemporal trajectory tracking of hand-reaching movements in VR offers an ecologically valid yet controlled medium for conducting experiments in an environment that mirrors characteristics of real-world behaviors. Importantly, it enables tracking the continuous dynamics of processing on a single-trial level. In an exploratory experiment L2 speakers heard predictive or non-predictive sentences (e.g., “The barber cuts the hair” vs. “The coach remembers the hair”). Participants’ task was to move their hands as quickly and as accurately as possible towards the object most relevant to the sentence. We measured reaction times (RTs) and hand-reaching trajectories as indicators of predictive behavior. There was a main effect of predictability: Predictable items were touched faster than unpredictable ones. Importantly, uncertainty was captured using spatiotemporal survival analysis by prolonged fluctuations in upward and downward vertical hand movements before making a final move to target or distractor. Self-correction of prediction errors was revealed by participants switching the direction of hand-reaching movements mid-trial. We conclude that the Virtual Hand Paradigm enables measuring the onset and dynamics of predictive behavior in real time in single and averaged trial data and captures (un)certainty about target objects and the self-correction of prediction error online in ‘close to real-world’ experimental settings. The new method has great potential to provide additional insights about time-course and intermediate states of processing, provisional interpretations and partial target commitments that go beyond other state-of-the-art methods.

Abstract

One of the earliest sources of mathematical input arises in dyadic parent–child interactions. However, the emphasis has been on parental input only in speech and how input varies across different environmental and child-specific factors remains largely unexplored. Here, we investigated the relationship among parental math input modality and type, children’s gestational status (being preterm vs. full-term born), and vocabulary development. Using book-reading as a medium for parental math input in dyadic interaction, we coded specific math input elicited by Turkish-speaking parents and their 26-month-old children (N = 58, 24 preterms) for speech-only and multimodal (speech and gestures combined) input. Results showed that multimodal math input, as opposed to speech-only math input, was uniquely associated with gestational status, expressive vocabulary, and the interaction between the two. Full-term children with lower expressive vocabulary scores received more multimodal input compared to their preterm peers. However, there was no association between expressive vocabulary and multimodal math input for preterm children. Moreover, cardinality was the most frequent type for both speech-only and multimodal input. These findings suggest that the specific type of multimodal math input can be produced as a function of children’s gestational status and vocabulary development.

Abstract

A series of experiments is reported in which subjects describe simple visual scenes by means of both sentential and non-sentential responses. The data support the following statements about the lexicalization (word finding) process. (1) Words used by speakers in overt naming or sentence production responses are selected by a sequence of two lexical retrieval processes, the first yielding abstract pre-phonological items (Ll -items), the second one adding their phonological shapes (L2-items). (2) The selection of several Ll-items for a multi-word utterance can take place simultaneously. (3) A monitoring process is watching the output of Ll-lexicalization to check if it is in keeping with prevailing constraints upon utterance format. (4) Retrieval of the L2-item which corresponds with a given LI-item waits until the Ld-item has been checked by the monitor, and all other Ll-items needed for the utterance under construction have become available. A coherent picture of the lexicalization process begins to emerge when these characteristics are brought together with other empirical results in the area of naming and sentence production, e.g., picture naming reaction times (Seymour, 1979), speech errors (Garrett, 1980), and word order preferences (Bock, 1982).

Abstract

Advanced diffusion magnetic resonance imaging (dMRI) allows one to probe and assess brain white matter (WM) organisation and microstructure in vivo. Various dMRI models with different theoretical and practical assumptions have been developed, representing partly overlapping characteristics of the underlying brain biology with potentially complementary value in the cognitive and clinical neurosciences. To which degree the different dMRI metrics relate to clinically relevant geno- and phenotypes is still debated. Hence, we investigate how tract-based and whole WM skeleton parameters from different dMRI approaches associate with clinically relevant and white matter-related phenotypes (sex, age, pulse pressure (PP), body-mass-index (BMI), brain asymmetry) and genetic markers in the UK Biobank (UKB, n=52,140) and the Adolescent Brain Cognitive Development (ABCD) Study (n=5,844). In general, none of the imaging approaches could explain all examined phenotypes, though the approaches were overall similar in explaining variability of the examined phenotypes. Nevertheless, particular diffusion parameters of the used dMRI approaches stood out in explaining some important phenotypes known to correlate with general human health outcomes. A multi-compartment Bayesian dMRI approach provided the strongest WM associations with age, and together with diffusion tensor imaging, the largest accuracy for sex-classifications. We find a similar pattern of metric and tract-dependent asymmetries across datasets, with stronger asymmetries in ABCD data. The magnitude of WM associations with polygenic scores as well as PP depended more on the sample, and likely age, than dMRI metrics. However, kurtosis was most indicative of BMI and potentially of bipolar disorder polygenic scores. We conclude that WM microstructure is differentially associated with clinically relevant pheno- and genotypes at different points in life.

Abstract

Background
Reliable language mappings require sufficient language skills. This study evaluated whether linguistic task properties impact feasibility and reliability of navigated transcranial magnetic stimulation (nTMS)-based language mappings in aphasic glioma patients.

Methods
The effect of linguistic complexity on naming accuracy during baseline testing without stimulation and on the number of errors during nTMS was evaluated for 16 moderately and 4 severely expressive aphasic patients.

Result
During baseline, items acquired later in life and used less frequently, a higher amount of multisyllabic, compound, and inanimate items were named inaccurately. Even after removing these more complex items, less frequent and multisyllabic items were more error-prone during stimulation.

Conclusion
Higher linguistic item complexity was associated with decreased naming accuracy during baseline and resulted in a potentially higher false positive rate during nTMS in aphasic glioma patients. Thus, tailoring task complexity to individual performance capabilities may considerably support the preservation of residual functionality.

Abstract

Two types of phonological variation in Dutch, resulting from optional rules, are schwa epenthesis and schwa deletion. In a lexical decision experiment it was investigated whether the phonological variants were processed similarly to the standard forms. It was found that the two types of variation patterned differently. Words with schwa epenthesis were processed faster and more accurately than the standard forms, whereas words with schwa deletion led to less fast and less accurate responses. The results are discussed in relation to the role of consonant-vowel alternations in speech processing and the perceptual integrity of onset clusters.

Abstract

Making a self-repair in speech typically proceeds in three phases. The first phase involves the monitoring of one’s own speech and the interruption of the flow of speech when trouble is detected. From an analysis of 959 spontaneous self-repairs it appears that interrupting follows detection promptly, with the exception that correct words tend to be completed. Another finding is that detection of trouble improves towards the end of constituents. The second phase is characterized by hesitation, pausing, but especially the use of so-called editing terms. Which editing term is used depends on the nature of the speech trouble in a rather regular fashion: Speech errors induce other editing terms than words that are merely inappropriate, and trouble which is detected quickly by the speaker is preferably signalled by the use of ‘uh’. The third phase consists of making the repair proper The linguistic well-formedness of a repair is not dependent on the speaker’s respecting the integriv of constituents, but on the structural relation between original utterance and repair. A bi-conditional well-formedness rule links this relation to a corresponding relation between the conjuncts of a coordination. It is suggested that a similar relation holds also between question and answer. In all three cases the speaker respects certain Istructural commitments derived from an original utterance. It was finally shown that the editing term plus the first word of the repair proper almost always contain sufficient information for the listener to decide how the repair should be related to the original utterance. Speakers almost never produce misleading information in this respect. It is argued that speakers have little or no access to their speech production process; self-monitoring is probably based on parsing one’s own inner or overt speech.

Abstract

Spontaneous self-corrections in speech pose a communication problem; the speaker must make clear to the listener not only that the original Utterance was faulty, but where it was faulty and how the fault is to be corrected. Prosodic marking of corrections - making the prosody of the repair noticeably different from that of the original utterance - offers a resource which the speaker can exploit to provide the listener with such information. A corpus of more than 400 spontaneous speech repairs was analysed, and the prosodic characteristics compared with the syntactic and semantic characteristics of each repair. Prosodic marking showed no relationship at all with the syntactic characteristics of repairs. Instead, marking was associated with certain semantic factors: repairs were marked when the original utterance had been actually erroneous, rather than simply less appropriate than the repair; and repairs tended to be marked more often when the set of items encompassing the error and the repair was small rather than when it was large. These findings lend further weight to the characterization of accent as essentially semantic in function.

Abstract

This review describes some recent, unexpected findings concerning variation in spatial language across cultures, and places them in the context of the general anthropology of space on the one hand, and theories of spatial cognition in the cognitive sciences on the other. There has been much concern with the symbolism of space in anthropological writings, but little on concepts of space in practical activities. This neglect of everyday spatial notions may be due to unwitting ethnocentrism, the assumption in Western thinking generally that notions of space are universally of a single kind. Recent work shows that systems of spatial reckoning and description can in fact be quite divergent across cultures, linguistic differences correlating with distinct cognitive tendencies. This unexpected cultural variation raises interesting questions concerning the relation between cultural and linguistic concepts and the biological foundations of cognition. It argues for more sophisticated models relating culture and cognition than we currently have available.

Abstract

Kidney stones (nephrolithiasis), which affect 12% of males and 5% of females in the western world, are familial in 45% of patients and are most commonly associated with hypercalciuria. Three disorders of hypercalciuric nephrolithiasis (Dent's disease, X-linked recessive nephrolithiasis (XRN), and X-linked recessive hypophosphataemic rickets (XLRH)) have been mapped to Xp11.22 (refs 5-7). A microdeletion in one Dent's disease kindred allowed the identification of a candidate gene, CLCN5 (refs 8,9) which encodes a putative renal chloride channel. Here we report the investigation of 11 kindreds with these renal tubular disorders for CLCN5 abnormalities; this identified three nonsense, four missense and two donor splice site mutations, together with one intragenic deletion and one microdeletion encompassing the entire gene. Heterologous expression of wild-type CLCN5 in Xenopus oocytes yielded outwardly rectifying chloride currents, which were either abolished or markedly reduced by the mutations. The common aetiology for Dent's disease, XRN and XLRH indicates that CLCN5 may be involved in other renal tubular disorders associated with kidney stones

Abstract

Libraries are very often considered the hallway to developing knowledge. However, the lack of adequate staff within Indian libraries makes catering to the visitors’ needs difficult. Previous systems that have sought to address libraries’ needs through automation have mostly been limited to storage and fetching aspects while lacking in their interaction aspect. We propose to address this issue by incorporating social robots within Indian libraries that can communicate and address the visitors’ queries in a multi-modal fashion attempting to make the experience more natural and appealing while helping reduce the burden on the librarians. In this paper, we propose and deploy a Furhat robot as a robot librarian by programming it on certain core librarian functionalities. We evaluate our system with a physical robot librarian (N = 26). The results show that the robot librarian was found to be very informative and overall left with a positive impression and preference.