The Experts below are selected from a list of 360 Experts worldwide ranked by ideXlab platform
Michael S Beauchamp - One of the best experts on this subject based on the ideXlab platform.
-
mouth and voice a relationship between visual and auditory preference in the human Superior Temporal Sulcus
The Journal of Neuroscience, 2017Co-Authors: Lin L Zhu, Michael S BeauchampAbstract:Cortex in and around the human posterior Superior Temporal Sulcus (pSTS) is known to be critical for speech perception. The pSTS responds to both the visual modality (especially biological motion) and the auditory modality (especially human voices). Using fMRI in single subjects with no spatial smoothing, we show that visual and auditory selectivity are linked. Regions of the pSTS were identified that preferred visually presented moving mouths (presented in isolation or as part of a whole face) or moving eyes. Mouth-preferring regions responded strongly to voices and showed a significant preference for vocal compared with nonvocal sounds. In contrast, eye-preferring regions did not respond to either vocal or nonvocal sounds. The converse was also true: regions of the pSTS that showed a significant response to speech or preferred vocal to nonvocal sounds responded more strongly to visually presented mouths than eyes. These findings can be explained by environmental statistics. In natural environments, humans see visual mouth movements at the same time as they hear voices, while there is no auditory accompaniment to visual eye movements. The strength of a voxel's preference for visual mouth movements was strongly correlated with the magnitude of its auditory speech response and its preference for vocal sounds, suggesting that visual and auditory speech features are coded together in small populations of neurons within the pSTS.SIGNIFICANCE STATEMENT Humans interacting face to face make use of auditory cues from the talker's voice and visual cues from the talker's mouth to understand speech. The human posterior Superior Temporal Sulcus (pSTS), a brain region known to be important for speech perception, is complex, with some regions responding to specific visual stimuli and others to specific auditory stimuli. Using BOLD fMRI, we show that the natural statistics of human speech, in which voices co-occur with mouth movements, are reflected in the neural architecture of the pSTS. Different pSTS regions prefer visually presented faces containing either a moving mouth or moving eyes, but only mouth-preferring regions respond strongly to voices.
-
the social mysteries of the Superior Temporal Sulcus
Trends in Cognitive Sciences, 2015Co-Authors: Michael S BeauchampAbstract:The Superior Temporal Sulcus (STS) is implicated in a variety of social processes, ranging from language perception to simulating the mental processes of others (theory of mind). In a new study, Deen and colleagues use functional magnetic resonance imaging (fMRI) to show a regular anterior–posterior organization in the STS for different social tasks.
-
multisensory speech perception without the left Superior Temporal Sulcus
NeuroImage, 2012Co-Authors: Sarah H Baum, Randi C Martin, Cris A Hamilton, Michael S BeauchampAbstract:Converging evidence suggests that the left Superior Temporal Sulcus (STS) is a critical site for multisensory integration of auditory and visual information during speech perception. We report a patient, SJ, who suffered a stroke that damaged the left tempo-parietal area, resulting in mild anomic aphasia. Structural MRI showed complete destruction of the left middle and posterior STS, as well as damage to adjacent areas in the Temporal and parietal lobes. Surprisingly, SJ demonstrated preserved multisensory integration measured with two independent tests. First, she perceived the McGurk effect, an illusion that requires integration of auditory and visual speech. Second, her perception of morphed audiovisual speech with ambiguous auditory or visual information was significantly influenced by the opposing modality. To understand the neural basis for this preserved multisensory integration, blood-oxygen level dependent functional magnetic resonance imaging (BOLD fMRI) was used to examine brain responses to audiovisual speech in SJ and 23 healthy age-matched controls. In controls, bilateral STS activity was observed. In SJ, no activity was observed in the damaged left STS but in the right STS, more cortex was active in SJ than in any of the normal controls. Further, the amplitude of the BOLD response in right STS response to McGurk stimuli was significantly greater in SJ than in controls. The simplest explanation of these results is a reorganization of SJ's cortical language networks such that the right STS now subserves multisensory integration of speech.
-
dynamic changes in Superior Temporal Sulcus connectivity during perception of noisy audiovisual speech
The Journal of Neuroscience, 2011Co-Authors: Audrey R Nath, Michael S BeauchampAbstract:Humans are remarkably adept at understanding speech, even when it is contaminated by noise. Multisensory integration may explain some of this ability: combining independent information from the auditory modality (vocalizations) and the visual modality (mouth movements) reduces noise and increases accuracy. Converging evidence suggests that the Superior Temporal Sulcus (STS) is a critical brain area for multisensory integration, but little is known about its role in the perception of noisy speech. Behavioral studies have shown that perceptual judgments are weighted by the reliability of the sensory modality: more reliable modalities are weighted more strongly, even if the reliability changes rapidly. We hypothesized that changes in the functional connectivity of STS with auditory and visual cortex could provide a neural mechanism for perceptual reliability weighting. To test this idea, we performed five blood oxygenation level-dependent functional magnetic resonance imaging and behavioral experiments in 34 healthy subjects. We found increased functional connectivity between the STS and auditory cortex when the auditory modality was more reliable (less noisy) and increased functional connectivity between the STS and visual cortex when the visual modality was more reliable, even when the reliability changed rapidly during presentation of successive words. This finding matched the results of a behavioral experiment in which the perception of incongruent audiovisual syllables was biased toward the more reliable modality, even with rapidly changing reliability. Changes in STS functional connectivity may be an important neural mechanism underlying the perception of noisy speech.
-
touch sound and vision in human Superior Temporal Sulcus
NeuroImage, 2008Co-Authors: Michael S Beauchamp, Nafi E Yasar, Richard E FryeAbstract:Abstract Human Superior Temporal Sulcus (STS) is thought to be a key brain area for multisensory integration. Many neuroimaging studies have reported integration of auditory and visual information in STS but less is known about the role of STS in integrating other sensory modalities. In macaque STS, the Superior Temporal polysensory area (STP) responds to somatosensory, auditory and visual stimulation. To determine if human STS contains a similar area, we measured brain responses to somatosensory, auditory and visual stimuli using blood-oxygen level dependent functional magnetic resonance imaging (BOLD fMRI). An area in human posterior STS, STSms (multisensory), responded to stimulation in all three modalities. STSms responded during both active and passive presentation of unisensory somatosensory stimuli and showed larger responses for more intense vs. less intense tactile stimuli, hand vs. foot, and contralateral vs. ipsilateral tactile stimulation. STSms showed responses of similar magnitude for unisensory tactile and auditory stimulation, with an enhanced response to simultaneous auditory–tactile stimulation. We conclude that STSms is important for integrating information from the somatosensory as well as the auditory and visual modalities, and could be the human homolog of macaque STP.
Gregory Mccarthy - One of the best experts on this subject based on the ideXlab platform.
-
attributing intentions to random motion engages the posterior Superior Temporal Sulcus
Social Cognitive and Affective Neuroscience, 2014Co-Authors: Su Mei Lee, Tao Gao, Gregory MccarthyAbstract:The right posterior Superior Temporal Sulcus (pSTS) is a neural region involved in assessing the goals and intentions underlying the motion of social agents. Recent research has identified visual cues, such as chasing, that trigger animacy detection and intention attribution. When readily available in a visual display, these cues reliably activate the pSTS. Here, using functional magnetic resonance imaging, we examined if attributing intentions to random motion would likewise engage the pSTS. Participants viewed displays of four moving circles and were instructed to search for chasing or mirror-correlated motion. On chasing trials, one circle chased another circle, invoking the percept of an intentional agent; while on correlated motion trials, one circle’s motion was mirror reflected by another. On the remaining trials, all circles moved randomly. As expected, pSTS activation was greater when participants searched for chasing vs correlated motion when these cues were present in the displays. Of critical importance, pSTS activation was also greater when participants searched for chasing compared to mirror-correlated motion when the displays in both search conditions were statistically identical random motion. We conclude that pSTS activity associated with intention attribution can be invoked by top–down processes in the absence of reliable visual cues for intentionality.
-
dissociating the detection of intentionality from animacy in the right posterior Superior Temporal Sulcus
The Journal of Neuroscience, 2012Co-Authors: Tao Gao, Brian J Scholl, Gregory MccarthyAbstract:Certain motion patterns can cause even simple geometric shapes to be perceived as animate. Viewing such displays evokes strong activation in temporoparietal cortex, including areas in and near the (predominantly right) posterior Superior Temporal Sulcus (pSTS). These brain regions are sensitive to socially relevant information, but the nature of the social information represented in pSTS is unclear. For example, previous studies have been unable to explore the perception of shifting intentions beyond animacy. This is due in part to the ubiquitous use of complex displays that combine several types of social information, with little ability to control lower-level visual cues. Here we address this challenge by manipulating intentionality with parametric precision while holding cues to animacy constant. Human subjects were exposed to a “wavering wolf” display, in which one item (the wolf) chased continuously, but its goal (i.e., the sheep) frequently switched among other shapes. By contrasting this with three other control displays, we find that the wolf9s changing intentions gave rise to strong selective activation in the right pSTS, compared with (1) a wolf that chases with a single unchanging intention, (2) very similar patterns of motion (and motion change) that are not perceived as goal-directed, and (3) abrupt onsets and offsets of moving objects. These results demonstrate in an especially well controlled manner that right pSTS is involved in social perception beyond physical properties such as motion energy and salience. More importantly, these results demonstrate for the first time that this region represents perceived intentions beyond animacy.
-
the posterior Superior Temporal Sulcus is sensitive to the outcome of human and non human goal directed actions
Social Cognitive and Affective Neuroscience, 2011Co-Authors: Sarah Shultz, Kevin A Pelphrey, Su Mei Lee, Gregory MccarthyAbstract:Prior studies have demonstrated that the posterior Superior Temporal Sulcus (pSTS) is involved in analyzing the intentions underlying actions and is sensitive to the context within which actions occur. However, it is debated whether the pSTS is actually sensitive to goals underlying actions, or whether previous studies can be interpreted to suggest that the pSTS is instead involved in the allocation of visual attention towards unexpected events. In addition, little is known about whether the pSTS is specialized for reasoning about the actions of social agents or whether the pSTS is sensitive to the actions of both animate and inanimate entities. Here, using functional magnetic resonance imaging, we investigated activation in response to passive viewing of successful and unsuccessful animate and inanimate goal-directed actions. Activation in the right pSTS was stronger in response to failed actions compared to successful actions, suggesting that the pSTS plays a role in encoding the goals underlying actions. Activation in the pSTS did not differentiate between animate and inanimate actions, suggesting that the pSTS is sensitive to the goal-directed actions of both animate and inanimate entities.
-
face specific resting functional connectivity between the fusiform gyrus and posterior Superior Temporal Sulcus
Frontiers in Human Neuroscience, 2010Co-Authors: Nicholas B Turkbrowne, Sam V Normanhaignere, Gregory MccarthyAbstract:Faces activate specific brain regions in fMRI, including the fusiform gyrus (FG) and the posterior Superior Temporal Sulcus (pSTS). The fact that the FG and pSTS are frequently co-activated suggests that they may interact synergistically in a distributed face processing network. Alternatively, the functions implemented by these regions may be encapsulated from each other. It has proven difficult to evaluate these two accounts during visual processing of face stimuli. However, if the FG and pSTS interact during face processing, the substrate for such interactions may be apparent in a correlation of the BOLD timeseries from these two regions during periods of rest when no faces are present. To examine face-specific resting correlations, we developed a new partial functional connectivity approach in which we removed variance from the FG that was shared with other category-selective and control regions. The remaining ‘face-specific’ FG resting variance was then used to predict resting signals throughout the brain. In two experiments, we observed face-specific resting functional connectivity between FG and pSTS, and importantly, these correlations overlapped precisely with the face-specific pSTS region obtained from independent localizer runs. Additional region-of-interest and pattern analyses confirmed that the FG-pSTS resting correlations were face-specific. These findings support a model in which face processing is distributed among a finite number of connected, but nevertheless face-specialized regions. The discovery of category-specific interactions in the absence of visual input suggests that resting networks may provide a latent foundation for task processing.
-
when strangers pass processing of mutual and averted social gaze in the Superior Temporal Sulcus
Psychological Science, 2004Co-Authors: Kevin A Pelphrey, Gregory Mccarthy, Ronald J ViolaAbstract:Using functional magnetic resonance imaging (fMRI), we investigated brain activity evoked by mutual and averted gaze in a compelling and commonly experienced social encounter. Through virtual-reality goggles, subjects viewed a man who walked toward them and shifted his neutral gaze either toward (mutual gaze) or away (averted gaze) from them. Robust activity was evoked in the Superior Temporal Sulcus (STS) and fusiform gyrus (FFG). For both conditions, STS activity was strongly right lateralized. Mutual gaze evoked greater activity in the STS than did averted gaze, whereas the FFG responded equivalently to mutual and averted gaze. Thus, we show that the STS is involved in processing social information conveyed by shifts in gaze within an overtly social context. This study extends understanding of the role of the STS in social cognition and social perception by demonstrating that it is highly sensitive to the context in which a human action occurs.
Andrew J Calder - One of the best experts on this subject based on the ideXlab platform.
-
network interactions explain sensitivity to dynamic faces in the Superior Temporal Sulcus
Cerebral Cortex, 2015Co-Authors: Nicholas Furl, Karl J Friston, Richard N Henson, Andrew J CalderAbstract:The Superior Temporal Sulcus (STS) in the human and monkey is sensitive to the motion of complex forms such as facial and bodily actions. We used functional magnetic resonance imaging (fMRI) to explore network-level explanations for how the form and motion information in dynamic facial expressions might be combined in the human STS. Ventral occipitoTemporal areas selective for facial form were localized in occipital and fusiform face areas (OFA and FFA), and motion sensitivity was localized in the more dorsal Temporal area V5. We then tested various connectivity models that modeled communication between the ventral form and dorsal motion pathways. We show that facial form information modulated transmission of motion information from V5 to the STS, and that this face-selective modulation likely originated in OFA. This finding shows that form-selective motion sensitivity in the STS can be explained in terms of modulation of gain control on information flow in the motion pathway, and provides a substantial constraint for theories of the perception of faces and biological motion.
-
direction sensitive codes for observed head turns in human Superior Temporal Sulcus
Cerebral Cortex, 2012Co-Authors: Johan D Carlin, James B Rowe, Nikolaus Kriegeskorte, Russell Thompson, Andrew J CalderAbstract:Humans and other primates are adept at using the direction of another's gaze or head turn to infer where that individual is attending. Research in macaque neurophysiology suggests that anterior Superior Temporal Sulcus (STS) contains a direction-sensitive code for such social attention cues. By contrast, most human functional Magnetic resonance imaging (fMRI) studies report that posterior STS is responsive to social attention cues. It is unclear whether this functional discrepancy is caused by a species difference or by experimental design differences. Furthermore, social attention cues are dynamic in naturalistic social interaction, but most studies to date have been restricted to static displays. In order to address these issues, we used multivariate pattern analysis of fMRI data to test whether response patterns in human right STS distinguish between leftward and rightward dynamic head turns. Such head turn discrimination was observed in right anterior STS/Superior Temporal gyrus (STG). Response patterns in this region were also significantly more discriminable for head turn direction than for rotation direction in physically matched ellipsoid control stimuli. Our findings suggest a role for right anterior STS/STG in coding the direction of motion in dynamic social attention cues.
-
a head view invariant representation of gaze direction in anterior Superior Temporal Sulcus
Current Biology, 2011Co-Authors: Johan D Carlin, Andrew J Calder, James B Rowe, Nikolaus Kriegeskorte, Hamed NiliAbstract:Humans show a remarkable ability to discriminate others' gaze direction, even though a given direction can be conveyed by many physically dissimilar configurations of different eye positions and head views. For example, eye contact can be signaled by a rightward glance in a left-turned head or by direct gaze in a front-facing head. Such acute gaze discrimination implies considerable perceptual invariance. Previous human research found that Superior Temporal Sulcus (STS) responds preferentially to gaze shifts [1], but the underlying representation that supports such general responsiveness remains poorly understood. Using multivariate pattern analysis (MVPA) of human functional magnetic resonance imaging (fMRI) data, we tested whether STS contains a higher-order, head view-invariant code for gaze direction. The results revealed a finely graded gaze direction code in right anterior STS that was invariant to head view and physical image features. Further analyses revealed similar gaze effects in left anterior STS and precuneus. Our results suggest that anterior STS codes the direction of another's attention regardless of how this information is conveyed and demonstrate how high-level face areas carry out fine-grained, perceptually relevant discrimination through invariance to other face features.
-
autism spectrum traits in the typical population predict structure and function in the posterior Superior Temporal Sulcus
Cerebral Cortex, 2011Co-Authors: Elisabeth A H Von Dem Hagen, Andrew D Engell, Lauri Nummenmaa, Michael P Ewbank, Andrew J CalderAbstract:Autism spectrum disorders (ASDs) are typically characterized by impaired social interaction and communication, narrow interests, and repetitive behaviors. The heterogeneity in the severity of these characteristics across individuals with ASD has led some researchers to suggest that these disorders form a continuum which extends into the general, or “typical,” population, and there is growing evidence that the extent to which typical adults display autistic traits, as measured using the autism-spectrum quotient (AQ), predicts performance on behavioral tasks that are impaired in ASD. Here, we show that variation in autism spectrum traits is related to cortical structure and function within the typical population. Voxel-based morphometry showed that increased AQ scores were associated with decreased white matter volume in the posterior Superior Temporal Sulcus (pSTS), a region important in processing socially relevant stimuli and associated with structural and functional impairments in ASD. In addition, AQ was correlated with the extent of cortical deactivation of an adjacent area of pSTS during a Stroop task relative to rest, reflecting variation in resting state function. The results provide evidence that autism spectrum characteristics are reflected in neural structure and function across the typical (non-ASD) population.
-
meg demonstrates a supra additive response to facial and vocal emotion in the right Superior Temporal Sulcus
Proceedings of the National Academy of Sciences of the United States of America, 2009Co-Authors: Cindy C Hagan, Andrew J Calder, William Woods, Sam R Johnson, Gary G R Green, Andrew W YoungAbstract:An influential neural model of face perception suggests that the posterior Superior Temporal Sulcus (STS) is sensitive to those aspects of faces that produce transient visual changes, including facial expression. Other researchers note that recognition of expression involves multiple sensory modalities and suggest that the STS also may respond to crossmodal facial signals that change transiently. Indeed, many studies of audiovisual (AV) speech perception show STS involvement in AV speech integration. Here we examine whether these findings extend to AV emotion. We used magnetoencephalography to measure the neural responses of participants as they viewed and heard emotionally congruent fear and minimally congruent neutral face and voice stimuli. We demonstrate significant supra-additive responses (i.e., where AV > [unimodal auditory + unimodal visual]) in the posterior STS within the first 250 ms for emotionally congruent AV stimuli. These findings show a role for the STS in processing crossmodal emotive signals.
Yingzu Huang - One of the best experts on this subject based on the ideXlab platform.
-
intermittent theta burst stimulation over the posterior Superior Temporal Sulcus for children with autism spectrum disorder a 4 week randomized blinded controlled trial followed by another 4 week open label intervention
Autism, 2021Co-Authors: Yilung Chen, Yiping Chao, Sophie Hsinyi Liang, Weichih Chin, Taili Chou, Susan Shurfen Gau, Yingzu HuangAbstract:The posterior Superior Temporal Sulcus is a potential therapeutic target of brain stimulation for autism spectrum disorder. We conducted a 4-week randomized, single-blind parallel sham-controlled t...
Olivier Coulon - One of the best experts on this subject based on the ideXlab platform.
-
plis de passage in the Superior Temporal Sulcus morphology and local connectivity
NeuroImage, 2021Co-Authors: Clementine Bodin, Jean Regis, Pascal Belin, Alexandre Pron, Le M Mao, Olivier CoulonAbstract:While there is a profusion of functional investigations involving the Superior Temporal Sulcus (STS), our knowledge of the anatomy of this Sulcus is still limited by a large individual variability. In particular, an accurate characterization of the "plis de passage" (PPs), annectant gyri inside the fold, is lacking to explain this variability. Performed on 90 subjects of the HCP database, our study revealed that PPs constitute landmarks that can be identified from the geometry of the STS walls. They were found associated with a specific U-shape white-matter connectivity between the two banks of the Sulcus, the amount of connectivity being related to the depth of the PPs. These findings raise new hypotheses regarding the spatial organization of PPs, the relation between cortical anatomy and structural connectivity, as well as the possible role of PPs in the regional functional organization.
-
the chaotic morphology of the left Superior Temporal Sulcus is genetically constrained
NeuroImage, 2018Co-Authors: Yann Le Guen, Denis Riviere, Jeanfrancois Mangin, Olivier Coulon, Francois Leroy, Ghislaine Dehaenelambertz, Guillaume Auzias, Antoine Grigis, Vincent FrouinAbstract:Abstract The asymmetry of the Superior Temporal Sulcus (STS) has been identified as a species-specific feature of the human brain. The so-called Superior Temporal asymmetrical pit (STAP) area is observed from the last trimester of gestation onwards and is far less pronounced in the chimpanzee brain. This asymmetry is associated with more frequent sulcal interruptions, named plis de passage (PPs), leading to the irregular morphology of the left Sulcus. In this paper, we aimed to characterize the variability, asymmetry, and heritability of these interruptions in the STS in comparison with the other main sulci. We developed an automated method to extract PPs across the cortex based on a highly reproducible grid of sulcal pits across individuals, which we applied to a subset of Human Connectome Project (HCP) subjects (N = 820). We report that only a few PPs across the cortex are genetically constrained, namely in the collateral, postcentral and Superior Temporal sulci and the calcarine fissure. Moreover, some PPs occur more often in one hemisphere than the other, namely in the precentral, postcentral, intraparietal sulci, as well as in both inferior and Superior Temporal sulci. Most importantly, we found that only the interruptions within the STAP region are both asymmetric and genetically constrained. Because this morphological pattern is located in an area of the left hemisphere related to speech, our results suggest structural constraints on the architecture of the linguistic network.
-
anatomo functional correspondence in the Superior Temporal Sulcus
22nd Annual Meeting of the Organization for Human Brain Mapping, 2016Co-Authors: Clementine Bodin, Sylvain Takerkart, Pascal Belin, Olivier CoulonAbstract:The Superior Temporal Sulcus (STS) is an intriguing region both for its complex anatomy and for the multiple functions that it hosts. Unfortunately, most studies explored either the functional organization or the anatomy of the STS only. Here, we link these two aspects by investigating anatomo-functional correspondences between the voice-sensitive cortex (Temporal Voice Areas) and the STS depth. To do so, anatomical and functional scans of 116 subjects were processed such as to generate individual surface maps on which both depth and functional voice activity can be analyzed. Individual depth profiles of manually drawn STS and functional profiles from a voice localizer (voice > non-voice) maps were extracted and compared to assess anatomo-functional correspondences. Three major results were obtained: first, the STS exhibits a highly significant rightward depth asymmetry in its middle part. Second, there is an anatomo-functional correspondence between the location of the voice-sensitive peak and the deepest point inside this asymmetrical region bilaterally. Finally, we showed that this correspondence was independent of the gender and, using a machine learning approach, that it existed at the individual level. These findings offer new perspectives for the understanding of anatomo-functional correspondences in this complex cortical region.
-
new human specific brain landmark the depth asymmetry of Superior Temporal Sulcus
Proceedings of the National Academy of Sciences of the United States of America, 2015Co-Authors: Francois Leroy, Olivier Coulon, Herve Glasel, Jessica Dubois, Qing Cai, Stephanie L Bogart, Karla Monzalvo, Clara Fischer, Lise Van Der Haegen, Audrey BenezitAbstract:Identifying potentially unique features of the human cerebral cortex is a first step to understanding how evolution has shaped the brain in our species. By analyzing MR images obtained from 177 humans and 73 chimpanzees, we observed a human-specific asymmetry in the Superior Temporal Sulcus at the heart of the communication regions and which we have named the “Superior Temporal asymmetrical pit” (STAP). This 45-mm-long segment ventral to Heschl’s gyrus is deeper in the right hemisphere than in the left in 95% of typical human subjects, from infanthood till adulthood, and is present, irrespective of handedness, language lateralization, and sex although it is greater in males than in females. The STAP also is seen in several groups of atypical subjects including persons with situs inversus, autistic spectrum disorder, Turner syndrome, and corpus callosum agenesis. It is explained in part by the larger number of sulcal interruptions in the left than in the right hemisphere. Its early presence in the infants of this study as well as in fetuses and premature infants suggests a strong genetic influence. Because this asymmetry is barely visible in chimpanzees, we recommend the STAP region during midgestation as an important phenotype to investigate asymmetrical variations of gene expression among the primate lineage. This genetic target may provide important insights regarding the evolution of the crucial cognitive abilities sustained by this Sulcus in our species, namely communication and social cognition.
