The Experts below are selected from a list of 6807 Experts worldwide ranked by ideXlab platform
Charles Spence - One of the best experts on this subject based on the ideXlab platform.
-
the scent of attraction and the smell of success Crossmodal influences on person perception
Cognitive Research: Principles and Implications, 2021Co-Authors: Charles SpenceAbstract:In recent decades, there has been an explosion of research into the Crossmodal influence of olfactory cues on multisensory person perception. Numerous peer-reviewed studies have documented that a variety of olfactory stimuli, from ambient malodours through to fine fragrances, and even a range of chemosensory body odours can influence everything from a perceiver's judgments of another person's attractiveness, age, affect, health/disease status, and even elements of their personality. The Crossmodal and multisensory contributions to such effects are reviewed and the limitations/peculiarities of the research that have been published to date are highlighted. At the same time, however, it is important to note that the presence of scent (and/or the absence of malodour) can also influence people's (i.e., a perceiver's) self-confidence which may, in turn, affect how attractive they appear to others. Several potential cognitive mechanisms have been put forward to try and explain such Crossmodal/multisensory influences, and some of the neural substrates underpinning these effects have now been characterized. At the end of this narrative review, a number of the potential (and actual) applications for, and implications of, such Crossmodal/multisensory phenomena involving olfaction are outlined briefly.
-
assessing the role of emotional mediation in explaining Crossmodal correspondences involving musical stimuli
Multisensory Research, 2020Co-Authors: Charles SpenceAbstract:A wide variety of Crossmodal correspondences, defined as the often surprising connections that people appear to experience between simple features, attributes, or dimensions of experience, either physically present or else merely imagined, in different sensory modalities, have been demonstrated in recent years. However, a number of Crossmodal correspondences have also been documented between more complex (i.e., multi-component) stimuli, such as, for example, pieces of music and paintings. In this review, the extensive evidence supporting the emotional mediation account of the Crossmodal correspondences between musical stimuli (mostly pre-recorded short classical music excerpts) and visual stimuli, including colour patches through to, on occasion, paintings, is critically evaluated. According to the emotional mediation account, it is the emotional associations that people have with stimuli that constitutes one of the fundamental bases on which Crossmodal associations are established. Taken together, the literature that has been published to date supports emotional mediation as one of the key factors underlying the Crossmodal correspondences involving emotionally-valenced stimuli, both simple and complex.
-
Representational momentum in vision and touch: Visual motion information biases tactile spatial localization
Attention Perception & Psychophysics, 2020Co-Authors: Simon Merz, Hauke S. Meyerhoff, Christian Frings, Charles SpenceAbstract:After an object disappears, the vanishing point is shifted in the direction of motion, a phenomenon known as representational momentum . The present study focused on the relationship between motion information and spatial location in a Crossmodal setting. In two visuotactile experiments, we studied how motion information in one sensory modality affects the perceived final location of a motion signal (congruent vs. incongruent left-right motion direction) in another modality. The results revealed a unidirectional Crossmodal influence of motion information on spatial localization performance. While visual motion information influenced the perceived final location of the tactile stimulus, tactile motion information had no influence on visual localization. These results therefore extend the existing literature on Crossmodal influences on spatial location and are discussed in relation to current theories of multisensory perception.
-
temperature based Crossmodal correspondences causes and consequences
Multisensory Research, 2020Co-Authors: Charles SpenceAbstract:The last few years have seen an explosive growth of research interest in the Crossmodal correspondences, the sometimes surprising associations that people experience between stimuli, attributes, or perceptual dimensions, such as between auditory pitch and visual size, or elevation. To date, the majority of this research has tended to focus on audiovisual correspondences. However, a variety of Crossmodal correspondences have also been demonstrated with tactile stimuli, involving everything from felt shape to texture, and from weight through to temperature. In this review, I take a closer look at temperature-based correspondences. The empirical research not only supports the existence of robust Crossmodal correspondences between temperature and colour (as captured by everyday phrases such as 'red hot') but also between temperature and auditory pitch. Importantly, such correspondences have (on occasion) been shown to influence everything from our thermal comfort in coloured environments through to our response to the thermal and chemical warmth associated with stimulation of the chemical senses, as when eating, drinking, and sniffing olfactory stimuli. Temperature-based correspondences are considered in terms of the four main classes of correspondence that have been identified to date, namely statistical, structural, semantic, and affective. The hope is that gaining a better understanding of temperature-based Crossmodal correspondences may one day also potentially help in the design of more intuitive sensory-substitution devices, and support the delivery of immersive virtual and augmented reality experiences.
-
on the relative nature of pitch based Crossmodal correspondences
Multisensory Research, 2019Co-Authors: Charles SpenceAbstract:This review deals with the question of the relative vs absolute nature of Crossmodal correspondences, with a specific focus on those correspondences involving the auditory dimension of pitch. Crossmodal correspondences have been defined as the often-surprising Crossmodal associations that people experience between features, attributes, or dimensions of experience in different sensory modalities, when either physically present, or else merely imagined. In the literature, Crossmodal correspondences have often been contrasted with synaesthesia in that the former are frequently said to be relative phenomena (e.g., it is the higher-pitched of two sounds that is matched with the smaller of two visual stimuli, say, rather than there being a specific one-to-one Crossmodal mapping between a particular pitch of sound and size of object). By contrast, in the case of synaesthesia, the idiosyncratic mapping between inducer and concurrent tends to be absolute (e.g., it is a particular sonic inducer that elicits a specific colour concurrent). However, a closer analysis of the literature soon reveals that the distinction between relative and absolute in the case of Crossmodal correspondences may not be as clear-cut as some commentators would have us believe. Furthermore, it is important to note that the relative vs absolute question may receive different answers depending on the particular (class of) correspondence under empirical investigation.
Jon Driver - One of the best experts on this subject based on the ideXlab platform.
-
Neural correlates of Crossmodal visual-tactile extinction and of tactile awareness revealed by fMRI in a right-hemisphere stroke patient
NEUROPSYCHOLOGIA, 2006Co-Authors: Jon DriverAbstract:We used fMRl to study the neural correlates of Crossmodal, visual-tactile extinction in a single case (patient GK). GK has chronic extinction after a lesion centred on right inferior parietal cortex, and has previously been investigated extensively in purely visual fMRI studies [e.g. Rees, G., Wojciulik, E., Clarke, K., Husain, M., Frith, C., & Driver, J. (2000). Unconscious activation of visual cortex in the damaged right hemisphere of a parietal patient with extinction. Brain, 123(Pt 8), 1624-1633; Rees, G., Kreiman, G., & Koch, C. (2002). Neural correlates of consciousness in humans. Nature Reviews Neuroscience, 3(4), 261-270]. With concurrent stimulation of the right visual field plus left index finger, GK showed Crossmodal extinction of left touch on approximately half of such trials here (reflecting impaired sensitivity, i.e. lowered d-prime), albeit becoming aware of left touch on the other half. fMRI revealed activation of contralateral primary somatosensory cortex on Crossmodal trials when touch was extinguished from awareness, suggesting unconscious residual processing there. When GK became aware of the left touch, additional activation was found in surviving right parietal cortex, and in frontal regions; moreover, functional coupling was enhanced with a region of frontal cortex implicated in awareness by previous work. Finally, on trials where Crossmodal extinction arose, surviving right parietal cortex showed stronger functional coupling with the left visual and right somatosensory regions driven by the competing stimuli, indicating that Crossmodal extinction arises when inputs to separate modalities interact competitively via multimodal cortex. (c) 2006 Elsevier Ltd. All rights reserved.
-
Crossmodal space and Crossmodal attention
2004Co-Authors: Charles Spence, Jon DriverAbstract:1. Development of multisensory spatial integration 2. Crossmodal spatial interactions in subcortical and cortical circuits 3. A system of multimodal areas in the primate brain 4. Neuropsychological evidence for multimodal representations of space near specific body parts 5. Multimodal spatial representations in the primate parietal lobe 6. A computational neural theory of multisensory spatial representations 7. The psychology of multimodal perception 8. Crossmodal spatial attention: evidence from human performance 9. Electrophysiology of human Crossmodal spatial attention 10. Functional imaging of Crossmodal spatial representations and Crossmodal spatial attention 11. Exogenous spatial-cuing studies of human Crossmodal attention and multisensory integration
-
spatial attention and Crossmodal interactions between vision and touch
Neuropsychologia, 2001Co-Authors: Emiliano Macaluso, Jon DriverAbstract:In the present paper, we review several functional imaging studies investigating Crossmodal interactions between vision and touch relating to spatial attention. We asked how the spatial unity of a multimodal event in the external world might be represented in the brain, where signals from different modalities are initially processed in distinct brain regions. The results highlight several links between visual and tactile spatial representations. First, we found that activity in the anterior part of the intraparietal sulcus was influenced by stimulus position independently of the modality of the stimulation. This is consistent with Crossmodal interactions via sensory convergence from early modality-specific spatial maps to higher-order multimodal regions. Second, we found that stimulation in, or attention to, one modality could affect activity in areas dedicated to a different modality, in a spatially-specific manner. These spatial Crossmodal effects in unimodal regions demonstrate congruous activity in anatomically distant brain areas that represent similar external locations, implicating a distributed network of spatial representations in Crossmodal integration. Finally, the results suggest that the temporo–parietal junction may be involved in aspects of controlling spatial attention, for both vision and touch. A multimodal attentional system may influence activity in distinct brain areas representing common regions of space for different modalities, thus suggesting a link between spatial attention and Crossmodal integration. © 2001 Elsevier Science Ltd. All rights reserved.
-
modulation of human visual cortex by Crossmodal spatial attention
Science, 2000Co-Authors: Emiliano Macaluso, Christopher D. Frith, Jon DriverAbstract:A sudden touch on one hand can improve vision near that hand, revealing Crossmodal links in spatial attention. It is often assumed that such links involve only multimodal neural structures, but unimodal brain areas may also be affected. We tested the effect of simultaneous visuo-tactile stimulation on the activity of the human visual cortex. Tactile stimulation enhanced activity in the visual cortex, but only when it was on the same side as a visual target. Analysis of effective connectivity between brain areas suggests that touch influences unimodal visual cortex via back-projections from multimodal parietal areas. This provides a neural explanation for Crossmodal links in spatial attention.
-
attention and the Crossmodal construction of space
Trends in Cognitive Sciences, 1998Co-Authors: Jon Driver, Charles SpenceAbstract:Traditional studies of spatial attention consider only a single sensory modality at a time (e.g. just vision, or just audition). In daily life, however, our spatial attention often has to be coordinated across several modalities. This is a non-trivial problem, given that each modality initially codes space in entirely different ways. In the last five years, there has been a spate of studies on Crossmodal attention. These have demonstrated numerous Crossmodal links in spatial attention, such that attending to a particular location in one modality tends to produce corresponding shifts of attention in other modalities. The spatial coordinates of these Crossmodal links illustrate that the internal representation of external space depends on extensive Crossmodal integration. Recent neuroscience studies are discussed that suggest possible brain mechanisms for the Crossmodal links in spatial attention.
Andreas K Engel - One of the best experts on this subject based on the ideXlab platform.
-
a matter of attention Crossmodal congruence enhances and impairs performance in a novel trimodal matching paradigm
bioRxiv, 2015Co-Authors: Jonas Misselhorn, Andreas K Engel, Jonathan Daume, Uwe FrieseAbstract:A novel Crossmodal matching paradigm including vision, audition, and somatosensation was developed in order to investigate the interaction between attention and Crossmodal congruence in multisensory integration. To that end, all three modalities were stimulated concurrently while a bimodal focus was defined blockwise. Congruence between stimulus intensity changes in the attended modalities had to be evaluated. We found that Crossmodal congruence improved performance if both, the attended modalities and the task irrelevant distractor were congruent. If the attended modalities were incongruent, the distractor impaired performance due to its congruence relation to one of the attended modalities. Between attentional conditions, magnitudes of Crossmodal enhancement or impairment differed. Largest Crossmodal effects were seen in visual?tactile matching, intermediate effects for audio?visual and smallest effects for audio?tactile matching. We conclude that differences in Crossmodal matching likely reflect characteristics of multisensory neural network architecture. We discuss our results with respect to the timing of perceptual processing and state hypotheses for future physiological studies. Finally, etiological questions are addressed.
-
oscillatory signatures of Crossmodal congruence effects an eeg investigation employing a visuotactile pattern matching paradigm
bioRxiv, 2015Co-Authors: Florian Goschl, Uwe Friese, Jonathan Daume, Peter Konig, Andreas K EngelAbstract:Coherent percepts emerge from the accurate combination of inputs from the different sensory systems. There is ongoing debate about the neurophysiological implementation of Crossmodal interactions in the brain, and it has been proposed that transient synchronization of neurons might be of central importance. Specifically, oscillatory activity in lower frequency ranges (< 30 Hz) has been implicated in mediating long-range communication as typically studied in multisensory research. In the current study, we recorded high-density electroencephalograms (EEG) while human participants were engaged in a visual-tactile pattern matching paradigm. Employing the same physical stimulation, separate tasks of the experiment either required the detection of predefined targets in visual and tactile modalities or the explicit evaluation of Crossmodal stimulus congruence. Analysis of the behavioral data showed benefits for congruent visual-tactile stimulus combinations. Differences in oscillatory dynamics within the two tasks related to Crossmodal congruence involved effects in the theta- (2-7 Hz), alpha- (8-13 Hz) and beta-band (13-25 Hz). Contrasting neuronal activity between the two tasks revealed differences in pre-stimulus alpha- and beta-band power, as well as differences in post-stimulus theta-band activity. Source reconstruction for these effects showed prominent involvement of superior temporal, parietal and prefrontal cortices–regions commonly implicated in multisensory integration. These results add to the increasing evidence that low frequency oscillations are well suited for studying integration in distributed brain networks, as demonstrated for Crossmodal interactions in visual-tactile pattern matching in the current study. Additionally, neuronal activity at theta-, alpha- and beta-frequencies might subserve distinct processes relevant for multisensory integration, such as multisensory gating and Crossmodal perceptual decision making.
-
Crossmodal shaping of pain a multisensory approach to nociception
Trends in Cognitive Sciences, 2014Co-Authors: Daniel Senkowski, Marion Hofle, Andreas K EngelAbstract:Noxious stimuli in our environment are often accompanied by input from other sensory modalities that can affect the processing of these stimuli and the perception of pain. Stimuli from these other modalities may distract us from pain and reduce its perceived strength. Alternatively, they can enhance the saliency of the painful input, leading to an increased pain experience. We discuss factors that influence the Crossmodal shaping of pain and highlight the important role of innocuous stimuli in peripersonal space. We propose that frequency-specific modulations in local oscillatory power and in long-range functional connectivity may serve as neural mechanisms underlying the Crossmodal shaping of pain. Finally, we provide an outlook on future directions and clinical implications of this promising research field.
-
enhanced eeg gamma band activity reflects multisensory semantic matching in visual to auditory object priming
NeuroImage, 2008Co-Authors: Till R Schneider, Stefan Debener, Robert Oostenveld, Andreas K EngelAbstract:Abstract An important step in perceptual processing is the integration of information from different sensory modalities into a coherent percept. It has been suggested that such Crossmodal binding might be achieved by transient synchronization of neurons from different modalities in the gamma-frequency range (> 30 Hz). Here we employed a Crossmodal priming paradigm, modulating the semantic congruency between visual–auditory natural object stimulus pairs, during the recording of the high density electroencephalogram (EEG). Subjects performed a semantic categorization task. Analysis of the behavioral data showed a Crossmodal priming effect (facilitated auditory object recognition) in response to semantically congruent stimuli. Differences in event-related potentials (ERP) were found between 250 and 350 ms, which were localized to left middle temporal gyrus (BA 21) using a distributed linear source model. Early gamma-band activity (40–50 Hz) was increased between 120 ms and 180 ms following auditory stimulus onset for semantically congruent stimulus pairs. Source reconstruction for this gamma-band response revealed a maximal increase in left middle temporal gyrus (BA 21), an area known to be related to the processing of both complex auditory stimuli and multisensory processing. The data support the hypothesis that oscillatory activity in the gamma-band reflects Crossmodal semantic-matching processes in multisensory convergence sites.
-
Crossmodal binding through neural coherence implications for multisensory processing
Trends in Neurosciences, 2008Co-Authors: Daniel Senkowski, Till R Schneider, John J Foxe, Andreas K EngelAbstract:Picture yourself on a crowded sideway with people milling about. The acoustic and visual signals generated by the crowd provide you with complementary information about their locations and motion which needs to be integrated. It is not well understood how such inputs from different sensory channels are combined into unified perceptual states. Coherence of oscillatory neural signals might be an essential mechanism supporting multisensory perception. Evidence is now emerging which indicates that coupled oscillatory activity might serve to link neural signals across uni- and multisensory regions and to express the degree of Crossmodal matching of stimulus-related information. These results argue for a new view on multisensory processing which considers the dynamic interplay of neural populations as a key to Crossmodal integration.
Ophelia Deroy - One of the best experts on this subject based on the ideXlab platform.
-
Crossmodal correspondences four challenges
Multisensory Research, 2016Co-Authors: Ophelia Deroy, Charles SpenceAbstract:The renewed interest that has emerged around the topic of Crossmodal correspondences in recent years has demonstrated that Crossmodal matchings and mappings exist between the majority of sensory dimensions, and across all combinations of sensory modalities. This renewed interest also offers a rapidly-growing list of ways in which correspondences affect--or interact with--metaphorical understanding, feelings of 'knowing', behavioral tasks, learning, mental imagery, and perceptual experiences. Here we highlight why, more generally, Crossmodal correspondences matter to theories of multisensory interactions.
-
hedonic mediation of the Crossmodal correspondence between taste and shape
Food Quality and Preference, 2015Co-Authors: Carlos Velasco, Andy T Woods, Ophelia Deroy, Charles SpenceAbstract:Abstract Crossmodal correspondences between gustatory (taste), olfactory (smell), and flavour stimuli on the one hand and visual attributes on the other have been extensively documented in recent years. For instance, people have been shown to consistently match specific tastes and flavours to particular visual shapes. That said, further research is still needed in order to clarify how and why such correspondences exist. Here, we report a series of four experiments designed to assess what drives people’s matching of visual roundness/angularity to both ‘basic’ taste names and actual tastants. In Experiment 1, Crossmodal correspondences between taste names and abstract shapes were assessed. Next, the results were replicated in a larger online study (Experiment 2). Experiment 3 assessed the role of liking in the association between taste words and morphed shapes along the roundness/angularity dimension. In Experiment 4, basic tastants were mapped to the roundness/angularity dimension, while the mediating role of liking for each taste was assessed. Across the 4 experiments, participants consistently matched sweetness to roundness. What is more, people’s liking for a taste (but not their liking for imagined tastes) appeared to influence their shape matching responses. These results are discussed in terms of Crossmodal correspondences, and a potential role for hedonics is outlined.
-
Crossmodal correspondences between odors and contingent features: odors, musical notes, and geometrical shapes
Psychonomic Bulletin & Review, 2013Co-Authors: Ophelia Deroy, Annesylvie Crisinel, Charles SpenceAbstract:Olfactory experiences represent a domain that is particularly rich in Crossmodal associations. Whereas associations between odors and tastes, or other properties of their typical sources such as color or temperature, can be straightforwardly explained by associative learning, other matchings are much harder to explain in these terms, yet surprisingly are shared across individuals: The majority of people, for instance, associate certain odors and auditory features, such as pitch (Belkin, Martin, Kemp, & Gilbert, Psychological Science 8:340–342, 1997 ; Crisinel & Spence, Chemical Senses 37:151–158, 2012b ) or geometrical shapes (Hanson-Vaux, Crisinel, & Spence, Chemical Senses 38:161–166, 2013 ; Seo, Arshamian, et al., Neuroscience Letters 478:175–178, 2010 ). If certain odors might indeed have been encountered while listening to certain pieces of music or seeing certain geometrical shapes, these encounters are very unlikely to have been statistically more relevant than others; for this reason, associative learning from regular exposure is ruled out, and thus alternative explanations in terms of metaphorical mappings are usually defended. Here we argue that these associations are not primarily conceptual or linguistic, but are grounded in structural perceptual or neurological determinants. These cases of Crossmodal correspondences established between contingent environmental features can be explained as amodal, indirect, and transitive mappings across modalities. Surprising associations between odors and contingent sensory features can be investigated as genuine cases of Crossmodal correspondences, akin to other widespread cases of functional correspondences that hold, for instance, between auditory and visual features, and can help reveal the structural determinants weighing on the acquisition of these Crossmodal associations.
-
Crossmodal mental imagery
2013Co-Authors: Charles Spence, Ophelia DeroyAbstract:While researchers have long pondered over the nature (and even the very existence) of visual mental imagery, it is only in the last few decades or so that serious scientific research has been devoted to the study of this phenomenon in modalities other than vision. That said, the available empirical evidence now supports the view that mental imagery can occur in any sensory modality, though with widely varying degrees of vividness. It is at this point, then, that the question arises as to whether there might also be such a thing as Crossmodal imagery. Crossmodal mental imagery has most commonly been reported under those conditions in which the presentation of a stimulus in one sensory modality results in the formation of a mental image in another modality. In this review, evidence supporting the existence of Crossmodal mental imagery in neurologically normal adults is critically evaluated. Furthermore, similarities and differences with related phenomena such as Crossmodal sensory forms of synaesthesia and Crossmodal perceptual completion are also discussed.
-
how automatic are Crossmodal correspondences
Consciousness and Cognition, 2013Co-Authors: Charles Spence, Ophelia DeroyAbstract:The last couple of years have seen a rapid growth of interest (especially amongst cognitive psychologists, cognitive neuroscientists, and developmental researchers) in the study of Crossmodal correspondences - the tendency for our brains (not to mention the brains of other species) to preferentially associate certain features or dimensions of stimuli across the senses. By now, robust empirical evidence supports the existence of numerous Crossmodal correspondences, affecting people's performance across a wide range of psychological tasks - in everything from the redundant target effect paradigm through to studies of the Implicit Association Test, and from speeded discrimination/classification tasks through to unspeeded spatial localisation and temporal order judgment tasks. However, one question that has yet to receive a satisfactory answer is whether Crossmodal correspondences automatically affect people's performance (in all, or at least in a subset of tasks), as opposed to reflecting more of a strategic, or top-down, phenomenon. Here, we review the latest research on the topic of Crossmodal correspondences to have addressed this issue. We argue that answering the question will require researchers to be more precise in terms of defining what exactly automaticity entails. Furthermore, one's answer to the automaticity question may also hinge on the answer to a second question: Namely, whether Crossmodal correspondences are all 'of a kind', or whether instead there may be several different kinds of Crossmodal mapping (e.g., statistical, structural, and semantic). Different answers to the automaticity question may then be revealed depending on the type of correspondence under consideration. We make a number of suggestions for future research that might help to determine just how automatic Crossmodal correspondences really are.
Alan Kingstone - One of the best experts on this subject based on the ideXlab platform.
-
audiovisual integration during joint action no effects for motion discrimination and temporal order judgment tasks
Frontiers in Psychology, 2020Co-Authors: Basil Wahn, Jill A Dosso, Alan KingstoneAbstract:In daily life, humans constantly process information from multiple sensory modalities (e.g., visual and auditory). Information across sensory modalities may (or may not) be combined to form the perception of a single event via the process of multisensory integration. Recent research has suggested that performing a spatial Crossmodal congruency task jointly with a partner affects multisensory integration. To date, it has not been investigated whether multisensory integration in other Crossmodal tasks is also affected by performing a task jointly. To address this point, we investigated whether joint task performance also affects perceptual judgments in a Crossmodal motion discrimination task and a temporal order judgment task. In both tasks, pairs of participants were presented with auditory and visual stimuli that might or might not be perceived as belonging to a single event. Each participant in a pair was required to respond to stimuli from one sensory modality only (e.g., visual stimuli only). Participants performed both individual and joint conditions. Replicating earlier multisensory integration effects, we found that participants' perceptual judgments were significantly affected by stimuli in the other modality for both tasks. However, we did not find that performing a task jointly modulated these Crossmodal effects. Taking this together with earlier findings, we suggest that joint task performance affects Crossmodal results in a manner dependent on how these effects are quantified (i.e., via responses time or accuracy) and the specific task demands (i.e., whether tasks require processing stimuli in terms of location, motion, or timing).
-
the effect of attention on the illusory capture of motion in bimodal stimuli
Brain Research, 2008Co-Authors: Ipek Oruc, Salvador Sotofaraco, Scott Sinnett, Walter F Bischof, Karman Lock, Alan KingstoneAbstract:A large body of work now exists that demonstrates the interaction between different sensory modalities when they are integrated into a single coherent percept. Yet, it is not yet clear whether attention plays a critical role in such Crossmodal interactions. We investigated the effect of attention on the Crossmodal integration of apparent motion signals using the Crossmodal dynamic capture paradigm. The stimuli were bimodal apparent motion streams consisting of audio-visual, visual-tactile, or audio-tactile signals. The task was to indicate the direction of motion in one of the modalities, called the target modality, that could be congruent or incongruent with the direction of the second motion stream, called the distractor modality. The influence of the distractor modality on participants' response accuracy, called Crossmodal capture, was assessed across three conditions of attentional manipulation. We found that attention does have an effect on how the motion signals are combined across modalities, but only when the susceptibility for capture between the two signals are comparable.
-
the ventriloquist in motion illusory capture of dynamic information across sensory modalities
Cognitive Brain Research, 2002Co-Authors: Salvador Sotofaraco, Charles Spence, Michael S. Gazzaniga, Jessica Lyons, Alan KingstoneAbstract:Integrating dynamic information across the senses is crucial to survival. However, most laboratory studies have only examined sensory integration for static events. Here we demonstrate that strong Crossmodal integration can also occur for an emergent attribute of dynamic arrays, specifically the direction of apparent motion. The results of the present study show that the perceived direction of auditory apparent motion is strongly modulated by apparent motion in vision, and that both spatial and temporal factors play a significant role in this Crossmodal effect. We also demonstrate that a split-brain patient who does not perceive visual apparent motion across the midline is immune to this audiovisual dynamic capture effect, highlighting the importance of motion being experienced in order for this new multisensory illusion to occur.