Editing Multisensory integration
Appearance
Latest revision | Your text | ||
Line 10: | Line 10: | ||
===Binding problem=== |
===Binding problem=== |
||
{{main|Binding problem}} |
{{main|Binding problem}} |
||
The relationship between the binding problem and multisensory perception can be thought of as a question – the binding problem |
The relationship between the binding problem and multisensory perception can be thought of as a question – the binding problem, and potential solution – multisensory perception. The binding problem stemmed from unanswered questions about how mammals (particularly higher primates) generate a unified, coherent perception of their surroundings from the cacophony of [[Electromagnetic radiation|electromagnetic waves]], chemical interactions, and pressure fluctuations that forms the physical basis of the world around us. It was investigated initially in the [[visual system|visual domain]] (colour, motion, depth, and form), then in the auditory domain, and recently in the multisensory areas. It can be said therefore, that the binding problem is central to multisensory [[perception]].<ref name="Zmigrod 2010">{{Cite journal | last1 = Zmigrod | first1 = S. | last2 = Hommel | first2 = B. | title = Temporal dynamics of unimodal and multimodal feature binding. | journal = Atten Percept Psychophys | volume = 72 | issue = 1 | pages = 142–52 |date=Jan 2010 | doi = 10.3758/APP.72.1.142 | pmid = 20045885 | s2cid = 7055915 |url = http://www.bernhard-hommel.eu/The%20temporal%20dynamics.pdf | doi-access = free }}</ref> |
||
However, considerations of how unified conscious representations are formed are not the full focus of multisensory Integration research. It is obviously important for the senses to interact in order to maximize how efficiently people interact with the environment. For perceptual experience and behavior to benefit from the simultaneous stimulation of multiple sensory modalities, integration of the information from these modalities is necessary. Some of the mechanisms mediating this phenomenon and its subsequent effects on cognitive and behavioural processes will be examined hereafter. Perception is often defined as one's conscious experience, and thereby combines inputs from all relevant senses and prior knowledge. Perception is also defined and studied in terms of feature extraction, which is several hundred milliseconds away from conscious experience. Notwithstanding the existence of [[Gestalt psychology]] schools that advocate a holistic approach to the operation of the brain,<ref name="Wagemans 2012a">{{Cite journal | last1 = Wagemans | first1 = J. | last2 = Elder | first2 = JH. | last3 = Kubovy | first3 = M. | last4 = Palmer | first4 = SE. | last5 = Peterson | first5 = MA. | last6 = Singh | first6 = M. | last7 = von der Heydt | first7 = R. | title = A century of Gestalt psychology in visual perception: I. Perceptual grouping and figure-ground organization. | journal = Psychol Bull | volume = 138 | issue = 6 | pages = 1172–217 |date=Nov 2012 | doi = 10.1037/a0029333 | pmid = 22845751 | pmc=3482144| citeseerx = 10.1.1.452.8394 }}</ref><ref name="Wagemans 2012b">{{Cite journal | last1 = Wagemans | first1 = J. | last2 = Feldman | first2 = J. | last3 = Gepshtein | first3 = S. | last4 = Kimchi | first4 = R. | last5 = Pomerantz | first5 = JR. | last6 = van der Helm | first6 = PA. | last7 = van Leeuwen | first7 = C. | title = A century of Gestalt psychology in visual perception: II. Conceptual and theoretical foundations. | journal = Psychol Bull | volume = 138 | issue = 6 | pages = 1218–52 |date=Nov 2012 | doi = 10.1037/a0029334 | pmid = 22845750 | pmc=3728284}}</ref> the physiological processes underlying the formation of percepts and conscious experience have been vastly understudied. Nevertheless, burgeoning neuroscience research continues to enrich our understanding of the many details of the brain, including neural structures implicated in multisensory integration such as the [[superior colliculus|superior colliculus (SC)]]<ref name="Stein 2011">{{Cite book | last1 = Stein | first1 = BE. | last2 = Rowland | first2 = BA. | title = Enhancing Performance for Action and Perception - Multisensory Integration, Neuroplasticity and Neuroprosthetics, Part I | chapter = Organization and plasticity in multisensory integration | journal = Prog Brain Res | volume = 191 | pages = 145–63 | year = 2011 | doi = 10.1016/B978-0-444-53752-2.00007-2 | pmid = 21741550 | pmc = 3245961 | series = Progress in Brain Research | isbn = 9780444537522 }}</ref> and various cortical structures such as the [[superior temporal gyrus|superior temporal gyrus (GT)]] and visual and auditory association areas. Although the structure and function of the SC are well known, the cortex and the relationship between its constituent parts are presently the subject of much investigation. Concurrently, the recent impetus on integration has enabled investigation into perceptual phenomena such as the [[ventriloquism]] effect,<ref name="Recanzone 2009">{{Cite journal | last1 = Recanzone | first1 = GH. | title = Interactions of auditory and visual stimuli in space and time. | journal = Hear Res | volume = 258 | issue = 1–2 | pages = 89–99 |date=Dec 2009 | doi = 10.1016/j.heares.2009.04.009 | pmid = 19393306 | pmc = 2787663}}</ref> rapid localization of stimuli and the [[McGurk effect]];<ref name="Smith 2013">{{Cite journal| last1=Smith| first1=E.| last2=Duede| first2=S.| last3=Hanrahan| first3=S.| last4=Davis| first4=T.| last5=House| first5=P.| last6=Greger| first6=B.| title= Seeing is believing: neural representations of visual stimuli in human auditory cortex correlate with illusory auditory perceptions.| journal=PLOS ONE| volume=8| issue=9 | pages=e73148| year=2013 | doi=10.1371/journal.pone.0073148 | pmid=24023823 | pmc=3762867| bibcode=2013PLoSO...873148S| doi-access=free}}</ref> culminating in a more thorough understanding of the human brain and its functions. |
However, considerations of how unified conscious representations are formed are not the full focus of multisensory Integration research. It is obviously important for the senses to interact in order to maximize how efficiently people interact with the environment. For perceptual experience and behavior to benefit from the simultaneous stimulation of multiple sensory modalities, integration of the information from these modalities is necessary. Some of the mechanisms mediating this phenomenon and its subsequent effects on cognitive and behavioural processes will be examined hereafter. Perception is often defined as one's conscious experience, and thereby combines inputs from all relevant senses and prior knowledge. Perception is also defined and studied in terms of feature extraction, which is several hundred milliseconds away from conscious experience. Notwithstanding the existence of [[Gestalt psychology]] schools that advocate a holistic approach to the operation of the brain,<ref name="Wagemans 2012a">{{Cite journal | last1 = Wagemans | first1 = J. | last2 = Elder | first2 = JH. | last3 = Kubovy | first3 = M. | last4 = Palmer | first4 = SE. | last5 = Peterson | first5 = MA. | last6 = Singh | first6 = M. | last7 = von der Heydt | first7 = R. | title = A century of Gestalt psychology in visual perception: I. Perceptual grouping and figure-ground organization. | journal = Psychol Bull | volume = 138 | issue = 6 | pages = 1172–217 |date=Nov 2012 | doi = 10.1037/a0029333 | pmid = 22845751 | pmc=3482144| citeseerx = 10.1.1.452.8394 }}</ref><ref name="Wagemans 2012b">{{Cite journal | last1 = Wagemans | first1 = J. | last2 = Feldman | first2 = J. | last3 = Gepshtein | first3 = S. | last4 = Kimchi | first4 = R. | last5 = Pomerantz | first5 = JR. | last6 = van der Helm | first6 = PA. | last7 = van Leeuwen | first7 = C. | title = A century of Gestalt psychology in visual perception: II. Conceptual and theoretical foundations. | journal = Psychol Bull | volume = 138 | issue = 6 | pages = 1218–52 |date=Nov 2012 | doi = 10.1037/a0029334 | pmid = 22845750 | pmc=3728284}}</ref> the physiological processes underlying the formation of percepts and conscious experience have been vastly understudied. Nevertheless, burgeoning neuroscience research continues to enrich our understanding of the many details of the brain, including neural structures implicated in multisensory integration such as the [[superior colliculus|superior colliculus (SC)]]<ref name="Stein 2011">{{Cite book | last1 = Stein | first1 = BE. | last2 = Rowland | first2 = BA. | title = Enhancing Performance for Action and Perception - Multisensory Integration, Neuroplasticity and Neuroprosthetics, Part I | chapter = Organization and plasticity in multisensory integration | journal = Prog Brain Res | volume = 191 | pages = 145–63 | year = 2011 | doi = 10.1016/B978-0-444-53752-2.00007-2 | pmid = 21741550 | pmc = 3245961 | series = Progress in Brain Research | isbn = 9780444537522 }}</ref> and various cortical structures such as the [[superior temporal gyrus|superior temporal gyrus (GT)]] and visual and auditory association areas. Although the structure and function of the SC are well known, the cortex and the relationship between its constituent parts are presently the subject of much investigation. Concurrently, the recent impetus on integration has enabled investigation into perceptual phenomena such as the [[ventriloquism]] effect,<ref name="Recanzone 2009">{{Cite journal | last1 = Recanzone | first1 = GH. | title = Interactions of auditory and visual stimuli in space and time. | journal = Hear Res | volume = 258 | issue = 1–2 | pages = 89–99 |date=Dec 2009 | doi = 10.1016/j.heares.2009.04.009 | pmid = 19393306 | pmc = 2787663}}</ref> rapid localization of stimuli and the [[McGurk effect]];<ref name="Smith 2013">{{Cite journal| last1=Smith| first1=E.| last2=Duede| first2=S.| last3=Hanrahan| first3=S.| last4=Davis| first4=T.| last5=House| first5=P.| last6=Greger| first6=B.| title= Seeing is believing: neural representations of visual stimuli in human auditory cortex correlate with illusory auditory perceptions.| journal=PLOS ONE| volume=8| issue=9 | pages=e73148| year=2013 | doi=10.1371/journal.pone.0073148 | pmid=24023823 | pmc=3762867| bibcode=2013PLoSO...873148S| doi-access=free}}</ref> culminating in a more thorough understanding of the human brain and its functions. |