Acoustic cues to visual detection: A classification image study

Year: 2011

Authors: Pascucci D., Megna N., Panichi M., Baldassi S.

Autors Affiliation: Univ Florence, Dept Psychol, Florence, Italy; Univ Trent, Ctr Mind Brain Sci, Dept Cognit Sci & Educ, Trento, Italy; INO CNR, Florence, Italy; CNR, Inst Neurosci, I-56100 Pisa, Italy.

Abstract: A non-informative sound is known to improve contrast detection thresholds for a synchronous visual target (M. Lippert, N. K. Logothetis, & C. Kayser, 2007). We investigated the spatio-temporal characteristics of the mechanisms underlying this crossmodal effect by using a classification image paradigm specifically suited to investigate perceptual templates across both space and time (P. Neri & D. J. Heeger, 2002). A bright bar was embedded in 2D (space-time) dynamic noise and observers were asked to detect its presence in both unimodal (only visual) and bimodal (audio-visual) conditions. Classification image analysis was performed and the 1st and 2nd order kernels were derived. Our results show that the cross-modal facilitation of detection consists in a reduction of activity of the early mechanisms elicited by the onset of the stimulation and not directly involved in the identification of the target. In fact, the sound sharpens the 2nd order kernels (involved in target detection) by suppressing the activation preceding the target, whereas it does not influence the 1st order kernels. These data suggest that the sound affects some non-linear process involved with the detection of a visual stimulus by, decreasing the activity of contrast energy filters temporally uncorrelated with the target, hence reducing temporal uncertainty.

Journal/Review: JOURNAL OF VISION

Volume: 11 (6)      Pages from: 7-1  to: 7-11

More Information: This research was supported by the ERC grant STANIB.
KeyWords: classification images; cross-modal perception; visual detection; reverse correlation; multisensory; contrast threshold
DOI: 10.1167/11.6.7

ImpactFactor: 3.376
Citations: 8
data from “WEB OF SCIENCE” (of Thomson Reuters) are update at: 2024-11-10
References taken from IsiWeb of Knowledge: (subscribers only)

Connecting to view paper tab on IsiWeb: Click here
Connecting to view citations from IsiWeb: Click here