|
|
||||||||
1 Department of Neurology, Charité Humboldt University of Berlin, 10117 Berlin, Germany; 2 Department of Human Neurobiology, University of Bremen, 28359 Bremen, Germany
Submitted 16 April 2003; accepted in final form 20 November 2003
| ABSTRACT |
|---|
|
|
|---|
| INTRODUCTION |
|---|
|
|
|---|
Kastner et al. (2000
) used attentional control and texture-defined contour stimuli; however, their study did not discriminate between signal modulations at different eccentricities within the relevant visual areas, which is necessary to discriminate contour processing from figure detection. Although those parts of the cortex retinotopically corresponding to the contour should process this contour, any activity located within the central part (i.e., the figure) signals the presence of this figure or object. The work of Lamme and colleagues (Lamme et al. 1995, 1998
; Supér et al. 2001
) clarifies this point. They found contextual responses in primary visual cortex (V1) neurons, that is, an increased neuronal spiking rate related to stimuli containing a closed figure. Not only did the neurons with receptive fields along the contour respond, but also neurons with receptive fields inside the figure did, thus, representing a contextual response. According to these studies, V1 neurons respond to both stimuli within the receptive field and to the context. Furthermore, Supér et al. (2001
) showed that this contextual response disappears if the monkey was not aware of the figure. These findings suggested a clear extension of the receptive fields of V1 neurons beyond their function as simple local filters and led to the recurrent processing hypothesis (Lamme and Roelfsema 2000
; Roelfsema et al. 2002). In short, they speculate that the local receptive field properties determine a fast and early feed-forward sweep of activity, whereas the contextual response extending the receptive field results from a more complex and slower recurrent feedback process.
The aim of the present study was to reexamine the modulation of retinotopic subparts corresponding to the figure, the contour, and the background, while controlling for the particular attentional effort. An event-related design was used and thus, our experimental design resembles those used by Lamme and colleagues. Our subjects performed a demanding foveal letter-discrimination task, similar to that used by Braun (1994
). At the same time, we presented contour stimuli without relevance to the letter task. In fact, subjects remained unaware that contour stimuli had been presented at all. By avoiding recurrent feedback, this design aimed at maximizing its sensitivity to reveal early steps of visual processing.
| METHODS |
|---|
|
|
|---|
SUBJECTS. Four male and two female students (21 to 29 yr, mean = 25 yr, SD = 3.1 yr) from the Humboldt University of Berlin served as subjects in the study, which was conducted in conformity with the Declaration of Helsinki. All subjects had no history of neurological or psychiatric disorders and reported normal visual acuity. Subjects were paid for their participation and signed a consent form.
CONTOUR STIMULI. To measure activity related to contour processing we designed a stimulus [rotator-stimulus (R-Stim)] consisting of 13 x 13 small rotating elements (0.6° diameter each). Each rotator consisted of 3 small dots arranged in a line (Fig. 1A). The 2 outer dots rotated around the central dot, thus creating the percept of a rotating line, without overall changes in luminance or contrast. This stimulus avoids luminance artifacts on a digital screen and is therefore well suited for fMRI experiments using an LCD projector. In half of the trials the 5 x 5 central elements rotated with a phase lag of 180 ms. Because of the phase lag, the inner rotators had a tilt relative to the outer rotators, thus creating the percept of an isoeccentric (3°) square (Fig. 1B). Because all rotators were moving in the same way it was the relative tilt that defined the square's contour, not motion cues. This was confirmed in psychophysical pilot experiments before the fMRI study. We could show that the stimulus provided a clear figureground contrast even in an isoluminant redgreen condition, whereas the contour percept disappeared with increasing speed of the rotators. If the rotators had contained a significant motion-related contour, then the figureground contrast should have been enhanced.
|
The two conditions were presented in a randomized rapid event-related design, consisting of two scanning sessions of 695 volumes each corresponding to 25-min duration. Each stimulus was presented for 800 ms and the interstimulus interval varied from 4 to 14 s (7.9 s average), resulting in 2 x 180 trials.
LETTER-DISCRIMINATION TASK. The subjects' attention was directed centrally by performing a foveal letter-discrimination task (Fig. 1A). Subjects had to decide in a 2 alternative forced-choice (2AFC) paradigm, whether these 5 elements were all identical (i.e., 5 L's or 5 T's), or whether one differed (e.g., 4 T's and 1 L). We chose this task because it has been studied extensively in former studies (Braun et al. 1994, 1998; Li et al. 2002
). Subjects were instructed to perform the letter task as accurately as possible without wasting time. This task prevented subjects from consciously perceiving the square's contour. After the experiment subjects were informed about the presence of a contour in some of the stimuli. Each subject was immediately able to detect the contour, but none had realized that the contour had also been present during the experiments. Before the fMRI sessions, subjects participated in a training session to become accustomed to the letter-discrimination task.
MAPPING STIMULI. Recall that the control condition created a homogeneous array. In the figure condition, however, this array was subdivided in 3 parts: the parafoveal figure, the contour of the square, and the background. To analyze the data of the R-Stim recordings, we accordingly divided each of the early visual areas (V1V4) into three subregions [regions of interest (ROIs)]. The inner figure region is represented by the parafoveal space between 1 and 2.5° eccentricity, the neighboring contour area ranged from 2.5 to 3.5°, and the outer peripheral ROI ranged from 3.5 to 8°. To separate these three eccentricity ranges we designed a customized eccentricity-mapping experiment (Fig. 1, C and D), which provided localizers for the ROIs.
To define the borders separating early visual areas we used a meridian-mapping experiment (DeYoe et al. 1996
). To induce an effective activation in higher visual areas we combined classical checkerboard stimuli and sequences from popular television comic strips (Sereno et al. 2001
). All mapping stimuli contained a central fixation dot and subjects were instructed to maintain fixation.
Equipment and fMRI protocols
The visual stimuli were displayed by ERTS (BeriSoft Cooperation, Frankfurt, Germany) and projected by an NEC LCD projector and a custom-made lens on a small back-projection screen (Daplex, 20 x 15 cm) mounted in front of the head coil. Subjects viewed the screen by way of a mirror at a distance of about 24 cm. MRI data were acquired using a 1.5-T Magnetom Vision (Siemens Medical Systems, Erlangen, Germany) equipped with an EPI booster and a standard head coil. Functional measurements were performed using single-shot EPI sequences (TE = 60 ms; FA 90°). Structural 3-D data sets were acquired in the same session, using a T1-weighted sagittal MP-Rage sequence (TR/TE = 10/4 ms; FA = 12°; TI = 100 ms; voxel size = 1 mm3). High-quality 3-D data sets for each subject were previously recorded using a T1-weighted sagittal FLASH sequence (TR/TE = 38/5 ms; FA = 30°; voxel size = 1 mm3) with 2 acquisitions for excellent graywhite contrast for accurate segmentation and reconstruction of individual surface structures.
Data analysis
fMRI data were analyzed using the BrainVoyager 4.6 software package (BrainInnovation, Maastricht, The Netherlands). Functional data preprocessing contained motion correction, linear trend removal, and slight Gaussian 3D spatial smoothing [3 mm full width at half maximum (FWHM) for meridian mapping or 4 mm for eccentricity mapping and figureground measurements]. The block-design measurements (meridian and eccentricity mapping) were also temporally smoothed (4-s FWHM). The event-related figureground measurements were slice scan time corrected.
We segmented and reconstructed the surface of the white matter and produced flat maps from the high-resolution structural MRI images of each subject. Based on the results of the mapping experiments as described above ROIs were defined. Each of the early visual areas (V1, V2d, V2v, Vp, V3, V4v, V3a) contained 3 eccentricity-based ROIs: parafoveal, contour, and periphery (Fig. 2d). Further ROIs, which were identified in only 4 of the 6 subjects covered area MT+ and area LO. MT+ was localized with a low-contrast motion stimulus similar to the one described by Tootell et al. (1997
). The ROI covering LO (Grill-Spector et al. 1999
) was defined as the region located between the ventral border of MT+ and the foveal representation of V4v and V3. LO was thus defined by the location of the neighboring areas and not by specific functional characteristics. Thus definition of ROIs was not confounded with data from figureground experiments.
|
| RESULTS |
|---|
|
|
|---|
|
|
| DISCUSSION |
|---|
|
|
|---|
Differences from previous studies
A prominent difference between our results and those of comparable fMRI studies (Kastner et al. 2000
; Mendola et al. 1999
; Reppas et al. 1997
; Skiera et al. 2000
) is the pronounced signal modulation in V2, whereas in V1 and V3/Vp modulation could not be detected. Of course, it cannot be concluded that there was a complete absence of contour-related modulations in V1. Nevertheless, we emphasize that the hemodynamic responses in V1 to both conditions of the R-Stim (reflecting the response related to the receptive field properties) were almost identical. We believe the different results in V1 and V2 reflect the fact that the processing of the square's contour modulates V2, but not V1, whereas additional attentional modulation is prevented by the foveal letter-discrimination task.
Response in the figure part
Why was significant signal modulation in the figure part absent in V1 and V2? Such figure response was described by Lamme and colleagues (1995, 1998
), who found modulation of firing rates of V1 neurons whose receptive fields covered exclusively the figure part of a figureground stimulus. A possible explanation for the lack of significant fMRI activity is supplied by the "recurrent processing" hypothesis (Lamme and Roelfsema 2000
; Roelfsema et al. 2002; Supér et al. 2001
). This hypothesis suggests that conscious figure perception is necessary to induce a figure response of this kind. By contrast, our stimulus was designed to avoid conscious figure perception and thus, did not induce a signal modulation within the figure part. In this context one might speculate that the absence of significant V1 modulation in our experiments reflects the fact that subjects were not aware of the presence of the figure (Supér et al. 2001
). In summary V1 should be modulated by contour stimuli either if 1) neurons contribute to the processing of the global contour (bottom up), 2) if attention is attracted (top down), or 3) by conscious perception of the contour (recurrent processing). We hypothesize that those premises were not given in our experimental paradigm, although the last two points are difficult to prove.
Response differences of V1 and V2
Why does V2 but not V1 respond to the contour stimulus? First, the receptive fields of neurons in V2 are significantly larger than those in V1 (Smith et al. 2001
). A local receptive fieldbased receptor must cover at least 2 rotators to detect the contour. Exact receptive field sizes are unknown for humans, but in the macaque the receptive field sizes at an eccentricity of 3° (position of the square's contour) range in V1
0.8° and in V2 from 1.2 to 2.0° (Lee et al. 2001). Thus, the receptive fields of 2° would be able to span two rotators, whereas 0.8° should be too small because two rotators span 1.4°.
Second, Hegdé and Van Essen (2001) found V2 neurons with selectivity to rather complex texture elements like arcs or circles. These neurons seem to prefer complex texture properties, such as those responsible for contour segregation of our stimulus. So far, cells with comparable receptive field properties could not be identified in V1. These cells seem to be well suited to detect the relative tilt of our rotators. Thus the receptive field size alone probably does not explain the absence of significant V1 modulation. In fact, von der Heydt and Peterhans (1989
) compared the response of monkey V1 and V2 neurons to abutted line gratings and other stimuli creating an illusory or anomalous contour percept. They found a significant response to their stimuli in V2, but not in V1, neurons. This finding was recently supported and extended by Ramsden et al. (2001) using optical imaging.
V3 and V3a
The results for areas V3 and V3a appear to be in line with the physiology of these areas in the macaque monkey. Unfortunately, the homology between macaques and humans is problematic especially in V3a (Vanduffel et al. 2001
). It is important to note that, even though our stimulus contains motion, this information did not produce the square's contour. V3 showed a BOLD response for the homogeneous R-Stim but this response was not further enhanced by the square's contour. In contrast, V3a neurons showed clear contour-related modulation. The V3a response is particularly strong and also remarkable because V3a is the only area with significant modulation in the figure part. V3a neurons have relatively large receptive fields and they contain a complete and contiguous representation of the visual field. These properties are good requisites for figure integration, but they do not satisfactorily explain why exclusively V3a contained contextual responses.
The role of V4v
V4v is known to play a central role in attentional processes relevant for some types of visual search. It is supposed to play a central role in performing attentional shifts, for example, during visual conjunction search. The letter-discrimination task was designed by Braun (1994
) to prevent these attentional shifts. Hanazawa and Komatsu (2001
) demonstrated selectivity of V4 neurons in macaques for complex texture properties. Because we controlled attentional modulation, we argue that the V4v modulation expresses contour processing alone.
LO and MT+
Although the response of MT+ remains unaffected by the square's contour, LO shows a clear modulation indicating the processing of the contour. This activation is possibly attributable either to a feed-forward flow of contour information derived from V2 or to a feature-contour system detecting salient regions as postulated by Grossberg et al. (1994). Recent fMRI results (Stanley and Rubin 2003
) propose that LO plays a critical role in a feature-contour system.
In conclusion, contour processing was investigated with a 2nd-order contour stimulus using an event-related fMRI design at a high spatial resolution. Control of attentional modulation during contour perception prevented unspecific BOLD responses. We suggest that the contour stimulus was primarily processed in V2 and then feed-forward propagated to V3a, V4v, and LO. Interestingly, neither V1 nor V2 showed contextual modulation, but V3a did. The combination of eccentricity-matched fMRI responses with an attentional control paradigm leads to activation patterns different from those described in similar studies. We speculate that we were imaging primarily feed-forward processing of contours within one processing stream.
| FOOTNOTES |
|---|
Address for reprint requests and other correspondence: S. A. Brandt, Department of Neurology, Charité, Schumannstr. 20/21, 10117 Berlin, Germany (E-mail: stephan.brandt{at}charite.de).
| REFERENCES |
|---|
|
|
|---|
Braun J and Julesz B. Withdrawing attention at little or no cost: detection and discrimination tasks. Percept Psychophys 60: 123, 1998.[ISI][Medline]
Dale AM and Buckner RL. Selective averaging of rapidly presented individual trials using fMRI. Hum Brain Mapp 5: 329340, 1997.[CrossRef][ISI]
DeYoe EA, Carman GJ, Bandettini P, Glickman S, Wieser J, Cox R, Miller D, and Neitz J. Mapping striate and extrastriate visual areas in human cerebral cortex. Proc Natl Acad Sci USA 93: 23822386, 1996.
Grill-Spector K, Kourtzi Z, and Kanwisher N. The lateral occipital complex and its role in object recognition. Vision Res 41: 14091422, 2001.[CrossRef][ISI][Medline]
Grill-Spector K, Kurshnir T, Edelman S, Avidan G, Itzchak Y, and Malach R. Differential processing of objects under various viewing conditions in the human lateral occipital complex. Neuron 24: 187203, 1999.[CrossRef][ISI][Medline]
Grossberg S. 3-D vision and figure-ground separation by visual cortex. Percept Psychophys 55: 48121, 1994.[ISI][Medline]
Hanazawa A and Komatsu H. Influence of the direction of elemental luminance gradients on the responses of V4 cells to textured surfaces. J Neurosci 21: 44904497, 2001.
Hegde J and Van Essen DC. Selectivity for complex shapes in primate visual area V2. J Neurosci 20: RC61, 2000.
Huk AC, Ress D, and Heeger DJ. Neuronal basis of the motion aftereffect reconsidered. Neuron 32: 161172, 2001.[CrossRef][ISI][Medline]
Kastner S, De Weerd P, and Ungerleider LG. Texture segregation in the human visual cortex: a functional MRI study. J Neurophysiol 83: 24532457, 2000.
Lamme VA. The neurophysiology of figure-ground segregation in primary visual cortex. J Neurosci 15: 16051615, 1995.[Abstract]
Lamme VA and Roelfsema PR. The distinct modes of vision offered by feed-forward and recurrent processing. Trends Neurosci 23: 571579, 2000.[CrossRef][ISI][Medline]
Lamme VA, Zipser K, and Spekreijse H. Figure-ground activity in primary visual cortex is suppressed by anesthesia. Proc Natl Acad Sci USA 95: 32633268, 1998.
Lee TS, Yang CF, Romero RD, and Mumford D. Neural activity in early visual cortex reflects behavioral experience and higher-order perceptual saliency. Nat Neurosci 5: 589597, 2002.[CrossRef][ISI][Medline]
Li FF, Van Rullen R, Koch C, and Perona P. Rapid natural scene categorization in the near absence of attention. Proc Natl Acad Sci USA 99: 95969601, 2002.
Mendola JD, Dale AM, Fischl B, Liu AK, and Tootell RB. The representation of illusory and real contours in human cortical visual areas revealed by functional magnetic resonance imaging. J Neurosci 19: 85608572, 1999.
Reppas JB, Niyogi S, Dale AM, Sereno MI, and Tootell RB. Representation of motion boundaries in retinotopic human visual cortical areas. Nature 388: 175179, 1997.[CrossRef][Medline]
Roelfsema PR, Lamme VA, Spekreijse H, and Bosch H. Figure-ground segregation in a recurrent network architecture. J Cogn Neurosci 14: 525537, 2000.
Sereno MI, Yu HH, and Vogel EK. Mapping retinotopy in higher level extrastriate visual areas in humans. Meeting of the Society for Neuroscience, San Diego, CA, Abstr. 11.7, 2001.
Skiera G, Petersen D, Skalej M, and Fahle M. Correlates of figure-ground segregation in fMRI. Vision Res 40: 20472056, 2000.[CrossRef][ISI][Medline]
Smith AT, Singh KD, Williams AL, and Greenlee MW. Estimating receptive field size from fMRI data in human striate and extrastriate visual cortex. Cereb Cortex 11: 11821190, 2001.
Stanley DA and Rubin N. fMRI activation in response to illusory contours and salient regions in the human lateral occipital complex. Neuron 37: 323331, 2003.[CrossRef][ISI][Medline]
Supér H, Spekreijse H, and Lamme VA. Two distinct modes of sensory processing observed in monkey primary visual cortex (V1). Nat Neurosci 4: 304310, 2001.[CrossRef][ISI][Medline]
Tootell RB, Mendola JD, Hadjikhani NK, Ledden PJ, Liu AK, Reppas JB, Sereno MI, and Dale AM. Functional analysis of V3A and related areas in human visual cortex. J Neurosci 17: 70607078, 1997.
Vanduffel W, Fize D, Mandeville JB, Nelissen K, Van Hecke P, Rosen BR, Tootell RB, and Orban GA. Visual motion processing investigated using contrast agent-enhanced fMRI in awake behaving monkeys. Neuron 32: 565577, 2001.[CrossRef][ISI][Medline]
Von der Heydt R and Peterhans E. Mechanisms of contour perception in monkey visual cortex. I. Lines of pattern discontinuity. J Neurosci 9: 17311748, 1989.[Abstract]
This article has been cited by other articles:
![]() |
J. Haushofer, C. I. Baker, M. S. Livingstone, and N. Kanwisher Privileged Coding of Convex Shapes in Human Object-Selective Cortex J Neurophysiol, August 1, 2008; 100(2): 753 - 762. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. Vinberg and K. Grill-Spector Representation of Shapes, Edges, and Surfaces Across Multiple Cues in the Human Visual Cortex J Neurophysiol, March 1, 2008; 99(3): 1380 - 1393. [Abstract] [Full Text] [PDF] |
||||
![]() |
G. P. Caplovitz and P. U. Tse V3A Processes Contour Curvature as a Trackable Feature for the Perception of Rotational Motion Cereb Cortex, May 1, 2007; 17(5): 1179 - 1189. [Abstract] [Full Text] [PDF] |
||||
![]() |
L. G. Appelbaum, A. R. Wade, V. Y. Vildavski, M. W. Pettet, and A. M. Norcia Cue-invariant networks for figure and background processing in human visual cortex. J. Neurosci., November 8, 2006; 26(45): 11695 - 11708. [Abstract] [Full Text] [PDF] |
||||
![]() |
F. W. Cornelissen, A. R. Wade, T. Vladusich, R. F. Dougherty, and B. A. Wandell No functional magnetic resonance imaging evidence for brightness and color filling-in in early human visual cortex. J. Neurosci., April 5, 2006; 26(14): 3634 - 3641. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
| Visit Other APS Journals Online |