|
|
||||||||
The Journal of Neurophysiology Vol. 86 No. 2 August 2001, pp. 741-759
Copyright ©2001 by the American Physiological Society
Howard Hughes Medical Institute, Department of Physiology, Neuroscience Graduate Program, and W. M. Keck Foundation Center for Integrative Neuroscience, University of California, San Francisco, California 94143
| |
ABSTRACT |
|---|
|
|
|---|
Churchland, Mark M. and Stephen G. Lisberger. Experimental and Computational Analysis of Monkey Smooth Pursuit Eye Movements. J. Neurophysiol. 86: 741-759, 2001. Smooth pursuit eye movements are guided by visual feedback and are surprisingly accurate despite the time delay between visual input and motor output. Previous models have reproduced the accuracy of pursuit either by using elaborate visual signals or by adding sources of motor feedback. Our goal was to constrain what types of signals drive pursuit by obtaining data that would discriminate between these two modeling approaches, represented by the "image motion model" and the "tachometer feedback" model. Our first set of experiments probed the visual properties of pursuit with brief square-pulse and sine-wave perturbations of target velocity. Responses to pulse perturbations increased almost linearly with pulse amplitude, while responses to sine wave perturbations showed strong saturation with increasing stimulus amplitude. The response to sine wave perturbations was strongly dependent on the baseline image velocity at the time of the perturbation. Responses were much smaller if baseline image velocity was naturally large, or was artificially increased by superimposing sine waves on pulse perturbations. The image motion model, but not the tachometer feedback model, could reproduce these features of pursuit. We used a revision of the image motion model that was, like the original, sensitive to both image velocity and image acceleration. Due to a saturating nonlinearity, the sensitivity to image acceleration declined with increasing image velocity. Inclusion of this nonlinearity was motivated by our experimental results, was critical in accounting for the responses to perturbations, and provided an explanation for the unexpected stability of pursuit in the presence of perturbations near the resonant frequency. As an emergent property, the revised image motion model was able to reproduce the frequency and damping of oscillations recorded during artificial feedback delays. Our second set of experiments replicated prior recordings of pursuit responses to multiple-cycle sine wave perturbations, presented over a range of frequencies. The image motion model was able to reproduce the responses to sine wave perturbations across all frequencies, while the tachometer feedback model failed at high frequencies. These failures resulted from the absence of image acceleration signals in the tachometer model. We conclude that visual signals related to image acceleration are important in driving pursuit eye movements and that the nonlinearity of these signals provides stability. Smooth pursuit thus illustrates that a plausible neural strategy for combating natural delays in sensory feedback is to employ information about the derivative of the sensory input.
| |
INTRODUCTION |
|---|
|
|
|---|
Motor systems rely on sensory feedback. A primary function of feedback is to tell the system how its output differs from the intended output, and to guide corrective movements. In such cases, sensory inputs provide the system with negative feedback. Negative feedback systems have the practical advantage that they are resistant to both noise and miscalibration of internal signals. They also have the drawback that they are prone to instabilities if sensory feedback is not immediate. Sensory processing delays of 100 ms or more are common in the nervous system. How do motor systems maintain good performance in the face of such feedback delays if they rely heavily on a negative feedback architecture?
Smooth pursuit eye movements provide an ideal model system in which to
approach this problem. Pursuit has an explicit negative feedback
architecture because the source of its sensory inputs, the retina, is
attached to the motor effector, the eyeball. As illustrated in Fig.
1, the primary input to the pursuit
system is retinal image motion, defined as target motion with respect to the potentially moving eye (
)
(Rashbass 1961
). The pursuit system is designed to
minimize image motion by matching eye velocity to target velocity. The
image velocity input to pursuit thus provides both a feed-forward
signal that drives changes in eye velocity, and a feedback signal
regarding the adequacy of those changes. Feedback regarding the effect
of motor commands is delayed due the 60- to 130-ms latency between
visual input and motor response. Pursuit performance is generally much
better than would be expected given this feedback delay. For example, Fig. 2 shows typical pursuit responses to
a step-ramp of target position (Rashbass 1961
), which
delivers a step of target velocity. After a delay of approximately 100 ms, eye velocity increases rapidly, overshoots target velocity little
or not at all, and then either oscillates near target velocity with a
period of about 200 ms (Fig. 2B), or tracks target velocity
almost perfectly (Fig. 2C).
|
|
Models of the pursuit system have been used extensively to form and test hypotheses about how neural systems achieve the performance measured in human and monkey subjects. The simplest pursuit model uses only a single visual input, an image velocity signal, and instantiates the "visual system" box in Fig. 1 as a simple gain. Eye acceleration would then be proportional to image velocity with a delay of 60-130 ms. In the absence of delay, such a "velocity-servo" model performs well, as eye acceleration is always in the direction that reduces image motion. However, in the presence of delay, the velocity servo model performs poorly and fails to account for a number of the features exhibited by pursuit. Figure 2, B and C, shows typical examples of eye velocity during pursuit, while the performance of the velocity-servo model is illustrated in Fig. 2D. The model exhibits much more overshoot than is seen in the data and oscillates with much too low of a frequency.
These failings of the simple velocity-servo model are eliminated, in
different ways, by three classes of pursuit model that have been
published previously, each of which is able to account for pursuit
responses to step changes in target velocity like those shown in Fig.
2, B and C. However, the three models use different control strategies and make fundamentally different predictions about the organization of the neural circuits that mediate
pursuit. Two of these, the "target velocity" model of Robinson
(Dicke and Thier 1999
; Huebner et al.
1990
, 1992
; Pola and Wyatt 2001
;
Robinson et al. 1986
) and the "tachometer feedback" model of Ringach (1995)
, assume that pursuit eye
movements are guided by motor feedback signals, and that the visual
pathways driving pursuit are sensitive only to image velocity. The
third, the "image motion" model of Krauzlis and Lisberger
(1989
, 1994b
) assumes that pursuit is driven not
only by image velocity, but also by image acceleration.
Goldreich et al. (1992)
have shown that the target
velocity model cannot account for the changes in spontaneous
oscillation frequency produced by altering the visual feedback delay.
We therefore focus on experiments and simulations designed to
discriminate between the tachometer feedback and image motion models,
and to determine whether the accuracy of pursuit is due to motor
feedback or to elaborated visual inputs. Our experiments provide new
data that could be reproduced only by a modified version of the image motion model. We conclude that the remarkable accuracy of pursuit in
human and nonhuman primates is due to visual inputs related to image
velocity and image acceleration. We further conclude that the
unexpected stability of pursuit, remarked on under a variety of
circumstances (Goldreich et al. 1992
; Ringach
1995
; Robinson 1965
), results from a
nonlinearity implied by our data.
| |
METHODS |
|---|
|
|
|---|
Experiments on monkeys
The majority of pursuit data shown was collected specifically
for this paper. The exception is the data from monkey Jo in Fig. 11, which is reprinted from Fig. 3 of Goldreich et al.
(1992)
and shows responses under conditions of artificially
increased feedback delays. These data were included because
Ringach (1995)
has argued that the image motion model
cannot account for them.
Data were obtained from three rhesus monkeys using methods that had
been approved in advance by the Committee on Animal Research at UCSF.
Using sterile procedure under isoflurane anesthesia, monkeys were
implanted with a platform that allowed head restraint and a scleral
search coil for monitoring eye movements (Judge et al.
1980
). They were given postoperative analgesic doses of Buprenorphine (0.01 mg/kg) every 12 h for 2-3 days.
Monkeys were trained to track visual targets for a juice reward. During
the experiment, monkeys sat in a primate chair with their head
restraint device fixed to the ceiling of the chair. Targets were
projected onto the back of a tangent screen that was 114 cm in front of the monkey. A red fixation spot was provided by direct projection of
the image from a red light-emitting diode (LED) onto the center of the
screen. A 0.5° white moveable tracking target was created by
reflecting the beam from an optical bench off a pair of orthogonal mirror galvanometers. The fixation and tracking targets had luminances of 0.2 and 3.5 cd/m2, respectively. The room was
otherwise dark.
Stimuli were presented in individual trials. Daily experiments lasted about 2 h, during which we collected eye movement responses for 1,600 to 3,000 trials. Trials began with the appearance of the red fixation spot, which the monkey was required to fixate. After a variable delay of 700-1,100 ms, the fixation spot was extinguished, and the white tracking target appeared 1.5-2.5° to the left or right and began to move immediately. The exact eccentricity was set to reduce the occurrence of saccades and varied depending on the monkey. The target always moved toward and then well past the extinguished fixation point. The target moved for a variable period of at least 1,600 ms. Each monkey was required to track the target with an accuracy of 3° until it was extinguished, at which time he received a reward. Usually, the target moved at a constant velocity of 15°/s. In some trials, perturbations were imposed on the constant target velocity. Perturbations were either sinusoidal variations of target velocity, brief pulses of target velocity, or combinations of pulses and sine waves. The position excursion of the perturbations ranged from 0.06 to 1.2° and was therefore small enough so that their presence did not affect the monkey's ability to keep eye position within the window required for reward. Different trial types were presented in random order, weighted so that perturbations were present in only 25% of the trials.
Eye and target position and eye velocity were sampled at 1 kHz on each
channel. The eye velocity voltage was obtained by using an analog
circuit that differentiated signals at frequencies up to 25 Hz and
attenuated signals at higher frequencies (
20 dB per decade). The
target position voltages were obtained as feedback from sensors on the
mirror galvanometers. Actual target velocity lagged commanded target
velocity by 2 ms or 7.2° at 10 Hz. Analog differentiation of eye
position voltages to create the eye velocity signal introduced phase
lag that was negligible at low frequencies but corresponded to up to 7 ms of time delay in the frequency range of 8-11 Hz. These lags were
corrected in the data analysis.
Saccades were identified by eye, and the resulting deflections of eye
velocity were replaced with straight-line segments. For our purposes,
the practice of linear interpolation is practically and theoretically
preferable to other alternatives, such as treating the excised saccades
as missing data (see Churchland and Lisberger 2000
), although under our stimulus conditions the two
methods produce very similar results. For the majority of our data,
saccades were both small and rare, occurring about once per second,
although there was day-to-day and monkey-to-monkey variability in the
number of saccades. Trials were rejected in the rare (1-5% depending on the experiment) instances when saccades were numerous, indicating that smooth tracking was poor. For experiments in which we examined the
response to 100-ms-long perturbations of target velocity, trials were
rejected from the analysis if a saccade obscured the response or
occurred during the target perturbation. Additionally, after
discovering the effect of baseline image velocity on the response to
perturbations, for some analyses (Figs. 4 and 5) we rejected trials in
which eye velocity was not close to target velocity when the
perturbation was imposed. For some experiments, the requirement both
that eye velocity be near target velocity at the time of the
perturbation, and that no saccade interrupt the target perturbation or
obscure the response, caused as many as 40% of trials to be excluded
from analysis. Although we considered it important to exclude these
trials on principle, their inclusion had only the minor (and expected)
effect of making the average responses slightly smaller.
For each trial type, we aligned individual trials on the onset of
target motion and computed the average eye velocity evoked by the
target. We isolated the pursuit response to perturbations of target
velocity (Fig. 3C) by
computing the millisecond-by-millisecond difference between the average
response to target steps that included (Fig. 3A) or did not
include (Fig. 3B) a perturbation. We presented perturbations
on top of ongoing target motion because the pursuit system responds
well to high-frequency perturbations only after it has already been
engaged by some other target motion (Goldreich et al.
1992
; Schwartz and Lisberger 1994
).
|
For sinusoidal perturbations, we used the Fourier transform to compute the gain and phase shift of both monkey and model responses. The gain was estimated as the amplitude of the relevant frequency component of the eye velocity response, divided by the amplitude of the target velocity perturbation. The phase shift was estimated as the difference between the phase of the response and that of the target. For perturbations that delivered pulses of image velocity, response amplitude was calculated as the difference between the maximum and minimum eye velocities over a period that began 40 ms before the response and ended at the time of the peak of the response. To remove the small contributions of noise, we subtracted the same measure for trials in which perturbations were not presented. The impact of this correction was minor (<10%).
Computer simulations
Models were simulated on a DEC Alpha workstation using our revision of the ASP software originally written by L. M. Optican and H. P. Goldstein. To allow for greater flexibility in the cost function used during optimizations, some optimizations were run using compiled Matlab functions with gradient descent provided by the "constr" function. Simplified versions of both models, employing an intuitive graphical interface, can be explored with common web browsers at http://keck.ucsf.edu/~sgl/top_pursuitmodel.htm.
Models were built by interconnecting time delays, nonlinearities, and
low-pass filters. Optimized parameters were the time delays, the
coefficients describing each of the nonlinearities, and the time
constants of the low-pass filters, which converted step inputs into
exponentially relaxing outputs with a single time constant.
Optimization was typically initiated by manually adjusting the model
parameters until the responses were reasonably close to those of the
monkey. For example, for the fits shown in Figs. 12 and 13, the
parameters of both models were initially set so that each provided
reasonable approximations to the 15°/s step responses and produced
responses to sinusoidal perturbations that were in the right amplitude
range. Optimization employed a gradient descent algorithm
("stepit," Chandler 1965
). To speed the optimization
process, limits were initially set on the range of most parameters. If
a good fit was not achieved within this range, the limits were relaxed
or eliminated. When a good fit was achieved, the optimization algorithm
typically took little time in finding it. In cases where a good fit was
not achieved, we repeatedly restarted the optimization algorithm using
different initial parameters. Different initial parameters were
obtained by 1) "jiggling" the parameter values slightly
from their value at the error minimum, 2) setting the
parameters to new random values, and 3) setting the
parameters by hand to attempt to improve the fit. The cost function was
usually simply the sum of the millisecond by millisecond squared
difference between the model and the data. For the simulations in Fig.
10, we included in the cost function the error between measured aspects
of the pursuit and model responses (e.g., the response amplitude). When
some aspects of the data were fit better than others, we increased the
cost function for those traces that were not fit well (multiplying
their error by a constant), and continued optimization. This was useful
in fitting the model simultaneously to large magnitude responses (e.g.,
the response to a 15°/s step) and small magnitude responses (e.g., the response to a 10-Hz target). Thus in instances where fits were
consistently poor we think it unlikely that we missed the global error
minimum. Our confidence in this assertion is increased by the nature of
the failures observed in instances of poor fits, which are readily
explained by reference to the architecture of the models. Pursuit
initiation from fixation is typically 10-20 ms slower than the true
pursuit latency. Models were allowed to compensate by having the
optimization algorithm add an additional delay at initiation.
| |
RESULTS |
|---|
|
|
|---|
Open-loop responses to brief perturbations of target velocity
We begin by presenting the results of experiments designed to test the feed-forward properties of pursuit. We recorded responses to 100-ms-long perturbations consisting of pulses (Fig. 4A) or sine wave modulations (Fig. 4B) of target velocity. Responses were recorded to various amplitudes of each perturbation type. Figure 4, A and B, shows averages of eye velocity. The pursuit response to a 12°/s velocity pulse was more than twice as large as the response to a 4°/s pulse, although not quite three times as large. In contrast, the response was nearly the same for a 12°/s sinusoidal perturbation as for a 4°/s perturbation. Note that, for graphical visibility, the eye velocity responses in Fig. 4, A and B, are plotted at twice the vertical scale as the target velocity traces.
|
The differing nonlinearity of the responses to pulse and sinusoidal
perturbations is summarized for monkey Na in Fig.
4C, which plots response amplitude as a function of stimulus
amplitude. The response to velocity pulse perturbations (
) saturates
moderately with stimulus amplitude over the range of 1-12°/s. The
response to a 12°/s pulse is 60% as large as expected given a linear
extrapolation from the response to a 2°/s pulse. The dashed line
shows that a logarithmic fit captures well the small to moderate
response saturation. The responses to sinusoidal perturbations
saturated much more severely (
and
). The saturation was similar
whether we measured the response to the first cycle of a perturbation that was five cycles long (
) or the average response to all five cycles (
). The response to the first cycle of a 12°/s amplitude sine wave is only 33% as large as expected given a linear
extrapolation from the response to a 2°/s sine wave. The response to
all five cycles is 38% as large as expected given a linear
extrapolation. These data were well fit by a logarithmic relationship
(solid and finely dashed lines). Note that the responses to sinusoidal perturbations are smaller than the responses to pulses and have been
plotted on a different amplitude scale. Amplitudes for the two kinds of
perturbations have been scaled so that they appear at a similar
position on the y-axes for low stimulus amplitudes, to
emphasize the difference in the degree of saturation.
Figure 4D shows the same general results from experiments on monkey Mo. Responses to sine waves showed more saturation (only 38% of the linear expectation) than did responses to pulses (59% of the linear expectation). For this experiment, sine wave perturbations were only one cycle long. Monkey Mo was used for this experiment only; all subsequent experiments use monkeys Na and Ka. The parameters of the logarithmic fits are given in the figure legend and, as expected, show a greater saturation for the fits to sine wave perturbation responses than for the fits to pulse perturbation responses. Linear regressions to the responses to sine waves showed y-intercepts significantly greater than zero (Mo, P < 0.05; Na, P < 0.05 for response to 1st cycle, P < 0.005 for response to all cycles), indicating that the response saturated. To determine whether the degree of saturation was significantly greater for sine waves than for pulses, we divided the response to the latter by the response to the former. This ratio was significantly larger for larger amplitude stimuli (Mo, P < 0.05; Na, P < 0.05 for response to 1st cycle, P < 0.005 for response to all cycles). While one expects the biphasic sinusoidal perturbations to evoke lower amplitude responses overall, relative to the pulse perturbations, some nonlinearity must be proposed to explain why they also evoke more response saturation.
Interaction of sinusoidal and pulse perturbations of target velocity
Our interpretation of the data in Fig. 4 is that the responses to
high-frequency sine wave perturbations are driven largely by a
fast-saturating sensitivity to image acceleration. While other
interpretations are possible, this interpretation guided the design of
the following experiment, which seeks to analyze the nature of the
proposed saturation further. We asked how the response to a sine wave
perturbation depended on the baseline image velocity at the time of the
perturbation. Our purpose was to determine whether the response to
image acceleration saturates with increasing image acceleration, or
with increasing image velocity. In other words, is the saturation best
approximated as S(d
/dt) or as
d[S(
)]/dt, where
is image velocity and
S is a saturating function? If the first possibility holds,
then baseline image velocity should have no effect on the response to
sinusoidal perturbations. If the second holds, then the response
amplitude should decrease with increasing baseline image velocity.
Figure 5 illustrates that the response to
sinusoidal perturbations depended strongly on the size of a concurrent
pulse. Responses were evoked by perturbations that consisted of a
single cycle of a 10-Hz sine wave superimposed on different amplitude
100-ms velocity pulses, all presented during maintained pursuit of
target motion at 15°/s (methods shown in Fig. 3D). To
isolate the response to the sine wave and exclude the response to the
pulse itself, we computed the difference between the response to the
sine wave with pulse (stimulus shown in Fig. 3D, 3rd
trace) and the response to the pulse alone (Fig. 3D, 2nd
trace). The resulting difference traces in Fig. 5A show
that the sinusoidal perturbation of target velocity caused very little
modulation of eye velocity when the pulse of image velocity was either
4°/s in the direction of ramp target motion (trace labeled "4
deg/s") or 6°/s in the direction opposite target motion (trace
labeled "
6 deg/s"). The amplitude of the response grew as the
pulse size was reduced and was largest when the pulse was 2°/s in the
direction opposite target motion (trace labeled "
2 deg/s").
Average eye velocity at the time of the perturbation was 13.8°/s,
which is 1.2°/s smaller than the original 15°/s target velocity.
Thus the image velocity offset caused by the pulse was smallest during
the
2°/s pulse, when the response to the sine wave was largest.
|
Figure 5, B and D, summarizes, for monkeys
Na and Ka, the finding that the response amplitude
depended strongly on the mean image velocity during the perturbation.
Response amplitude is shown normalized by its maximum value. The
amplitude was largest when the mean image velocity was near zero, and
declined sharply with increasing image velocity in either the same or
opposite direction from target motion. This decrease was significant
for both monkeys (linear regression, P < 0.001 for
both). These results support the hypothesis that high-frequency sine
wave perturbations are driven in part by a sensitivity to image
acceleration, and that this sensitivity saturates with increasing image
velocity. That is, the saturation is best expressed as
d[S(
)]/dt. However, the results of Fig. 5, B
and D, could also have been obtained if sine wave
perturbations are driven purely by a strongly saturating sensitivity to
image velocity. To test this possibility, we assessed the linearity of
the pursuit response to pulses of target velocity presented alone.
Control trials presenting pure pulses were interleaved with
experimental trials.
The responses to pulse perturbations are summarized in Fig. 5, C and E. As in Fig. 4, the response to pulses alone saturated only moderately with increasing stimulus amplitude. For monkey Na (C), the response to an 8°/s pulse was 76% of the linear expectation given the response to a 2°/s pulse. This mild saturation is unlikely to account for the results of B, where sine wave response amplitudes fell to less than one-half when image velocity was between 4 and 8°/s. Monkey Ka (E) showed an asymmetry: considerable response saturation was observed only when the pulse increased target velocity (right-hand side for the open squares plotting rightward pursuit, left-hand side for the filled circles plotting leftward pursuit). The response to an 8°/s decrease in target velocity was 88% of the linear expectation, while the response to an 8°/s increase was only 58% of the linear expectation. This asymmetric response saturation is almost certainly due to eye velocity saturation and cannot account for the responses of monkey Ka in D, where response amplitude decreased similarly regardless of whether the pulse increased or decreased eye velocity.
Given that the response to sinusoidal motion is reduced by the addition of image velocity, one would expect that the natural fluctuations in image velocity during pursuit maintenance might have a similar influence. Perturbations presented when eye velocity is near the baseline target velocity would evoke larger responses than perturbations presented when eye velocity is farther from the baseline target velocity. To test this hypothesis, we pooled data from a number of experiments using 10-Hz perturbations (those shown in Figs. 4, 5, and 8, along with others not shown in this paper). For each experiment, we calculated the average absolute image velocity, across all trials, during the time the perturbation was presented. Within each experiment, we then divided individual trial responses into two bins: one in which baseline image velocity at the time of the perturbation was higher than average, and one in which baseline image velocity was lower than average. The trials in each bin were then averaged, and the response to the perturbation was calculated as described above. It was necessary to bin and average because responses were obscured by noise in the majority of individual trials, and were clear only in the averages. For monkey Na, image velocity averaged 2.4°/s for the first bin and 0.9°/s for the second (averages over 16 experiments). The response to a 10-Hz sinusoidal perturbation was on average 34% smaller in the first bin (2-tailed t-test, P < 0.0002). For monkey Ka, image velocity averaged 1.7°/s for the first bin and 0.7°/s for the second (averages over 11 experiments). The response was on average 16% smaller in the first bin (P < 0.05). Thus even the small naturally occurring departures from zero image velocity that occur during pursuit maintenance can reduce the pursuit response to sinusoidal perturbations. For comparison, consider only those responses in Fig. 5, B and D, where image velocity during the pulse was <2°/s (mean = 1.1°/s) or >4°/s (mean = 6.4°/s). Across both directions and monkeys, the response in the latter condition was 59% smaller (standard error = 6%).
Closed loop responses to steps and sinusoidal perturbations of target velocity
To provide a data set for testing the models under closed-loop conditions, we conducted modified versions of experiments already in the literature. We recorded the responses of monkeys Na and Ka to 15°/s steps of target velocity, and to multi-cycle sine wave perturbations over a range of frequencies from 1 to 10 Hz. Sine wave perturbations were imposed during maintained pursuit of 15°/s steps. Perturbations were presented in the minority (25%) of trials; target velocity was usually a pure 15°/s step.
Figure 6 shows 12 responses of
monkey Na to a 15°/s step of target velocity. For this
monkey, spontaneous oscillations at approximately 5 Hz were a typical,
if not universal (see examples 11 and 12) feature
of maintained pursuit. However, comparison along the vertical dashed
line reveals that the phase of these oscillations was not consistent
between trials. As a result, the average eye velocity response, when
aligned on the onset of target motion, showed no spontaneous
oscillations (e.g., Fig. 3B). For comparison of different
models, we did not wish to use average responses that were
unrepresentative of the majority of individual responses. We wished
particularly to preserve the spontaneous oscillations present in
individual trials, since fitting the oscillation period has been an
important challenge for models of pursuit (Goldreich et al.
1992
; Ringach 1995
; Robinson et al.
1986
).
|
Our solution to this problem, shown in Fig.
7, was to make two averages: one with
individual trials aligned on the initiation of pursuit, and a second
average aligned on the first trough of the spontaneous oscillations.
Most records exhibited at least one full oscillation cycle, making this
strategy feasible. For the few trials that did not show any clear
oscillations, we made an estimate based on the end of the initial eye
acceleration and the typical period of the oscillations. After
obtaining the two averages, we spliced them at the point were their
accelerations and velocities were both equal, just before the end of
the initial eye acceleration. The resulting "spliced average" (Fig.
7) was representative of both the initial eye acceleration and the
typical amplitude and period of the spontaneous oscillations, and was used as the goal for the models' responses. The spliced average is
related to the method used by Robinson et al.
(1986)
to solve the same problem. For these experiments, we had
many more repetitions of the responses to steps of target velocity than
we needed. Therefore we averaged only a randomly selected subset of
25-35 repetitions.
|
Figure 8A shows the spliced
averages of eye velocity (
) for monkey Na to rightward and
leftward 15°/s steps of target velocity (- - - - -). We estimated
the feedback delay of this monkey's pursuit system to be about 80 ms,
based on the latency to respond to perturbations of target velocity
imposed during maintained tracking. The spontaneous oscillations were
lightly damped and persisted for several cycles with a period of 207 ms, a little over twice the feedback delay. In contrast to monkey
Na, monkey Ka exhibited spontaneous oscillations in only a small
subset of his responses (individual responses not shown). Thus aligning his responses on the onset of target motion produced average responses that resembled individual responses. However, we found that by averaging his responses time locked to the peak of the usual small overshoot of target velocity, we better preserved this aspect of
individual responses. Responses of monkey Ka are shown
alongside those of the models in Fig. 13A. On rare occasions
when spontaneous oscillations were present in the individual responses
of monkey Ka, their period was around 150 ms, just over
twice the estimated feedback delay of 65-70 ms.
|
Figure 8B shows the responses of monkey Na to
sinusoidal perturbations over a range of frequencies, collected during
the same experiment as the step response in A, and isolated
as described in METHODS. As expected, eye velocity (
)
always lagged target velocity (- - - - -), even for 500-ms period
perturbations (2 Hz). As the period of the sinusoidal perturbations
decreased, the phase lag increased until it exceeded 360° for
perturbations with a period of 100 ms. In agreement with previous data
(Goldreich et al. 1992
), the gain of the response was
close to one for 500-ms period perturbations (2 Hz), and declined to
somewhat less than 0.5 for 100-ms period perturbations (10 Hz). One
feature of these responses is particularly notable, even though it can
be predicted from the unexpected stability of pursuit in the face of
artificially increased feedback gains (Robinson 1965
).
Given the lightly damped spontaneous oscillations in response to steps
of target velocity, linear systems analysis predicts that the system
should resonate strongly when stimulated at the oscillation frequency.
The amplitude of the eye velocity response should increase with each
cycle of the perturbation, and the final gain should be quite high.
This did not occur. In Fig. 8B, the gain of the response to
a perturbation of period 190 ms is less than one and is smaller than
that to a perturbation of period 350 ms. However, the absence of the
resonance predicted by linear control models is perhaps not surprising, as we observed above that the pursuit response to sinusoidal target motion is far from linear. In particular, fluctuations of eye velocity
about target velocity (as in Fig. 6) increase baseline image velocity
and are thus expected, given the data in Fig. 5, to reduce the response
to sinusoidal perturbations.
The responses of monkey Ka to sinusoidal perturbations of target velocity were similar to those of monkey Na and are shown later (Fig. 13C). Again, there was no pronounced increase in the response gain when the perturbation frequency was near that of the (rarely observed) spontaneous oscillations.
Architecture of the models
Both the image motion model (Goldreich et al. 1992
;
Krauzlis and Lisberger 1989
, 1994b
) and
the tachometer feedback model (Ringach 1995
) attempt to
explain why pursuit eye velocity follows trajectories like those in
Fig. 2, B and C, rather than that of a simple
velocity servo as in Fig. 2D. For the image motion model, the use of image acceleration (and deceleration) information limits the
overshoot of target velocity and produces the correct oscillation frequency of approximately twice the visual feedback delay.
Intuitively, performance of the simple velocity-servo model is poor
because what is needed to ensure perfect performance is current image velocity, 

t).
The image motion class of models essentially makes the first-order
estimate: 

t) + gÏ(t
t). For the estimate to be optimal, g should
be approximately
t. If the image acceleration signal is
too weak, large overshoots will result. If it is too strong,
spontaneous oscillations are produced with a period of twice the visual
delay. These spontaneous oscillations represent repeated
over-corrections. The period is twice the delay because one delay
interval expires between maximum image acceleration (maximum eye
deceleration), and the maximum of the subsequent overcorrecting
response: maximum eye acceleration. The response delay thus accounts
for one-half cycle, from maximum eye deceleration to maximum eye
acceleration. These explanations are complicated somewhat by the
addition of filters and of nonlinear gain elements, but remain a
fruitful way of understanding the behavior of the image motion model. A
formal explanation of these effects can be found in the Appendix of
Goldreich et al. (1992)
.
Figure 9A shows a block
diagram of a revised image motion model. Target velocity (
) and
eye velocity (
) are compared by the model at a summing junction
that represents the retina, yielding image velocity (
). The eye velocity command is then passed through a low-pass
filter (labeled "plant") to yield actual eye velocity (
).
The relatively simple dynamics of the plant are based on the widely
accepted idea that neural circuits not included in our model compensate
for the physical dynamics of the eye (Skavenski and Robinson
1973
).
|
The top visual pathway in Fig. 9A takes image velocity as its input, delays it, processes it with a nonlinear gain element, and subjects it to low-pass filtering with a single time constant. The middle pathway has the same three elements (with different parameters), plus a switch that is on only for 30 ms following the onset of target motion, to produce a "Motion onset transient." This pathway was included to account for certain nonlinearities present during the initiation of pursuit, but is silent during maintained pursuit, and is thus of minor relevance to the majority of our analysis. The bottom pathway receives an image velocity input that is first delayed and passed through a saturating nonlinearity. The derivative is then taken, and the resulting image acceleration signal then passes through a second nonlinear gain element and filter. An additional low-pass filter is associated with the differentiation.
The model in Fig. 9A has three departures from the image
motion model of Krauzlis and Lisberger (1994b)
. First,
it adds a nonlinearity to the acceleration pathway, situated before the derivative of image velocity is taken. This nonlinearity was crucial in
fitting much of the data presented in this paper and was motivated by
the data in Figs. 4 and 5. When set to saturate, the nonlinearity reduces the sensitivity to image acceleration when image velocity is
high; an acceleration from 0 to 5°/s produces a larger output than
does the same magnitude acceleration from 30 to 35°/s. Second, each
of the parallel pathways now has an independent time delay. These
delays were allowed to vary slightly from one another (see Table A1) to
achieve the best fit to the data. Third, the current model does not use
temporal filters with inherent resonance. Given that relatively little
is known about the filtering properties of the pursuit system, we made
the simplest possible assumption and used low-pass filters described by
a single exponential time constant.
We converted the image motion model into an equivalent tachometer
feedback model by replacing the image velocity input to the
acceleration pathway with a negative eye velocity input. The tachometer
feedback model, shown in Fig. 9B, shares the first two
pathways with the image motion model. However, the bottommost pathway
embodies a sensitivity to eye acceleration, rather than a sensitivity
to image acceleration. This version of the tachometer model uses
potentially nonlinear gain elements and is capable of showing all the
features of the original linear tachometer model and more. The
inclusion of the motion onset pathway does confer a limited type of
image acceleration sensitivity (at the onset of target motion) to the
tachometer feedback model. However, we felt this pathway should be
included given the ample evidence for a motion onset transient that
drives eye acceleration at the initiation of pursuit (Krauzlis
and Lisberger 1994a
; Lisberger and Westbrook
1985
). To further facilitate comparison of the two models, we
designed the differentiator in the acceleration pathway of the image
motion model to ignore the brief pulse of image acceleration present
when the target first began to move. Any response to motion onset could
still be modeled by the motion onset pathway.
The two models are functionally nearly identical for target motion at a constant velocity. Eye deceleration is identical to image acceleration when target acceleration is zero, and the eye acceleration pathway of the tachometer feedback model thus has a similar effect on model performance as does the image acceleration pathway of the image motion model. The only differences arise due to the potentially nonlinear gain that precedes differentiation within the acceleration pathway. The nonlinearity acts on image velocity for the image motion model, and on eye velocity for the tachometer feedback model, and image velocity is typically not equal to eye velocity. In general, optimized versions of the tachometer feedback model tended to use a nearly linear transfer function in this position, while the image motion model used a saturating nonlinearity. Still, the performance of the two models was nearly identical for steps of target velocity. The two models produced dramatically different responses 1) when the target accelerated continuously and 2) when visual feedback was artificially delayed. The latter condition creates different predictions for the two models because it delays both types of feedback (image velocity and image acceleration) for the image motion model, but only the image velocity feedback for the tachometer feedback model.
We have diagrammed the architecture of the models to highlight their close formal relationship. In doing so, we have lumped into the total delay of each pathway a motor delay that in Ringach's original formulation affected the final common pathway. This formulation of the delays is formally identical to the original. As described, the models employed many free parameters, eight describing the delay and filtering properties of pursuit, with multiple additional parameters describing the four nonlinearities. The number of free parameters may seem excessive, and indeed it was designed to be. We wished to ensure that any failings of the models were due to limitations imposed by their architecture, and not to a lack of free parameters.
Simulation of open-loop responses
The simulations shown in Fig.
10A verify our earlier
conclusion that a saturating response to image acceleration is
sufficient to account for the discrepancy in response saturation
between pulses and sine waves. There is excellent quantitative
agreement between the output from the image motion model (Fig.
10A,
, - - - - -, and - - -) and the responses of
monkey Na to pulse and sine wave perturbations of target
velocity (symbols, replotted from Fig. 4). For both the model and the
monkey, the response to pulses of target velocity (
,
) showed less
saturation than did responses either to the first cycle of a 10-Hz sine
wave (- - - - -,
) or to all five cycles (- - -,
). The
model and the monkey both showed slightly smaller response amplitudes
when measured over five cycles instead of one. Model responses were
obtained using target velocity inputs equal to the sine wave or pulse
perturbation of interest. Response gains were then calculated just as
they had been for the monkey. To fit these data, the image motion model relied on the combination of a nearly linear response to image velocity, and a response to image acceleration that saturated with
increasing image velocity. The parameters used to achieve these fits
are reported in Fig. A1 and Table A1.
|
The tachometer feedback model was less successful in reproducing the
responses to pulse and sine wave perturbations of target velocity. When
the parameters were set so that the responses to pulses were fit well
(Fig. 10B,
), the gain of the response to sine waves was
too low for all but the highest stimulus amplitudes (bottom 2 dashed
lines). This was especially true when all five cycles of the response
were considered (bottom dashed line). In addition, the response of the
model did not saturate quickly enough with increasing sine wave
perturbation amplitude. Scaling the responses of the model so that the
pulse and sine wave response gains overlap for low amplitude stimuli
(top dashed line) reveals that the response to sine waves saturated to
the same degree as the response to pulses. It was possible to configure
the tachometer feedback model to produce responses to sinusoidal
perturbations with the appropriate gain and saturation. However, the
model's responses to velocity steps were then too large and exhibited far too much saturation (simulation data not shown). As discussed later, these shortcomings are due not to the use of motor feedback, but
to the tachometer model's lack of sensitivity to image acceleration.
We also fit both models to the responses of monkey Na to
sine waves imposed on velocity pulses, and to his responses to the pulses alone, originally shown in Fig. 5. As in Fig. 10, A
and B, both models were able to reproduce accurately the
responses to different amplitude pulses (simulation data not shown, but fits were as good as in Fig. 10, A and B).
However, only the image motion model was also able to reproduce the
responses to sine waves presented on top of pulses. Figure
10C shows, for the two models (curves) and for the monkey
(symbols), the response gain for sine waves as a function of the mean
image velocity created by a concurrent pulse. The responses of the
models were isolated using the same method employed for the behavioral
data: the response to the pulse alone was subtracted from the response
to the pulse/sine wave combination. The image motion model (
)
captures the steep decline in response gain with increasing image
velocity (
). The behavior of the image motion model is due to the
initial nonlinearity in the image acceleration pathway (bottom pathway
of Fig. 9A). When baseline image velocity is zero, the input
to the pathway engages the steep part of the nonlinearity, and the
signal to be differentiated has a relatively high gain. When baseline
image velocity is either above or below zero, the input to this pathway engages the shallower part of the nonlinearity, and the signal to be
differentiated has a relatively low gain. In effect, the gain of the
image acceleration pathway varies as a function of baseline image velocity.
The tachometer feedback model (- - - - -) showed only a modest decline in response gain with increasing baseline image velocity. The decline was due to the saturation of the response to image velocity. The tachometer model was able to produce a steeper decline, but only if its responses to pulses saturated much more than did the monkeys' (simulation data not shown). Because the data are expressed in normalized form, Fig. 10C obscures an additional failure of the tachometer feedback model; when image velocity was zero, the responses of the tachometer feedback model to sinusoidal perturbations of target velocity were only 50% as large as those of the monkey. The data from monkeys Mo and Ka were sufficiently similar to those of monkey Na that we did not repeat the simulations using their data as a goal.
Simulation of closed-loop responses under conditions of delayed visual feedback
We next ask whether the nonlinear visual properties of our
elaborated image motion model are sufficient to explain pursuit under
closed-loop conditions, or if sources of motor feedback must also be
assumed. Ringach has argued that the image motion model is unable to
account for some aspects of pursuit under conditions of delayed visual
feedback, and indeed this is true for a linear model. We now compare
the behavior of the nonlinear versions of both models with
the pursuit behavior that led Ringach to reject the linear
image motion model. The solid lines in Fig.
11 reproduce data from Goldreich
et al. (1992)
and show responses of a monkey to a 15°/s step
of target velocity, with artificially imposed feedback delays indicated
by the numbers to the left of each trace. As reported in detail before,
and as expected from an image motion model, the period of the
spontaneous oscillations increased with feedback delay. The increase is
not linear, however. At short artificial delays the oscillation period
is approximately twice the total feedback delay, while at long
artificial delays the period is closer to four times the total feedback
delay. There is also an increase in the damping of the oscillations at
intermediate delays. These more subtle aspects of the data could not be
reproduced by a linear image motion model (Ringach
1995
), although it has previously been shown that a nonlinear
image motion model can produce a nonlinear increase in oscillation
period with increasing feedback delay (Krauzlis and Lisberger
1994b
).
|
The dashed traces in Fig. 11 show that the nonlinear versions of both
models provide good fits to the data of Goldreich et al.
(1992)
. Both models show realistic effects of increases in feedback delay with respect to the oscillation period and the damping.
Thus the primary criticism leveled by Ringach (1995)
against the linear image motion model is obviated by the nonlinear version of the model. The nonlinear image motion model succeeds where
the linear version failed primarily because of the addition of image
velocity saturation prior to the extraction of image acceleration (1st
nonlinearity in bottom pathway, Fig. 9A). The image
acceleration pathway dominates the model's dynamics when the visual
delay is short and the oscillations (and resulting image velocities)
are small. Dominance of the image acceleration pathway produces an
oscillation period roughly twice the feedback delay, as discussed
above. When the visual delay is long and the oscillations (and
resulting image velocities) become large, saturation weakens the image
acceleration pathway, and the image velocity pathway dominates the
dynamics, creating an oscillation period of roughly four times the
feedback delay. Between these extremes is a period where the two
pathways are more balanced, and damping is increased. The parameters
that produced these fits are shown in Table A1, and the nonlinearities
appear in Fig. A1.
The principle frequency of the spontaneous oscillations exhibited by
the tachometer feedback model increases appropriately with increasing
feedback delay, as described by Ringach (1995)
. However,
for moderate to long delays, higher frequency oscillations produced by
the eye acceleration feedback pathway, whose delay is unaltered, are
superimposed on the lower frequency oscillations produced by the image
velocity pathway. The model oscillates at two distinct frequencies. In
contrast, the average responses of the monkey did not show two
frequencies of oscillation. Although it is possible that high-frequency
oscillations were present in individual trials and were lost due to
averaging, this seems unlikely because for this monkey similar
high-frequency oscillations were visible in the average responses when
the visual feedback was not delayed. Unfortunately, the raw data from
Goldreich et al. (1992)
are no longer available to
investigate directly the presence or absence of simultaneous
oscillations at both high and low frequencies. For the responses of the
image motion model, there are also some small departures from
smoothness that appear as if they might represent a small higher
frequency component. In fact, these result from a small discontinuity
at zero in the derivative of the first nonlinearity in the image
acceleration pathway (curve labeled "Image velocity #2" in the
2nd row of Fig. A1). These small bumps would have been
eliminated if we had parameterized the curve to allow asymmetry without
a discontinuity in the first derivative.
Simulation of closed-loop responses to steps and sinusoidal modulations of target velocity
The image motion model was able to replicate the very different responses of monkeys Na and Ka to 15°/s steps of target velocity (Figs. 12A and 13A). Different parameters were used in fitting the responses of the two monkeys (see Table A1 and Fig. A1), a necessity given their very different profiles of pursuit. The tachometer feedback model was equally successful in fitting the responses to steps of target velocity (Figs. 12B and 13B). These results were expected: the two models are formally very similar under these conditions, and both had previously been shown to successfully emulate pursuit of target velocity steps.
|
|
We next ask how well the models reproduce the responses to sinusoidal perturbations. For each monkey, responses to sine wave perturbations were collected during the same experimental session as the responses to steps. We simulated responses by simply providing the target velocity perturbations themselves as the input to the models. This method ignores the fact that, for actual pursuit image, velocity was rarely zero at the time the perturbations were imposed, due to imperfections in pursuit maintenance and the presence of spontaneous oscillations. The method essentially assumes that pursuit maintenance was perfect at the time of the perturbation. This choice of method avoided the myriad complications of attempting to incorporate noise sources into the models, but it posed a different problem. For a linear model, the average perturbation response would not depend on the presence of random-phase fluctuations in baseline image velocity. The versions of the two models we employ are not linear, but considering the small (1-2°/s) size of fluctuations in baseline image velocity during pursuit, the departures from linearity are expected to be of little consequence, with one key exception. For the image motion model, even small fluctuations in baseline image velocity will reduce the effective gain of the image acceleration pathway. One would therefore predict that the image motion model, configured to reproduce the response to steps of target velocity, would successfully reproduce the responses to sinusoidal perturbations if and only if the gain of the image acceleration pathway is reduced. This is precisely what we found.
The responses of the image motion model to sinusoidal perturbations are shown in Figs. 12C and 13C. The simulated responses successfully capture both the amplitude and the phase of the monkeys' responses. To achieve these fits, the gain of the image acceleration pathway was reduced, respectively, by 34 and 38%, relative to the gain that reproduced the step responses shown in Figs. 12A and 13A. Fluctuations in baseline image velocity are expected to have little or no effect on the duration of the visual delay, or on the effective gain of the image velocity pathway (which is nearly linear in the relevant range). All other parameters were therefore restricted to be the same when simulating responses to target velocity steps and perturbations. The reductions in gain were achieved by simply reducing the output of the image acceleration pathway by the indicated percentage. This is equivalent to linearly scaling the second nonlinear gain function of that pathway (see Fig. A1).
The reduction in the gain of the image acceleration pathway (34 and
38% for monkeys Na and Ka) was chosen to produce
optimal fits. An independent estimate can be made of the decrease in
responsiveness expected given the fluctuations of image velocity. For
the data in Figs. 12 and 13, we measured image velocity during the time
the sine wave perturbations were presented, but for individual trials without perturbations (i.e., pure 15°/s steps of target
velocity). Image velocity during this interval fluctuated about target
velocity as in Fig. 6, and its absolute value averaged 1.4°/s for
monkey Na and 1.0°/s for monkey Ka. For
monkey Na, we reported above that increases in baseline
image velocity of 1.22°/s,
1.16°/s (both artificially produced),
and 1.5°/s (naturally occurring) reduced the response to sine waves
by 34, 33, and 34%, respectively. These values are very similar to the
value of 34% used by the model to fit the data of monkey
Na. For monkey Ka, increases in image velocity of
1.0°/s,
1.0°/s (artificially produced), and 1.0°/s (naturally
occurring) reduced the response by 15, 7, and 16%. These values are
smaller than that used by the model (38%). In summary, although the
decreases in responsiveness expected given the data are similar to the
decreases in responsiveness necessary to allow the image motion model
to achieve good fits, the two values do not agree exactly in both monkeys.
The responses of the tachometer feedback model were, like those of the image motion model, computed without regard to the fluctuations of image velocity during pursuit maintenance. The input to the model was simply the target velocity of the perturbation, as if maintenance were perfect. Unlike the image motion model, the presence of small fluctuations in image velocity do little to alter the behavior of the tachometer feedback model. Still, if we did not alter any parameters from the values that produced good fits to the responses to 15°/s steps, then the tachometer feedback model showed excessive resonance in its response to perturbations (these simulations are not those seen in Figs. 12D and 13D). We therefore allowed the optimization algorithm to use a lower gain for the eye acceleration pathway whe