Академический Документы
Профессиональный Документы
Культура Документы
Recovery of a conditioned response (CR) after its extinction is both familiar and mysterious. Dating back to
Pavlov (1927), CRs have been readily recovered in three
different ways. First, there is spontaneous recovery, in
which an extinguished CR can reappear when the conditioned stimulus (CS) is presented after a period of rest
(Pavlov, 1927, p. 58). Second, there is rapid reacquisition.
Even when spontaneous recovery has been eradicated by
repeated extinction sessions, the CR can be reacquired
rapidly if pairings of the CS with the unconditioned stimulus (US) are resumed (Pavlov, 1927, p. 60). Third, there is
external disinhibition, in which an extinguished CR reappears when the CS is presented in compound with a
novel CS (Pavlov, 1927, pp. 6264). Effects like external
disinhibition have also been seen in (1) renewal, which occurs when the extinguished CS is presented in a changed
context, and (2) reinstatement, which occurs when the extinguished CS is presented following US-alone presentations (Bouton & Nelson, 1998).
Recently, studies by Kehoe and his associates using
the rabbit nictitating membrane (NM) preparation have
demonstrated a new technique for recovering the CR to
an extinguished CS, which has been denoted concurrent
recovery. In this procedure, a stimulus from one modality
(CSA, e.g., tone) is first paired with the US and is then
extinguished. After all responding to CSA has been eliminated, a new stimulus from a different modality (CSB,
343
344
345
Stage 2
Stage 3
Test Stimuli
T1
T1/T2
T1/T2
L
L
L
T1/T2
T1/T2
T1/T2
T1/T2
T1/T2
L
L
T1/T2
T1/T2
CSA
CSA
CSB
CSB
CSA
CSA
346
Results
Unless otherwise noted, planned contrasts were used to
analyze the data, and the rejection level was set according
to a Type I error rate of .05 (Harris, 1994; OBrien & Kaiser, 1985). Because Experiment 1 focused on recovery of
responding in Stage 3, rigorous criteria were applied to
ensure that each subject had shown both sufficient acquisition by the end of Stage 1 (50% CRs) and complete
extinction of responding by the end of Stage 2 (10%
CRs). One animal in Group Single failed to meet the criteria for extinction; it persisted in responding at levels of
more than 75% CRs throughout all 6 days of extinction.
Accordingly, its data were excluded from the analysis and
presentation of the data. In addition, 1 animal in Group
Discrim and 1 animal in Group Single developed an eye
infection in Stage 3, and NM responding could not be re-
Figure 1. Percentage of CRs in the three successive stages of Experiment 1. Each row of panels
shows the results of a different group. In Stage 1 (left panels), Group Single received continuous
reinforcement of a single tone (T1), Group Discrim received differential conditioning of two tones
(T1, T2), and Group Pseudo received partial reinforcement of two tones (T1, T2). In Stage 2
(middle panels), Group Single received nonreinforced presentations of the previously reinforced
tone (T1), Group Discrim received nonreinforced presentations of the previously reinforced tone
(T1) as well as of the previously nonreinforced tone (T2), and Group Pseudo received nonreinforced presentations of the two partially reinforced tones (T1, T2). In Stage 3 (right panels), all
three groups received reinforced presentations of a light CS ().
347
348
Results
Stage 1: Acquisition. The left-hand panels of Figure 3
show the acquisition of discriminative responding for both
groups plotted across the 5 days of Stage 1. There is a separate panel for each group. Each day is divided into three
blocks of 10 T1 trials and three blocks of 10 T2 trials.
Inspection of Figure 3 reveals that both groups acquired
discriminative responding to the two tones [F(1,14)
95.72, p .05]. Any apparent differences between the
349
Figure 3. Percentage of CRs in the three successive stages of Experiment 2. Each row of panels shows the results of
a different group. In Stage 1 (left panels), both groups received differential conditioning of two tones (T1, T2). In
Stage 2 (middle panels), Group DE received nonreinforced presentations of the two tones (T1, T2), and Group DR
received reversal training of the original two-tone discrimination (T1, T2). In Stage 3 (right panels), both groups
received reinforced presentations of a light CS ().
350
351
Results
In Experiment 3A, 1 animal in Group CMD1 failed to
show extinction in Stage 2. It persisted in responding at
levels of more than 50% CRs throughout all 7 days of
extinction, and, hence, its data were removed from the
analyses. In Group SST1, 2 animals were removed as a
result of injury on the preparation day. In Experiment 3B,
1 animal in Group CMD2 and 1 animal in Group SST2
failed to meet the criterion for acquisition; neither animal
showed more than 25% CRs on any trial block on the 6
days of Stage 1. Thus, the sample size of Group SST1 in
Experiment 3A was 6, and all other groups had sample
sizes of 7. Figure 5 depicts CR performance during the
three stages of Experiments 3A and 3B using the final
sample sizes.
352
Figure 5. Percentage of CRs across the three successive stages of Experiments 3A and 3B.
In Stage 1 (panels A, D), the SST groups received reinforced presentations of a single stimulus
(CSA, open squares), and the CMD groups received differential conditioning (CSA, solid
squares; CSB, solid triangles). In Stage 2 (panels B, E), all groups received nonreinforced
presentations of the previously reinforced stimulus (CSA). In Stage 3 (panels C, F), the SST
groups received reinforced presentations of a novel stimulus (CSB), and the CMD groups
received reinforced presentations of the nonreinforced stimulus from Stage 1 (CSB).
353
354
355
356
ened. As these interior connections were strengthened, test trials with the original CS (T1) would be able to elicit some CRs
because the exterior connections could weakly activate the
hidden units and capitalize on the strengthened interior connections (XR, YR, ZR).
The same layered structure can also explain the considerable savings that are seen after extinction of the CR
in the rabbit NM preparation, in particular, rapid reacquisition of the CR to the extinguished CS and the rapid
acquisition of CRs to a new CS from a different modality
(Kehoe et al., 1984; Macrae & Kehoe, 1999; Weidemann
& Kehoe, 2003). At the beginning of extinction with an
established CS, both the exterior and interior connections
would start to diminish. As the exterior connections, however, become too weak to activate the hidden unit, the interior connections would be protected from further extinction, because they would not be receiving input from the
hidden unit or from the absent US. Provided that the rate
of decline in the interior connections is about the same or
less than that of the exterior connections, a considerable
portion of the interior connections strength would be preserved. Thus, this strength would be available when any
exterior connections were strengthened during any subsequent reinforced training with any CS (Kehoe, 1988;
Weidemann & Kehoe, 2004).
As can now be seen, a layered network model can explain both the learning-dependent generalization seen in
acquisition (Schreurs & Kehoe, 1987) and the savings seen
after extinction with only simple parametric assumptions,
specifically, that the learning rates for all the connections
are equal. Surprisingly, the learning-dependent generalization seen after extinction in the form of concurrent recovery seems to require a more complex set of parametric
assumptions. The problem that concurrent recovery poses
for the proposed layered network arises from the strong
assumption that the sensory encodings for stimuli from
different modalities are entirely isolated from each other,
namely, the light (L) versus the tone stimuli (T1, T2). That
is, there is no inbuilt possibility of generalization between
them as there is between stimuli from the same modality
(T1, T2). Previously, this assumption has been required by
repeated failures to detect any unlearned generalization
between the visual and auditory CSs in the rabbit NM
preparation (Kehoe, 1992; Kehoe & Holt, 1984; Macrae
& Kehoe, 1999; Schreurs & Kehoe, 1987; Weidemann &
Kehoe, 2004). By the same token, the exterior connections for the light versus tone stimuli are specific to those
stimuli. Thus, in Stage 3 of the present experiments, there
is no way that the acquisition of the LX, LY, and LZ
connections can influence the ability of test presentations
of T1 or T2 to activate the X, Y, or Z units.
Simulations were first conducted with all the learning
rates set to the same value. Across a wide range of values, it proved impossible for the model to produce any
evidence of substantial concurrent recovery, even though
it could reproduce rapid reacquisition after extinction,
learning-dependent cross-modal generalization in acquisition, and facilitation of cross-modal acquisition after
357
358
359
360
Figure A1. Simulations for all connections and outputs for initial single-stimulus training (T1), extinction (T1), and final training with a novel stimulus (Light).
strength faster than either the T1Y or T1Z connections. The T2X, T2Y, and T2Z connections also gained
some weak excitatory strength as a result of the overlap in stimulus encoding fields of the two-tone stimuli. As
a result of the X unit receiving a stronger input than either the Y or Z units, the interior XR connection reached
a higher terminal strength than either the YR or ZR connections.
Subsequent extinction training with the tone stimulus (T1), shown in the center column of panels, resulted
in a decrease in the value of all the connections. However, the T1X connection, with its relatively high learning
rate, decreased rapidly. Consequently, the XR connection was protected from further decreases. Conversely,
the T1Y and T1Z connections changed more slowly and retained much of their strength, thus exposing the
YR and ZR connections to the continued effects of extinction. Thus, the YR and ZR connections decreased
toward zero. The parallel, but weaker exterior connections involving T2 showed a similar pattern of changes.
Most importantly, by the end of extinction, only the T1Y, T1Z, and XR connections retained considerable
strength, whereas all other connections had been substantially reduced.
As seen in simulations using the predecessor for this network (Kehoe, 1988), the final cross-modal training
with the light (L; right column of panels) reproduced the facilitated acquisition of responding to the orthogonal CS. Specifically, a comparison of acquisition during L training to initial acquisition during T1 training reveals that simulated responding to the L input reached 100% CRs in the fourth block of trials, whereas
responding during T1 training did not reach 100% CRs until the fifth block of trials. Thus, final cross-modal
acquisition required only 80% as many trials as initial acquisition. Simulation of a naive rest control (not shown)
confirmed that acquisition during L training would have only reached 100% CRs by the fifth block in the
absence of any prior training with T1.
In addition to reproducing facilitated acquisition, the simulations of L training yielded concurrent recovery
of extinguished responding to T1 and generalized responding to T2. All these effects arose from the ability of the
exterior connections to capitalize on interior connections. During the L training, the LZ connection increased
the most rapidly, but the LX and LY connections also gained strength. As all these connections strengthened,
Figure A2. Simulations for all connections and outputs for initial discrimination training (T1, T2),
extinction (T1, T2), and final training with a novel stimulus (Light).
361
362
Figure A3. Simulations for all connections and outputs for initial discrimination training (T1, T2),
discrimination reversal (T1, T2), and final training with a novel stimulus (Light).
(Manuscript submitted October 31, 2003;
revision accepted for publication September 30, 2004.)