Skip to main content

Main menu

  • Home
  • Articles
    • Current
    • Special Feature Articles - Most Recent
    • Special Features
    • Colloquia
    • Collected Articles
    • PNAS Classics
    • List of Issues
  • Front Matter
    • Front Matter Portal
    • Journal Club
  • News
    • For the Press
    • This Week In PNAS
    • PNAS in the News
  • Podcasts
  • Authors
    • Information for Authors
    • Editorial and Journal Policies
    • Submission Procedures
    • Fees and Licenses
  • Submit
  • Submit
  • About
    • Editorial Board
    • PNAS Staff
    • FAQ
    • Accessibility Statement
    • Rights and Permissions
    • Site Map
  • Contact
  • Journal Club
  • Subscribe
    • Subscription Rates
    • Subscriptions FAQ
    • Open Access
    • Recommend PNAS to Your Librarian

User menu

  • Log in
  • My Cart

Search

  • Advanced search
Home
Home
  • Log in
  • My Cart

Advanced Search

  • Home
  • Articles
    • Current
    • Special Feature Articles - Most Recent
    • Special Features
    • Colloquia
    • Collected Articles
    • PNAS Classics
    • List of Issues
  • Front Matter
    • Front Matter Portal
    • Journal Club
  • News
    • For the Press
    • This Week In PNAS
    • PNAS in the News
  • Podcasts
  • Authors
    • Information for Authors
    • Editorial and Journal Policies
    • Submission Procedures
    • Fees and Licenses
  • Submit
Research Article

Purkinje cell activity during classical conditioning with different conditional stimuli explains central tenet of Rescorla–Wagner model

Anders Rasmussen, View ORCID ProfileRiccardo Zucca, View ORCID ProfileFredrik Johansson, Dan-Anders Jirenhed, and Germund Hesslow
  1. aAssociative Learning Group, Department of Experimental Medical Science, Lund University, 221 00 Lund, Sweden;
  2. bThe Linnaeus Centre Thinking in Time: Cognition, Communication and Learning, Lund University, 221 00 Lund, Sweden;
  3. cLaboratory for Synthetic Perceptive, Emotive, and Cognitive Systems (SPECS), N-RAS, DTIC, Universitat Pompeu Fabra, 08018 Barcelona, Spain

See allHide authors and affiliations

PNAS November 10, 2015 112 (45) 14060-14065; first published October 26, 2015; https://doi.org/10.1073/pnas.1516986112
Anders Rasmussen
aAssociative Learning Group, Department of Experimental Medical Science, Lund University, 221 00 Lund, Sweden;
bThe Linnaeus Centre Thinking in Time: Cognition, Communication and Learning, Lund University, 221 00 Lund, Sweden;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: anders.rasmussen@med.lu.se
Riccardo Zucca
cLaboratory for Synthetic Perceptive, Emotive, and Cognitive Systems (SPECS), N-RAS, DTIC, Universitat Pompeu Fabra, 08018 Barcelona, Spain
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Riccardo Zucca
Fredrik Johansson
aAssociative Learning Group, Department of Experimental Medical Science, Lund University, 221 00 Lund, Sweden;
bThe Linnaeus Centre Thinking in Time: Cognition, Communication and Learning, Lund University, 221 00 Lund, Sweden;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Fredrik Johansson
Dan-Anders Jirenhed
aAssociative Learning Group, Department of Experimental Medical Science, Lund University, 221 00 Lund, Sweden;
bThe Linnaeus Centre Thinking in Time: Cognition, Communication and Learning, Lund University, 221 00 Lund, Sweden;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Germund Hesslow
aAssociative Learning Group, Department of Experimental Medical Science, Lund University, 221 00 Lund, Sweden;
bThe Linnaeus Centre Thinking in Time: Cognition, Communication and Learning, Lund University, 221 00 Lund, Sweden;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  1. Edited by Charles R. Gallistel, Rutgers University, Piscataway, NJ, and approved October 1, 2015 (received for review August 26, 2015)

  • Article
  • Figures & SI
  • Info & Metrics
  • PDF
Loading

Significance

The Rescorla–Wagner model of associative learning has guided research in behavioral and neural sciences for several decades. Although phenomena associated with the model have previously been linked to nucleo-olivary inhibition, many questions regarding the neural mechanisms underlying the model still remain. In this paper, we present evidence from our eyeblink conditioning setup, indicating that the variables used in Rescorla and Wagner's model have physiological correlates.

Abstract

A central tenet of Rescorla and Wagner’s model of associative learning is that the reinforcement value of a paired trial diminishes as the associative strength between the presented stimuli increases. Despite its fundamental importance to behavioral sciences, the neural mechanisms underlying the model have not been fully explored. Here, we present findings that, taken together, can explain why a stronger association leads to a reduced reinforcement value, within the context of eyeblink conditioning. Specifically, we show that learned pause responses in Purkinje cells, which trigger adaptively timed conditioned eyeblinks, suppress the unconditional stimulus (US) signal in a graded manner. Furthermore, by examining how Purkinje cells respond to two distinct conditional stimuli and to a compound stimulus, we provide evidence that could potentially help explain the somewhat counterintuitive overexpectation phenomenon, which was derived from the Rescorla–Wagner model.

  • eyeblink conditioning
  • Rescorla–Wagner model
  • inferior olive
  • nucleo-olivary pathway
  • climbing fibers

The Rescorla–Wagner model of associative learning is arguably the most influential theory of associative learning in recent history. The model successfully predicted several behavioral phenomena (1). Moreover, in contrast to the Hebbian model, it is a prime example of an error correction process in which behavioral changes result from violation of expectations (2). A central tenet of the model is that the reinforcement value of a paired trial depends on the existing associative strength between the presented stimuli (3, 4). Neural mechanisms for several phenomena related to the Rescorla–Wagner model have already been proposed (5⇓⇓⇓⇓⇓⇓⇓⇓⇓⇓–16). In this paper, we present evidence from our eyeblink setup that builds on and advances prior thinking regarding the physiological basis of the Rescorla–Wagner model.

In eyeblink conditioning, repeated presentations of a neutral conditional stimulus (CS), such as a tone or a light stimulus, followed by a blink-eliciting unconditional stimulus (US), such as an air puff to the cornea or electrical stimulation of the periorbital skin, results in the acquisition of a conditioned blink response (CR). Previous studies have shown that eyeblink conditioning depends on the cerebellum (17, 18) and that the cerebellar cortex plays a crucial role (19). Specifically, conditioned blink responses appear to be triggered by pause responses in GABAergic Purkinje cells (20). These pause responses, which are acquired gradually during conditioning (21), disinhibit cells in the cerebellar nuclei (22), thus allowing them to activate muscles controlling the eyelid (23, 24). Disinhibition of the cerebellar nuclei also activates GABAergic cells that project to the inferior olive (15). Because the US signal enters the cerebellum via the inferior olive (18), we hypothesized that the nucleo-olivary inhibition that arises during learning, suppresses the US signal and therefore reduces the reinforcement value of a paired trial, as postulated in the Rescorla–Wagner model.

A surprising consequence of the model is that if a subject has learned to respond to two different CSs, the reinforcement value of a trial where both CSs and the US are presented will be negative and will cause extinction. This counterintuitive prediction has been confirmed in several learning paradigms including fear conditioning (25, 26), appetitive conditioning (27, 28), and eyeblink conditioning (10). The phenomenon is known as “overexpectation” because the subject may be said to “expect” a US that is more intense than the one it actually receives. We hypothesized that, within the context of eyeblink conditioning, overexpectation occurs because the compound CS results in stronger simple spike suppression in the Purkinje cells and, consequently, a stronger nucleo-olivary inhibition of the US signal, to the extent that the reinforcement value becomes negative.

Results

To test our hypotheses, we recorded simple and complex spikes from 30 Purkinje cells in the C3 zone of the cerebellar cortex in 23 decerebrated ferrets (Fig. 1). The animals had been trained in a classical delay-conditioning paradigm where we alternated between presenting two different CSs, paired with a US. CSA consisted of superior colliculus stimulation (12 cells), stimulation of ipsilateral whiskers (14 cells), or pontine stimulation (2 cells). CSB was always forelimb stimulation. As US, we used periorbital electrical stimulation (17 cells) or climbing-fiber stimulation (13 cells). When we found a cell in a trained animal, we examined how the cell responded to each CS as well as to simultaneous presentation of both CSs. In a set of 10 cells, we also examined how the presentation of a CS influences the probability that a subsequent periorbital US elicits a complex spike. To test this, we compared the probability that a periorbital US would elicit a complex spike if it was preceded by CSA, CSB, CSA + CSB, or no CS.

Fig. 1.
  • Download figure
  • Open in new tab
  • Download powerpoint
Fig. 1.

Experimental setup and field potential recordings. (A) Illustration of the experimental setup including relevant afferent and efferent cerebellar pathways. As CS, we used stimulation of the forelimb, superior colliculus (SC) pontine nuclei, or whiskers. As US, we used stimulation of climbing fibers (CF) or the periorbital skin (eye). CN, cerebellar nuclei; GC, granule cells; NO, nucleo-olivary pathway; PC, Purkinje cell. (B) Examples of field potentials elicited on the cerebellar cortex following stimulation of cerebellar afferents. (C) A Purkinje cell recording showing simple spikes, complex spikes, and a learned pause response or Purkinje cell CR.

The fact that a subject can acquire CRs to more than one CS raises the question of whether an individual Purkinje cell can acquire pause responses to more than one CS, or if separate stimuli require separate Purkinje cells. Of 26 Purkinje cells, 23 exhibited a reduced firing rate (<100%, relative to background), in response to each of the two CSs, and despite limited training we found 10 cells with distinctive pause responses to each CS (Fig. 2). These results are important because we can say, with certainty, that individual Purkinje cells can acquire conditioned pause responses to at least two CSs that belong to different sensory modalities.

Fig. 2.
  • Download figure
  • Open in new tab
  • Download powerpoint
Fig. 2.

Single Purkinje cells can acquire pause responses to two different CSs. (A) Raster plots showing the responses of four Purkinje cells to 20 trials of CSA (superior colliculus, n = 3, or whisker air puff, n = 1, red) and CSB (forelimb, n = 4, green). (B) Composite raster diagram with spikes from 10 Purkinje cells showing pause responses to CSA (superior colliculus, n = 6, or whisker air puff, n = 4) and CSB (forelimb, n = 10). (C) Line diagram showing average response profiles to each of the two CSs in the 10 cells.

Having established that Purkinje cells can acquire pause responses to two different CSs, we proceeded to analyze the effect of presenting both stimuli simultaneously. Presenting this compound CS resulted in a stronger suppression of Purkinje cell activity compared with when either of the two CSs was presented individually (Fig. 3). Of the 26 cells, 18 exhibited a lower firing rate in response to the compound CS. A repeated-measures ANOVA showed that the activity during the CS depended on the type of stimulation used [F(2,25) = 14.74, P < 0.0001***]. The firing rate on trials with the compound CS was lower than on trials where either CSA [F(1,25) = 35.09, P < 0.00001***] or CSB [F(1,25) = 8.1, P = 0.0087**] was presented alone. As illustrated in Fig. 3D, the effect was most pronounced in the latter part of the CS, which is consistent with earlier reports (21) and with the known time course of nucleo-olivary inhibition (14, 29).

Fig. 3.
  • Download figure
  • Open in new tab
  • Download powerpoint
Fig. 3.

Presentation of two CSs simultaneously results in a stronger pause response than any of the two CSs elicits individually. (A) Sample recordings from one cell showing five trials for each CS (red and green) as well as five trials in which both CSs were presented as a compound (blue). (B) Raster plots showing how two cells respond to two different CSs (red and green), and to both CSs combined (blue). (C) Boxplot showing the distribution of Purkinje cell activity during CSA (red), CSB (green), and CSA ± CSB (blue). (D) Line diagram illustrating the average profile of the Purkinje cell pause response (mean ± SEM), for CSA (red), CSB (green), and CSA ± CSB (blue).

To test whether a suppression of Purkinje cell activity can reduce the probability that a subsequent periorbital US elicits a complex spike, we trained 10 Purkinje cells until they appeared to exhibit reduced firing rates in response to both CSA (superior colliculus stimulation, n = 6, or whisker air puff, n = 4) and CSB (forelimb stimulation). We then examined whether the probability that the periorbital US elicited a complex spike was dependent on whether a CS preceded the stimulus. The analysis showed that the periorbital US, presented alone, elicited complex spikes on 79 ± 5% of trials. The corresponding values when the periorbital stimulation was preceded by CSA and CSB were 49 ± 11% and 38 ± 12%, respectively. Combining CSA and CSB reduced the percentage to 37 ± 12%. A repeated-measures ANOVA revealed a significant difference in the percentage of trials in which the periorbital US elicited a complex spike, depending on the type of CS that preceded the stimulus [F(3,9) = 13.41, P < 0.0001***] (Fig. 4A). However, the compound CS did not reduce the complex spike probability more than presenting the individual CSs (Fig. 4A). This apparent anomaly may be due to greater variability in the effectiveness of the different CSs in suppressing simple spike activity. To examine this more closely, we analyzed cells in which each CS induced at least a 15% reduction in Purkinje cell activity. In the six cells meeting this criterion, the average probability that a periorbital US would elicit a complex spike was 26 ± 9% following CSA, 19 ± 13% following CSB, and 13 ± 12% following CSA + CSB. This indicates that a compound CS does indeed induce a stronger suppression of the inferior olive than the constituent CSs presented individually, as long as each CS induces some suppression of Purkinje cell activity.

Fig. 4.
  • Download figure
  • Open in new tab
  • Download powerpoint
Fig. 4.

The probability that a periorbital US elicits a complex spike is reduced if it is preceded by a CS-induced suppression of Purkinje cell activity. (A) The probability that a periorbital stimulus elicits a complex spike depends on whether it is preceded by a CS. (B) Simple spike activity during the presentation of different CS combinations or without a CS, relative to the background-firing rate in the same cell. (C) Correlation between the suppression of Purkinje cell activity induced by a CS and the probability that a subsequent periorbital stimulus elicits a complex spike in the same Purkinje cell. Each point in the scatterplot corresponds to the average value for each CS type, for each cell (1 cell = 4 points).

The Rescorla–Wagner model predicts that the reinforcement value should decrease gradually as the learned association between the stimuli gets stronger. In the context of eyeblink conditioning, this should mean that a CS that elicits a strong suppression of simple spike activity also induces a strong suppression of the inferior olive and is therefore associated with a lower complex spike probability following a periorbital US. To test this, we calculated the correlation between the Purkinje cell firing rate during the presentation of a given CS and the probability that a periorbital US, presented at the CS offset, elicited a complex spike. As shown in Fig. 4C, there was a strong correlation between the Purkinje cell suppression induced by a certain CS and the probability that a subsequent periorbital US elicited a complex spike (r = 0.58). Excluding cases in which the simple spike activity during the CS exceeded 200% resulted in an even stronger correlation (r = 0.67). This suggests that the strength of the Purkinje cell suppression, which reflects the amount of learning that has taken place, regulates the probability that a periorbital US will be transmitted to the cerebellar cortex, and that this occurs in a graded manner.

Discussion

Animals can acquire conditioned blink responses to a wide range of stimuli, including tones and light stimuli (30), forelimb stimulation, whisker stimulation (31), lateral geniculate nucleus stimulation, superior colliculus stimulation (32), and mossy fiber stimulation (33). Consistent with their purported role in eyeblink conditioning, Purkinje cells can also acquire conditioned pause responses to different CSs, including stimuli applied to the forelimb, mossy fibers (21), superior colliculus (34), and parallel fibers (35). The present results show that individual Purkinje cells can also acquire pause responses to two CSs of different modalities. This is consistent with a recent study in which it was shown that Purkinje cells can acquire pause responses to two tones with different frequencies (36). Next, we examined the effect of presenting two CSs simultaneously, as a compound CS. At the behavioral level, this will give rise to a stronger blink response (10), and we predicted that the same would hold true for CS-induced suppression of Purkinje cell activity. This prediction was confirmed. Thus, cells that had been trained to two different CSs produced a stronger pause response when these were combined compared with when either CS was presented alone.

A Purkinje cell initiates behavior by disinhibiting the cerebellar nuclei, allowing them to initiate motor activity (37). However, disinhibiting the cerebellar nuclei also leads to inhibition of the inferior olive via the GABAergic nucleo-olivary pathway (6, 7, 16, 38, 39). This can be seen by recording field potentials on the cerebellar surface (40, 41), or the frequency of spontaneous complex spikes in Purkinje cells, during conditioning (14). Because the inhibition is associated with an unusually long delay (42), it will coincide with the arrival of the US (13), which suggests that the nucleo-olivary pathway is part of a negative-feedback system that controls cerebellar learning (5, 16).

Accordingly, the present results show that presentation of a CS that has previously been paired with the US reduces the probability that a periorbital US elicit complex spikes. This means that a suppression of Purkinje cell activity is sufficiently strong to suppress the signal generated by a periorbital US. However, these results do not contradict the idea that the nucleo-olivary inhibition can change the olivary signal in a graded manner, such as by reducing the number of spikes in the climbing-fiber signal (15, 43⇓–45). We also hypothesized that, when each CS induced a suppression of the simple spike activity, presentation of a compound CS would result in an even lower probability of a complex spike following the periorbital US. When we examined only those cells in which each CS suppressed Purkinje cell activity by at least 15%, there was indeed a more pronounced inhibition of complex spikes when both stimuli were presented simultaneously. However, due to the small sample size (n = 6), we could not test these differences statistically.

To assess more accurately how a learned pause response affects the excitability of the inferior olive, we calculated the correlation between the suppression of Purkinje cell activity induced by a CS and the probability that a periorbital US would elicit a complex spike. This analysis showed that a CS that elicits a strong suppression of Purkinje cell activity also induces a strong suppression of periorbitally elicited complex spikes. This is in perfect agreement with the observation that Purkinje cells control cells in the inferior olive from which they receive their climbing-fiber afferents (29, 46).

According to the Rescorla–Wagner model of classical conditioning, the reinforcing value of a paired trial decreases as the US becomes more predictable, or in other words, the extent to which a US is surprising (4). In mathematical terms the change in associative strength (ΔV) on a given trial is given by the following (simplified) version of the original Rescorla–Wagner equation:ΔV=αβ(λ−V),where α and β are the associabilities of the CS and the US, respectively; λ is the maximum associative strength that the US can support; and V is the current associative strength. In the beginning of acquisition, there is a large difference between λ and V, and therefore the learning effect, the change in associative strength, will be at its maximum, only limited by the associability of the two stimuli. However, as learning proceeds and V approaches λ, (λ − V) and ΔV will approach zero and V will reach an asymptote.

In the context of eyeblink conditioning, our results suggest plausible neural correlates of the variables on which the Rescorla–Wagner model is based. As previously mentioned, conditioning leads to a suppression of Purkinje cell activity that also suppresses the inferior olive, and thus the US signal, until an equilibrium is reached. If we assume that λ is determined by the intensity of the US (climbing-fiber signal) and V corresponds to the degree of simple spike suppression induced by the CS, we can begin to explain several behavioral phenomena that have been derived from the Rescorla–Wagner model. For example, extinction occurs when a CS that has a high associative strength (V) is presented without a US (λ = 0), so that (λ − V), and consequently (ΔV), is negative leading to a reduction in associative strength, which is extinction. Consistent with this idea, it has been suggested that the nucleo-olivary pathway is crucial for extinction to occur (9). Another phenomenon, blocking, refers to the fact that conditioning will not occur in response to a CS if it is only presented together with another CS, to which the subject has already been conditioned (47). The absence of learning to the second CS is presumably due to the inhibition of the US induced by the other CS, and without the US, learning will not occur (8). In mathematical terms, (λ − V) will be near zero because the associative strength (V) of the first CS is close to λ and adding a second CS will not change that.

Overexpectation is another consequence of the Rescorla–Wagner model. To account for situations where a compound of two CSs is used, each with its own associative strength, the basic formula needs to be modified so that ΔV becomes proportional to λ − (V1 + V2). If two CSs are already maximally associated with the US (λ = V), the current associative strength of the compound will be V1 + V2, meaning that λ − (V1 + V2), and consequently ΔV, will be negative. The model therefore predicts that presenting two CSs simultaneously, each of which already produces a CR, will result in a partial extinction of the CRs, even if the US is still presented.

Our results are consistent with the idea that overexpectation occurs because the compound CS causes a stronger suppression of the simple spike firing than the individual CSs. The increased suppression could push the excitability of the inferior olive below the equilibrium level, and thus weaken the US signal. However, because many of our cells were trained with a climbing-fiber US, which is not affected by nucleo-olivary inhibition, we cannot prove that the stronger pause response induced by the compound CS causes extinction. To properly test the idea that overexpectation is a result of aggregated nucleo-olivary inhibition, one would have to train animals with a periorbital US and then see that the pause response, and preferably also the overt CR, is extinguished.

Materials and Methods

Subjects and Surgery.

Subjects were 23 decerebrated male ferrets in which 30 extracellular Purkinje cell recordings were made. The ferrets were initially anesthetized in a mixture of O2 and air with 1.5–2% (vol/vol) isoflurane (Baxter Medical), which was later replaced by propofol (10 mg/mL Diprivan; AstraZeneca) administered intravenously. When deep anesthesia had been achieved, a tracheotomy was performed and gas was channeled directly into a tracheal tube. The end-expiratory CO2 concentration, arterial blood pressure, and rectal temperature were monitored continuously and kept within physiological limits throughout the experiment. The animal’s head was fixed in a stereotaxic frame. The skull was then opened on the left side, and the caudal half of the left cerebral hemisphere, together with a substantial part of the thalamus on the left side, were removed by aspiration. The aspiration exposed the cerebellum and the superior and inferior colliculi. The animals were decerebrated by sectioning the brainstem with a blunt spatula 1–2 mm rostral to the superior colliculus. After decerebration, anesthesia was discontinued. With the cerebellum and colliculi exposed, a pool was constructed of cotton-reinforced agar and filled with warm high-density perfluoro carbon liquid (FC-40). To ensure mechanical stability in the tissue, the animals were curarized, artificially ventilated, and were kept hanging by the spine, with the head fixed in the stereotaxic frame. The dura covering the cerebellum was removed, and the cerebellar surface was covered with agarose gel (18–20 mg/mL) to provide recording stability and prevent edema near the site of recording. This study has been reviewed and approved by the Malmö–Lund animal experimentation ethics committee.

Stimulation of Cerebellar Afferents.

Forelimb and periorbital stimulation consisted of electrical pulses (1–3 mA, 1 ms), passed through insulated insect needles. For whisker stimulation, we gave three to six air puffs directed at the ipsilateral whiskers, with a pressure of 5–20 psi. The pressure was reduced if the air puff elicited eye muscle activity. For stimulation of cerebellar afferents, we used insulated tungsten electrodes with a tip of 30 µm. Climbing fibers were stimulated by lowering an electrode 4.0–5.0 mm below the posterior cerebellar surface, at an angle of 45°, 4 mm lateral to the midline and 4 mm rostral to the caudal border of the cerebellar vermis. The superficial layer of the ipsilateral superior colliculus was stimulated by placing an electrode 1 mm medial of the lateral border of the superior colliculus at a depth of ∼100 µm. The pontine nuclei were stimulated by lowering an electrode, at an angle of 90°, down through the middle of the superior colliculus to a depth of 8 mm. When stimulating cerebellar afferents, we used intensities ranging from 50 to 750 µA, with pulse duration of 0.1 ms. To find the optimal stimulation site, single electrical pulses (100 µA) were applied and the evoked field potentials from the cerebellar surface were recorded. Field potentials were used to verify that climbing-fiber and periorbital stimulation were effective and to identify the eyeblink area in the C3 zone of the hemispheral lobule VI. Stimulation sites and stimulus intensities were verified again and adjusted if necessary, when recording the activity of single Purkinje cells.

Training Protocol.

CSA consisted of superior colliculus stimulation (12 cells), stimulation of ipsilateral whiskers (16 cells), or pontine stimulation (2 cells). In all 30 cells, CSB consisted of forelimb stimulation. Forelimb, superior colliculus, and pontine CSs consisted of a 50-Hz, 300-ms stimulation train of electrical pulses. The stimulation intensity ranged between 50 and 300 μA for central stimulation (superior colliculus and pontine stimulation), and 1 and 3 mA for forelimb stimulation. The air puff CS consisted of six 20-ms air puffs, repeated at 20 Hz, with a pressure ranging between 0.3 and 1.3 bar. Before training, we verified that the air puff did not elicit alpha responses. The US consisted of either climbing-fiber stimulation (13 cells) or periorbital stimulation (17 cells). The climbing-fiber US consisted of two 10-ms stimulus trains delivered with a 20-ms interval, each consisting of five impulses at 500 Hz, with an intensity ranging between 100 and 500 μA, applied to the ipsilateral climbing fibers. The periorbital US consisted of three pulses delivered bilaterally to the periorbital skin, repeated at 50 Hz, with a duration of 1 ms and with an intensity ranging between 2 and 3 mA. When examining the effect of CS-induced suppression of Purkinje cell activity on the probability that a periorbital US elicits a complex spike, we used a single periorbital stimuli to avoid interference from stimulus artifacts. We consistently used an intertrial interval of 15 ± 1 s and an interstimulus interval of 300 ms.

Training consisted of alternating blocks of 20 trials of CSA + US, and CSB + US pairings. This training protocol was used until a change in Purkinje cell activity was detected in response to one or both CSs. If only one CS appeared to result in a pause response, we proceeded to train only with the CS that did not elicit a response. If both CSs induced a Purkinje cell CR, we stopped the training and proceeded to test the effect of CSA and CSB individually, as well as the effect of the compound stimulus (CSA + CSB) in three independent blocks of 20 CS-alone trials. To test the effect of the Purkinje cell pause response on the probability that a subsequent periorbital stimulation pulse (eye) would elicit a complex spike, we repeatedly presented, in succession: (i) eye only, (ii) CSA + eye, (iii) CSB + eye, and (iv) CSA + CSB + eye.

Purkinje Cell Recordings.

Extracellular recordings of Purkinje cells, identified by the presence of complex spikes, were performed using 30- to 40-µm metal core diameter, quartz glass-coated platinum–tungsten fiber microelectrodes with an impedance ranging from 5 to 10 MΩ (Thomas Recording). The signal from the microelectrode was fed through a preamplifier and filter module from Digitimer, before entering a Power 1401 AD converter (CED), which passed the signal on to a PC running Spike2, version 7, software. On-line and off-line spike sorting was done in Spike2, and subsequent data analysis was done in Matlab. The following recording strategy was used for obtaining single-cell records: (i) find a Purkinje cell; (ii) verify that periorbital stimulation elicits a complex spike with a latency consistent with the properties of the C3 zone (24, 48); (iii) determine the stimulation threshold for the US; (iv) start paired CS–US presentations and record cell activity; (v) if a cell shows a conditioned response to one CS but not the other, then proceed to train only with the CS that does not elicit a response; (vi) if both CSs elicit Purkinje cell CRs, discontinue the training protocol and test the effects of the CSs individually, as well as the effect of the compound CS on CS-alone trials; if a cell is lost, go back to step 1.

Acknowledgments

This work was supported by Swedish Research Council Grants 2015-00276 (to A.R.), 349-2007-8695 (to The Linnaeus Centre for Cognition, Communication and Learning), and 09899 (to G.H.), and grants from the Söderberg, Krapperup, and Åhlen Foundations.

Footnotes

  • ↵1To whom correspondence should be addressed. Email: anders.rasmussen{at}med.lu.se.
  • Author contributions: A.R., D.-A.J., and G.H. designed research; A.R., R.Z., and F.J. performed research; A.R. and R.Z. analyzed data; and A.R. and G.H. wrote the paper.

  • The authors declare no conflict of interest.

  • This article is a PNAS Direct Submission.

Freely available online through the PNAS open access option.

References

  1. ↵
    1. Miller RR,
    2. Barnet RC,
    3. Grahame NJ
    (1995) Assessment of the Rescorla–Wagner model. Psychol Bull 117(3):363–386
    .
    OpenUrlCrossRefPubMed
  2. ↵
    1. Sutton RS,
    2. Barto AG
    (1981) Toward a modern theory of adaptive networks: Expectation and prediction. Psychol Rev 88(2):135–170
    .
    OpenUrlCrossRefPubMed
  3. ↵
    1. Gallistel C
    (1990) The Organization of Learning (Bradford Books/MIT, Cambridge, MA)
    .
  4. ↵
    1. Rescorla RA,
    2. Wagner AR,
    3. Black AH,
    4. Prokasy WF
    (1972) A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement. Classical Conditioning II (Appleton-Century-Crofts, New York), pp 64–99
    .
  5. ↵
    1. Andersson G,
    2. Garwicz M,
    3. Hesslow G
    (1988) Evidence for a GABA-mediated cerebellar inhibition of the inferior olive in the cat. Exp Brain Res 72(3):450–456
    .
    OpenUrlPubMed
  6. ↵
    1. Sears LL,
    2. Steinmetz JE
    (1991) Dorsal accessory inferior olive activity diminishes during acquisition of the rabbit classically conditioned eyelid response. Brain Res 545(1-2):114–122
    .
    OpenUrlCrossRefPubMed
  7. ↵
    1. Hesslow G,
    2. Ivarsson M
    (1996) Inhibition of the inferior olive during conditioned responses in the decerebrate ferret. Exp Brain Res 110(1):36–46
    .
    OpenUrlCrossRefPubMed
  8. ↵
    1. Kim JJ,
    2. Krupa DJ,
    3. Thompson RF
    (1998) Inhibitory cerebello-olivary projections and blocking effect in classical conditioning. Science 279(5350):570–573
    .
    OpenUrlAbstract/FREE Full Text
  9. ↵
    1. Medina JF,
    2. Nores WL,
    3. Mauk MD
    (2002) Inhibition of climbing fibres is a signal for the extinction of conditioned eyelid responses. Nature 416(6878):330–333
    .
    OpenUrlCrossRefPubMed
  10. ↵
    1. Kehoe EJ,
    2. White NE
    (2004) Overexpectation: Response loss during sustained stimulus compounding in the rabbit nictitating membrane preparation. Learn Mem 11(4):476–483
    .
    OpenUrlAbstract/FREE Full Text
  11. ↵
    1. Bengtsson F,
    2. Jirenhed D-A,
    3. Svensson P,
    4. Hesslow G
    (2007) Extinction of conditioned blink responses by cerebello-olivary pathway stimulation. Neuroreport 18(14):1479–1482
    .
    OpenUrlCrossRefPubMed
  12. ↵
    1. Rasmussen A,
    2. Jirenhed D-A,
    3. Hesslow G
    (2008) Simple and complex spike firing patterns in Purkinje cells during classical conditioning. Cerebellum 7(4):563–566
    .
    OpenUrlCrossRefPubMed
  13. ↵
    1. Lepora NF,
    2. Porrill J,
    3. Yeo CH,
    4. Dean P
    (2010) Sensory prediction or motor control? Application of Marr-Albus type models of cerebellar function to classical conditioning. Front Comput Neurosci 4:140
    .
    OpenUrlPubMed
  14. ↵
    1. Rasmussen A,
    2. Jirenhed DA,
    3. Wetmore DZ,
    4. Hesslow G
    (2014) Changes in complex spike activity during classical conditioning. Front Neural Circuits 8:90
    .
    OpenUrlPubMed
  15. ↵
    1. Rasmussen A,
    2. Hesslow G
    (2014) Feedback control of learning by the cerebello-olivary pathway. Prog Brain Res 210:103–119
    .
    OpenUrlCrossRefPubMed
  16. ↵
    1. Bengtsson F,
    2. Svensson P,
    3. Hesslow G
    (2004) Feedback control of Purkinje cell activity by the cerebello-olivary pathway. Eur J Neurosci 20(11):2999–3005
    .
    OpenUrlCrossRefPubMed
  17. ↵
    1. McCormick DA,
    2. Thompson RF
    (1984) Cerebellum: Essential involvement in the classically conditioned eyelid response. Science 223(4633):296–299
    .
    OpenUrlAbstract/FREE Full Text
  18. ↵
    1. Yeo CH,
    2. Hesslow G
    (1998) Cerebellum and conditioned reflexes. Trends Cogn Sci 2(9):322–330
    .
    OpenUrlCrossRefPubMed
  19. ↵
    1. Longley M,
    2. Yeo CH
    (2014) Distribution of neural plasticity in cerebellum-dependent motor learning. Prog Brain Res 210:79–101
    .
    OpenUrlCrossRefPubMed
  20. ↵
    1. Jirenhed D-A,
    2. Hesslow G
    (2015) Are Purkinje cell pauses drivers of classically conditioned blink responses? Cerebellum doi:10.1007/s12311-015-0722-4
    .
    OpenUrlCrossRef
  21. ↵
    1. Jirenhed DA,
    2. Bengtsson F,
    3. Hesslow G
    (2007) Acquisition, extinction, and reacquisition of a cerebellar cortical memory trace. J Neurosci 27(10):2493–2502
    .
    OpenUrlAbstract/FREE Full Text
  22. ↵
    1. Najac M,
    2. Raman IM
    (2015) Integration of Purkinje cell inhibition by cerebellar nucleo-olivary neurons. J Neurosci 35(2):544–549
    .
    OpenUrlAbstract/FREE Full Text
  23. ↵
    1. Heiney SA,
    2. Kim J,
    3. Augustine GJ,
    4. Medina JF
    (2014) Precise control of movement kinematics by optogenetic inhibition of Purkinje cell activity. J Neurosci 34(6):2321–2330
    .
    OpenUrlAbstract/FREE Full Text
  24. ↵
    1. Hesslow G
    (1994) Correspondence between climbing fibre input and motor output in eyeblink-related areas in cat cerebellar cortex. J Physiol 476(2):229–244
    .
    OpenUrlCrossRefPubMed
  25. ↵
    1. Rescorla RA
    (1970) Reduction in the effectiveness of reinforcement after prior excitatory conditioning. Learn Motiv (1):372–381
    .
  26. ↵
    1. McNally GP,
    2. Pigg M,
    3. Weidemann G
    (2004) Blocking, unblocking, and overexpectation of fear: A role for opioid receptors in the regulation of Pavlovian association formation. Behav Neurosci 118(1):111–120
    .
    OpenUrlCrossRefPubMed
  27. ↵
    1. Lattal LM,
    2. Nakajima S
    (1998) Overexpectation in appetitive Pavlovian and instrumental conditioning. Anim Learn Behav 26(3):351–360
    .
    OpenUrlCrossRef
  28. ↵
    1. Khallad Y,
    2. Moore J
    (1996) Blocking, unblocking, and overexpectation in autoshaping with pigeons. J Exp Anal Behav 65(3):575–591
    .
    OpenUrlCrossRefPubMed
  29. ↵
    1. Bengtsson F,
    2. Hesslow G
    (2006) Cerebellar control of the inferior olive. Cerebellum 5(1):7–14
    .
    OpenUrlCrossRefPubMed
  30. ↵
    1. Moore JW
    1. Kehoe EJ,
    2. Macrae M
    (2002) Fundamental behavioral methods and findings in classical conditioning. A Neuroscientist’s Guide to Classical Conditioning, ed Moore JW (Springer, New York), pp 171–231
    .
  31. ↵
    1. Carrel AJ,
    2. Zbarska S,
    3. Zenitsky GD,
    4. Bracha V
    (2012) A trigeminal conditioned stimulus yields fast acquisition of cerebellum-dependent conditioned eyeblinks. Behav Brain Res 226(1):189–196
    .
    OpenUrlCrossRefPubMed
  32. ↵
    1. Halverson HE,
    2. Hubbard EM,
    3. Freeman JH
    (2009) Stimulation of the lateral geniculate, superior colliculus, or visual cortex is sufficient for eyeblink conditioning in rats. Learn Mem 16(5):300–307
    .
    OpenUrlAbstract/FREE Full Text
  33. ↵
    1. Steinmetz JE
    (1990) Classical nictitating membrane conditioning in rabbits with varying interstimulus intervals and direct activation of cerebellar mossy fibers as the CS. Behav Brain Res 38(2):97–108
    .
    OpenUrlCrossRefPubMed
  34. ↵
    1. Rasmussen A, et al.
    (2013) Number of spikes in climbing fibers determines the direction of cerebellar learning. J Neurosci 33(33):13436–13440
    .
    OpenUrlAbstract/FREE Full Text
  35. ↵
    1. Johansson F,
    2. Jirenhed D-A,
    3. Rasmussen A,
    4. Zucca R,
    5. Hesslow G
    (2014) Memory trace and timing mechanism localized to cerebellar Purkinje cells. Proc Natl Acad Sci USA 111(41):14930–14934
    .
    OpenUrlAbstract/FREE Full Text
  36. ↵
    1. Halverson HE,
    2. Khilkevich A,
    3. Mauk MD
    (2015) Relating cerebellar Purkinje cell activity to the timing and amplitude of conditioned eyelid responses. J Neurosci 35(20):7813–7832
    .
    OpenUrlAbstract/FREE Full Text
  37. ↵
    1. Perciavalle V, et al.
    (2013) Consensus paper: Current views on the role of cerebellar interpositus nucleus in movement control and emotion. Cerebellum 12(5):738–757
    .
    OpenUrlCrossRefPubMed
  38. ↵
    1. Nelson B,
    2. Mugnaini E,
    3. Strata P
    (1989) Origins of GABA-ergic inputs to the inferior olive. The Olivocerebellar System in Motor Control (Springer, Berlin), pp 86–107
    .
  39. ↵
    1. de Zeeuw CI,
    2. Holstege JC,
    3. Calkoen F,
    4. Ruigrok TJ,
    5. Voogd J
    (1988) A new combination of WGA-HRP anterograde tracing and GABA immunocytochemistry applied to afferents of the cat inferior olive at the ultrastructural level. Brain Res 447(2):369–375
    .
    OpenUrlCrossRefPubMed
  40. ↵
    1. Apps R,
    2. Lee S
    (2002) Central regulation of cerebellar climbing fibre input during motor learning. J Physiol 541(Pt 1):301–317
    .
    OpenUrlCrossRefPubMed
  41. ↵
    1. Hesslow G
    (1986) Inhibition of inferior olivary transmission by mesencephalic stimulation in the cat. Neurosci Lett 63(1):76–80
    .
    OpenUrlCrossRefPubMed
  42. ↵
    1. Svensson P,
    2. Bengtsson F,
    3. Hesslow G
    (2006) Cerebellar inhibition of inferior olivary transmission in the decerebrate ferret. Exp Brain Res 168(1-2):241–253
    .
    OpenUrlCrossRefPubMed
  43. ↵
    1. Herreros I,
    2. Verschure PF
    (2013) Nucleo-olivary inhibition balances the interaction between the reactive and adaptive layers in motor control. Neural Netw 47:64–71
    .
    OpenUrlCrossRefPubMed
  44. ↵
    1. Najafi F,
    2. Medina JF
    (2013) Beyond “all-or-nothing” climbing fibers: Graded representation of teaching signals in Purkinje cells. Front Neural Circuits 7:115
    .
    OpenUrlPubMed
  45. ↵
    1. Gilbert PF
    (1974) A theory of memory that explains the function and structure of the cerebellum. Brain Res 70(1):1–18
    .
    OpenUrlCrossRefPubMed
  46. ↵
    1. Chaumont J, et al.
    (2013) Clusters of cerebellar Purkinje cells control their afferent climbing fiber discharge. Proc Natl Acad Sci USA 110(40):16223–16228
    .
    OpenUrlAbstract/FREE Full Text
  47. ↵
    1. Campbell BA,
    2. Church RM
    1. Kamin LJ
    (1969) Predictability, surprise attention and conditioning. Punishment and Aversive Behavior, eds Campbell BA, Church RM (Appleton-Century-Crofts, New York), pp 279–296
    .
  48. ↵
    1. Hesslow G
    (1994) Inhibition of classically conditioned eyeblink responses by stimulation of the cerebellar cortex in the decerebrate cat. J Physiol 476(2):245–256
    .
    OpenUrlCrossRefPubMed
PreviousNext
Back to top
Article Alerts
Email Article

Thank you for your interest in spreading the word on PNAS.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Purkinje cell activity during classical conditioning with different conditional stimuli explains central tenet of Rescorla–Wagner model
(Your Name) has sent you a message from PNAS
(Your Name) thought you would like to see the PNAS web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Citation Tools
Neural basis of the Rescorla–Wagner model
Anders Rasmussen, Riccardo Zucca, Fredrik Johansson, Dan-Anders Jirenhed, Germund Hesslow
Proceedings of the National Academy of Sciences Nov 2015, 112 (45) 14060-14065; DOI: 10.1073/pnas.1516986112

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Request Permissions
Share
Neural basis of the Rescorla–Wagner model
Anders Rasmussen, Riccardo Zucca, Fredrik Johansson, Dan-Anders Jirenhed, Germund Hesslow
Proceedings of the National Academy of Sciences Nov 2015, 112 (45) 14060-14065; DOI: 10.1073/pnas.1516986112
del.icio.us logo Digg logo Reddit logo Twitter logo CiteULike logo Facebook logo Google logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Mendeley logo Mendeley

Article Classifications

  • Biological Sciences
  • Neuroscience
  • Social Sciences
  • Psychological and Cognitive Sciences
Proceedings of the National Academy of Sciences: 112 (45)
Table of Contents

Submit

Sign up for Article Alerts

Jump to section

  • Article
    • Abstract
    • Results
    • Discussion
    • Materials and Methods
    • Acknowledgments
    • Footnotes
    • References
  • Figures & SI
  • Info & Metrics
  • PDF

You May Also be Interested in

Setting sun over a sun-baked dirt landscape
Core Concept: Popular integrated assessment climate policy models have key caveats
Better explicating the strengths and shortcomings of these models will help refine projections and improve transparency in the years ahead.
Image credit: Witsawat.S.
Model of the Amazon forest
News Feature: A sea in the Amazon
Did the Caribbean sweep into the western Amazon millions of years ago, shaping the region’s rich biodiversity?
Image credit: Tacio Cordeiro Bicudo (University of São Paulo, São Paulo, Brazil), Victor Sacek (University of São Paulo, São Paulo, Brazil), and Lucy Reading-Ikkanda (artist).
Syrian archaeological site
Journal Club: In Mesopotamia, early cities may have faltered before climate-driven collapse
Settlements 4,200 years ago may have suffered from overpopulation before drought and lower temperatures ultimately made them unsustainable.
Image credit: Andrea Ricci.
Steamboat Geyser eruption.
Eruption of Steamboat Geyser
Mara Reed and Michael Manga explore why Yellowstone's Steamboat Geyser resumed erupting in 2018.
Listen
Past PodcastsSubscribe
Birds nestling on tree branches
Parent–offspring conflict in songbird fledging
Some songbird parents might improve their own fitness by manipulating their offspring into leaving the nest early, at the cost of fledgling survival, a study finds.
Image credit: Gil Eckrich (photographer).

Similar Articles

Site Logo
Powered by HighWire
  • Submit Manuscript
  • Twitter
  • Facebook
  • RSS Feeds
  • Email Alerts

Articles

  • Current Issue
  • Special Feature Articles – Most Recent
  • List of Issues

PNAS Portals

  • Anthropology
  • Chemistry
  • Classics
  • Front Matter
  • Physics
  • Sustainability Science
  • Teaching Resources

Information

  • Authors
  • Editorial Board
  • Reviewers
  • Subscribers
  • Librarians
  • Press
  • Site Map
  • PNAS Updates
  • FAQs
  • Accessibility Statement
  • Rights & Permissions
  • About
  • Contact

Feedback    Privacy/Legal

Copyright © 2021 National Academy of Sciences. Online ISSN 1091-6490