Академический Документы
Профессиональный Документы
Культура Документы
Number of spikes
(NAc) shell, recorded using this method at an 15
form of striatal neuron-specific αCaMKII
early withdrawal time point (1–3 days (in which Thr286 is mutated to Asp)
post-treatment) following 5 days of sensitizing 10 decreases MSN firing capacity in the NAc
cocaine treatment. shell, a mechanism that involves an increase
The figure, part b, shows how the firing in A-type K+ currents62 and that is consistent
5
pattern and action potential waveform can be with the regulatory role of A-type K+ cur-
dissected in several components (for example,
0 rents by αCaMKII63–65. Nonetheless, because
latency to spike after current injection; the 80 120 180 200 240 280
interspike interval (ISI); action potential
these targets were either exogenously
Input (pA)
threshold (Thr); fast and medium after-hyper- manipulated62 prior to cocaine exposure, or
polarization (fAHP and mAHP); and amplitude). b ISI indirectly assessed in ex vivo NAc shell slices
These components are shaped by a timed and after in vivo cocaine treatment28, they have
coordinated opening and closing of specific not been causally linked to cocaine-induced
voltage-gated ion channels (Na+, Ca2+ and K+). First spike plasticity of intrinsic excitability.
To generate hypotheses regarding which ion latency
A recent study identified an additional
channels or group of channels have changed candidate mechanism, showing that
following drug exposure, investigators quantify cocaine leads to firing rate depression of
the differences in spiking patterns and the
NAc shell MSNs through the activation
precise details of the action potential waveform
between drug and control conditions. Using
of sigma 1 receptor (SIG1R) following the
20 mV
this method, they have found, among other 200 ms same cocaine exposure regimen and in the
alterations, that cocaine exposure increases the absence of any prior exogenous manipula-
latency to the first spike and the ISI, which tion25. SIG1R is an endoplasmic reticulum
suggests that the activity of some members of (ER) chaperone protein66 that is known to
the Kv1 and SK (Ca2+-activated) K+ channel be associated with several neuropsychiat-
subfamilies is enhanced. As described in many ric disorders67–69, including addiction, and
Amplitude
Drug-seeking
firing capability was restored, the locomo-
behaviour
tor response to cocaine was similar to that
observed in drug-naive mice, suggesting Induced by:
that depressed firing capacity of NAc shell Time • Drug priming
neurons may predispose individuals to • Cue
Short access Long access • Context
express rewarding and psychomotor activat- • Stress
ing effects of cocaine62. Taken together, we Self-administered drug
speculate that a decrease in NAc shell intrin- b Experimenter-administered cocaine c Intrinsic factors (NAc shell)
sic excitability62 or an increase in NAc core (Psychomotor sensitization and short‐access
Acute Chronic
excitability75, two subsets of early cocaine- self‐administration)
injection administration
induced neuroadaptations26, recapitulate ↑ K+ channels (Kv1.2, SK, other K+ channel
early physiological and behavioural effects hyperpolarizing currents)
exhibited by mice after repeated exposure to Ca2+ channel
non-contingent cocaine injections. ↓ MSN
↓ N- and R-type voltage- excitability
Interestingly, in vivo electrophysiologi- Behavioural gated Ca2+ currents
cal studies in rats during or after chronic paradigms (depolarizing currents)
self-administration of cocaine parallel the • Conditioned
Na+ channel
place preference
ex vivo findings. However, this comparison • Psychomotor ↓ Voltage-sensitive Na+ currents
must be taken with caution because under sensitization (depolarizing currents)
in vivo conditions, firing can be either tonic
(constant) or phasic (in bursts), whereas in Figure 3 | Drug-exposure procedures and animal behaviouralNature modelsReviews
used to| Neuroscience
approximate
ex vivo studies firing is elicited by positive human addiction. a | The human addiction cycle is characterized by initial recreational drug use, fol-
current injections (see BOX 1); we also can- lowed in some individuals by a period of drug abuse (increased dose and/or frequency of drug intake).
not dissociate intrinsic from synaptic influ- A period of abstinence from drug use is often followed by a relapse to drug use or abuse; relapse can
ences on neuronal firing in in vivo studies. be triggered by several environmental factors. Animal models attempt to recapitulate these phases of
the human addiction cycle by first training animals to self-administer intravenous contingent cocaine
Nevertheless, striking similarities between
injections. Over a few days (short access) of this training, drug intake initially increases and then stabi-
in vivo and ex vivo studies encourage us lizes as animals learn the behavioural response required to self-administer the drug (the acquisition
to speculate. For example, during long- phase). Short-access procedures are thought to approximate voluntary recreational drug use. Long-
access (6 hours daily for 12–18 days prior access procedures involve extended periods of daily access to self-administrable cocaine, and drug
to recording) cocaine self-administration, intake in some individuals can escalate under these conditions (thought to approximate the beginnings
decreases in tonic firing are more preva- of the drug abuse stage in humans). The abstinence phase of human addiction is modelled in animals
lent in NAc shell than NAc core neurons, either by extinction (where the learnt behaviour no longer results in drug delivery) or forced abstinence
whereas increases in tonic firing are more without extinction (when the animals do not have access to cocaine), which can lead to incubation, a
common in NAc core than in NAc shell time-dependent increase in cue-induced drug seeking after abstinence. Reinstatement (resumption
neurons76. Furthermore, during a simi- of drug-seeking) induced either by a priming injection of cocaine itself, cocaine-associated cues,
cocaine-associated contexts, or stress can be used to model the impact of various environmental fac-
lar cocaine self-administration paradigm
tors on relapse to drug use. b | Animal models of cocaine-induced behavioural changes usually involve
(6 hours daily for 2–3 weeks prior to record- either an acute injection of the drug (used to study the acute locomotor-activating effects of cocaine),
ing), increases in the magnitude or incidence or repeated intraperitoneal cocaine injections (used to study the effects of chronic cocaine use). These
of phasic firing is greater in NAc core than approaches are often referred to as experimenter-administered or non-contingent to distinguish them
in shell neurons during presentation of a cue from voluntary self-administration. Two frequently used behavioural paradigms are conditioned place
that an animal has learned to associate with preference (whereby repeated cocaine administration is associated with a later preference for the
cocaine48,77 and when a cocaine-associated cocaine-paired environment) and psychomotor sensitization (whereby repeated intraperitoneal
cue is randomly presented after one month cocaine injections are associated with an incremental increase in the locomotor-activating effects of
of drug abstinence from short-access cocaine cocaine). c | Intrinsic factors that change following cocaine treatment. A non-contingent cocaine regi-
self-administration (2 hours per day for men that induces psychomotor sensitization in rats reduces depolarizing currents and increases hyper-
polarizing currents, resulting in a reduced excitability of medium spiny neurons (MSNs) in the nucleus
2–3 weeks)78,79. These cocaine-associated
accumbens (NAc). These changes result from alterations in various intrinsic excitability factors, such as
cues are used in animal models to better increases in hyperpolarizing K+ currents22, and decreases in both N- and R‑type Ca2+ currents28 and
understand the physiological correlates of depolarizing basal Na+ conductance (INa)29. Recent studies have identified key K+ conductances, includ-
cue-driven cocaine seeking that have also ing a transient voltage-gated K+ current (slowly inactivating As current), which is now known to be
been observed in humans80. Ex vivo obser- mediated by Kv1.2 subunits25, and the small conductance Ca2+-activated K+ currents (SK currents)23,
vations of reduced NAc shell excitability which has also been shown to be upregulated following cocaine self-administration27.
in contrast to the NAc shell, does mediate these two factors of excitability is unlikely. intrinsic excitability interact to shape final
some behavioural effects of cocaine, such However, this does not exclude the possibility NAc MSN output, as well as its consequences
as the incentive motivational properties of that these two neuroadaptations are sequen- on neural circuit activity and thereby on
cocaine115 and susceptibility to relapse104. tially related; the delayed synaptic potentia- cocaine-seeking behaviour. An area that has
tion may be a consequence of the transient received little attention is the identification of
Signal-to‑noise ratio hypothesis. How can firing potentiation. An idea that originates mood states that are associated with increased
opposite adaptations in the NAc shell, an from learning and memory research pro- synaptic or decreased intrinsic excitability in
increased synaptic102 and a decreased intrin- poses that increases in intrinsic excitability the NAc. More specifically, if the decreased
sic excitability25,62 all lead to enhanced psy- may provide a permissive function for syn- firing capacity of the NAc shell predisposes
chomotor sensitization to cocaine? Kalivas aptic potentiation to develop, which may individuals to a positive drug experience62,125,
and Hu116 posited a theory that may reconcile be one possible mechanism that underlies then what are the mood states associated
this apparent paradox, whereby decreased the memory trace. For example, rabbits with NAc firing rate depression? Is the early
intrinsic excitability may act as a noise filter subjected to eyeblink conditioning exhibited and rapidly appearing decrease in NAc shell
that allows only strong and behaviourally enhanced hippocampal intrinsic excitability intrinsic excitability an electrophysiological
relevant synaptic inputs, which represent that was evidenced by a decreased spike after marker of withdrawal? Indeed, the negative
the signal, to reach action potential thresh- hyperpolarization (mostly mediated by SK symptoms associated with drug withdrawal
old and activate the neuron, enhancing the current). This increased intrinsic excitability will promote addicted individuals to engage
signal-to‑noise ratio (FIG. 4b). This theory was appeared before eyeblink conditioning was in drug-seeking and drug-taking behav-
originally proposed to explain data obtained acquired and was no longer present when the iours to relieve these symptoms126. Are these
in the NAc core, as it assumes that cocaine rabbits, still showing a strong memory, were unidentified drug-induced emotional states
also decreases firing in NAc core neurons. tested a few weeks later119–122. The authors a factor of vulnerability to relapse in drug
Although firing in NAc core neurons of this study suggested that increased hip- addicts? As mentioned at the beginning of
was later shown to be transiently potenti- pocampal intrinsic excitability was not a part this Opinion article, pre-existing biological
ated26 instead of persistently depressed23,24,26, of the engram (that is, the memory trace), conditions (for example, epigenetic varia-
the theory is still appealing and has a great but may have provided a permissive function tions) may also contribute to the development
explanatory power for both NAc core and for the memory trace to be formed. We spec- of addictive disorders in some individuals. So,
shell cocaine-induced neuroadaptations. ulate that NAc core hyperexcitability may it is possible that there are epigenetic varia-
Regarding NAc core neurons, after a period predispose the neural network to generate tions in NAc excitability (for example, owing
of withdrawal (>10 days), potentiated intrin- long-term neuronal changes, such as delayed to innate or developmentally acquired dif-
sic excitability returned to basal levels26, synaptic potentiation123. ferential expression of specific ion channels)
whereas synaptic transmission increased5–7, The permissive function hypothesis that render some individuals predisposed to
which together suggest an increased signal- suggests that although both the NAc shell experience enhanced rewarding properties
to‑noise ratio in this region. Regarding and the NAc core develop a similar delayed of the drug and make them prone to develop
NAc shell neurons, after a similar period of synaptic potentiation, they may be differ- cocaine addiction.
withdrawal, intrinsic excitability remained entially induced and can facilitate different Moreover, as discussed earlier, synaptic and
depressed23,24,26, whereas synaptic transmission physiological and behavioural functions. intrinsic excitability are constantly working
increased5–7,97–99, which together also support This idea is consistent with the fact that the in concert to shape global neuronal activity
an enhanced signal-to‑noise ratio. Increased NAc shell and core have different roles in to control information transmission within
signal-to‑noise ratio may predispose MSNs behaviour directed towards natural and drug the nervous system. There is currently a
to fire only in highly salient situations. For reward seeking36–45. Synaptic potentiation strong focus on understanding how manipu-
example, this could favour stronger inputs may encode highly salient rewards in the lating synaptic factors affects reward-related
(from the hippocampus100,101, prefrontal cor- NAc shell, and the motor programme needed behaviours at various stages of the addic-
tex100,102–104 and amygdala117) that may increase to obtain those rewards in the NAc core. Sup- tion cycle (FIG. 3a). One must extend these
the response to cocaine-associated cues to port for this idea comes from neuroanatomi- experimental manipulations to discrete
readily trigger action potentials in NAc neu- cal studies suggesting that the NAc shell can intrinsic excitability factors (for example, K+
rons and initiate cocaine-seeking behaviours. influence the behavioural output of the NAc channels), to draw a more accurate picture
This idea is consistent with AMPAR-mediated core51,124. Increased synaptic strength in the of the functional relationships that may
incubation of cue-induced cocaine craving118. NAc shell may be ideally positioned to allow exist between intrinsic membrane proper-
highly salient drug-associated cues to further ties, neural network activity and, ultimately,
Permissive function hypothesis. In con- amplify the NAc core behavioural output. behavioural phenotypes. Old and recent
trast to what is seen in NAc shell neurons, data from learning and memory research
passive repeated non-contingent cocaine Challenges and future perspectives support this idea. In particular, learning and
injections induce an early and transient fir- Cocaine experience affects both intrinsic drug addiction processes seem to share many
ing potentiation in core NAc MSNs that and synaptic NAc MSN excitability. One of common molecular mechanisms127. A newly
quickly dissipates (measured 1–3 days after the challenges for the field is to demonstrate identified potentially common mechanism
the last cocaine injection)26. Another study a causal role for any given drug-induced may be the participation of specific K+ cur-
showed that during a period of abstinence neuronal excitability mechanism for driv- rents in both learning119,122,128 and addic-
from cocaine self-administration, a synaptic ing specific cocaine-associated behaviours tion, as discussed here. Regarding learning
potentiation slowly develops in the NAc that are related to drug addiction in humans. mechanisms, pharmacological blockade and
core118 (FIG. 4b). Therefore, an intrinsic- Another challenge is to understand how genetic knock-down of specific K+ chan-
to‑synaptic homeostatic relationship between drug-induced changes in synaptic and nel subtypes, presumably altering different
firing characteristics, have been shown to experimenter-controlled native K+ channels Considering the well-established role of
differentially modulate learning and memory are self-explanatory: these are non-foreign the NAc core and shell in natural and drug
performance in both memory-type- and proteins that are not likely to trigger com- reward seeking36–46, as well as mounting evi-
stage-specific manners129–132, some of which pensatory mechanisms, which are usually dence suggesting that cocaine exposure alters
exhibit direct correlation between learning observed in classic genetic knock‑in or the landscape of information encoding in
capabilities and K+ channel functions, protein knockout models147–150. A next step would these regions48,76–79,85,176–179, there would be tre-
or transcript expression119–121,133,134. Therefore, be to make highly specific photochemical mendous utility in pursuing a neurocomputa-
it would be plausible to relate specific K+ con- ligands or neuron-specific photoswitchable tional approach that bridges the gap between
ductances with the development or expres- channel subtypes that have the same bio- NAc neuroadaptations observed after drug
sion of specific aspects of addiction-related physical properties and trafficking patterns exposure and NAc-dependent drug-seeking
behaviours, or perhaps with stages of the as the target channels. Reaching such molec- behaviours.
addiction cycle. ular specificity and such a degree of regional Altogether, the development of neuro-
More insights into addiction behaviour and temporal control will allow us to finely computational models, in parallel with the
may be obtained using newly developed tune particular aspects of neuronal excitabil- in vivo manipulation of cell-specific photo-
techniques and computational models. One ity, and thus to reprogramme the activity of switchable target channels, could significantly
such example is optogenetics, which allows specific neural networks in real-time as we advance our understanding of how drug-
researchers to manipulate neural activ- assess changes in behaviour. induced changes in specific intrinsic factors
ity in a temporally precise and relatively The mechanism by which NAc intrin- shape neuronal activity and circuit dynamics,
cell-specific manner, and can be used to sic excitability alters behavioural output and how they lead to the behavioural adapta-
demonstrate a causal link between neuronal remains an open question. As discussed tions that characterize drug addiction. These
activity at the circuit level and behavioural previously, there is a high diversity of K+ theoretical and technological advancements
responses that are relevant to addiction and channels, heterogeneously expressed across may also contribute to the understanding of
other psychiatric disorders, such as depres- different subcellular compartments within the functional relationships between altera-
sion135,136. However, the specificity of infor- neurons137,151,152. However, it remains unclear tions in a given ion channel and neuronal
mation transmitted within neural circuits how changes in specific types of K+ channels, dysfunctions that are associated with a num-
arises from a finely tuned firing frequency- within specific subcellular compartments, ber of psychiatric and neurological disorders
modulated code, a mechanism that is made might differentially shape the complex fea- (channelopathies).
possible by the well-orchestrated activation tures of neuronal excitability (for example,
and inactivation of specific K+ channels15. action potential threshold, spike waveforms Saïd Kourrich is at the Department of Psychiatry, The
University of Texas Southwestern Medical Center,
Moreover, the high diversity of K+ chan- and frequency adaptation), which ultimately
Dallas, Texas 75390–9011, USA.
nels, which are heterogeneously distributed shape the specificity of the information
Donna J. Calu and Antonello Bonci are at the National
throughout both the neuron137 and the communicated to downstream targets.
Institute on Drug Abuse, Intramural Research Program,
brain, will also strongly affect spatial and Neurocomputational models that predict Baltimore, Maryland 21224, USA.
temporal intracellular Ca2+ dynamics, and how upregulation or downregulation of a
Antonello Bonci is also at the Solomon H. Snyder
therefore neuronal signalling and plasticity138. particular type of K+ channel within a given Neuroscience Institute, Johns Hopkins University
In contrast to the fine-tuning of neuronal subcellular compartment would impact neu- School of Medicine, Baltimore, Maryland 21205, USA.
excitability provided by K+ channels, optoge- ronal excitability have tremendous power, Correspondence to S.K. and A.B:
netic manipulations uniformly increase or as they provide insights into unanswered e-mails: Said.Kourrich@UTSouthwestern.edu;
decrease neuronal firing through the expres- questions about how the neuron works, how antonello.bonci@nih.gov
sion of exogenous light-activated proteins. it shapes information and how it conveys the doi:10.1038/nrn3877
This could result in a loss of information information to downstream targets. Such
1. Piazza, P. V. & Deroche-Gamonet, V. A multistep
specificity that may be encoded by a com- computational models of NAc MSNs have general theory of transition to addiction.
bination of various K+ channel-dependent emerged153–156, and the development of more Psychopharmacol. (Berl.) 229, 387–413 (2013).
2. White, N. M. Addictive drugs as reinforcers: multiple
neuronal excitability features (for example, comprehensive computational models that partial actions on memory systems. Addiction 91,
action potential threshold, spike waveforms include a broader representation of existing 921–949; discussion 951–965 (1996).
3. Siegel, S. Drug anticipation and the treatment of
and frequency adaptation) and their effects conductances within NAc MSNs will further dependence. NIDA Res. Monogr. 84, 1–24 (1988).
on dynamics of cellular Ca2+ signalling. enhance our understanding of how subcellu- 4. Robbins, T. W. & Everitt, B. J. Limbic-striatal memory
systems and drug addiction. Neurobiol. Learn. Mem.
Conferring molecular specificity to lar- and cellular-level alterations in ion chan- 78, 625–636 (2002).
optogenetic techniques may help to over- nel make‑up can affect the complex features 5. Luscher, C. & Malenka, R. C. Drug-evoked synaptic
plasticity in addiction: from molecular changes to
come this issue, providing causal links of neuronal excitability. circuit remodeling. Neuron 69, 650–663 (2011).
between specific native ion channel func- A critical next step would be to under- 6. Wolf, M. E. The Bermuda Triangle of cocaine-induced
neuroadaptations. Trends Neurosci. 33, 391–398
tions and behaviour. Efforts to develop stand how cocaine-induced changes in NAc (2010).
and use photoswitchable molecules that neuronal excitability may drive drug-seeking 7. Wolf, M. E. & Tseng, K. Y. Calcium-permeable AMPA
receptors in the VTA and nucleus accumbens after
modulate gating of relatively specific behaviour. One possibility is to integrate the cocaine exposure: when, how, and why? Frontiers Mol.
indigenous K+ channels with light are cur- resulting excitability changes from the cellu- Neurosci. 5, 72 (2012).
8. White, F. J. & Kalivas, P. W. Neuroadaptations involved
rently underway139–146. This method con- lar-level model proposed above, into existing in amphetamine and cocaine addiction. Drug Alcohol
sists of either manipulating K+ channels associative learning157, reinforcement learning Depend. 51, 141–153 (1998).
9. Wolf, M. E. The role of excitatory amino acids in
with specific light-controlled ligands142 or and striatal-based actor-critic neurocompu- behavioral sensitization to psychomotor stimulants.
expressing engineered photoswitch-ready tational models158–162 that generate direct and Prog. Neurobiol. 54, 679–720 (1998).
10. Lomazzi, M., Slesinger, P. A. & Luscher, C. Addictive drugs
channels with built‑in pharmacologi- testable predictions for natural163–168 and drug- modulate GIRK-channel signaling by regulating RGS
cal specificity139. The advantages of using reward learning and seeking behaviours169–175. proteins. Trends Pharmacol. Sci. 29, 544–549 (2008).
11. Padgett, C. L. et al. Methamphetamine-evoked 36. Hall, J., Parkinson, J. A., Connor, T. M., Dickinson, A. & 56. Clarkson, C. W., Xu, Y. Q., Chang, C. & Follmer, C. H.
depression of GABAB receptor signaling in GABA Everitt, B. J. Involvement of the central nucleus of the Analysis of the ionic basis for cocaine’s biphasic
neurons of the VTA. Neuron 73, 978–989 (2012). amygdala and nucleus accumbens core in mediating effect on action potential duration in guinea-pig
12. Hearing, M. et al. Repeated cocaine weakens GABAB– Pavlovian influences on instrumental behaviour. Eur. ventricular myocytes. J. Mol. Cell. Cardiol. 28,
Girk signaling in layer 5/6 pyramidal neurons in the J. Neurosci. 13, 1984–1992 (2001). 667–678 (1996).
prelimbic cortex. Neuron 80, 159–170 (2013). 37. Parkinson, J. A., Olmstead, M. C., Burns, L. H., 57. Kimura, S., Bassett, A. L., Xi, H. & Myerburg, R. J.
13. Hearing, M. C., Zink, A. N. & Wickman, K. Cocaine- Robbins, T. W. & Everitt, B. J. Dissociation in effects of Early afterdepolarizations and triggered activity
induced adaptations in metabotropic inhibitory lesions of the nucleus accumbens core and shell on induced by cocaine. A possible mechanism of cocaine
signaling in the mesocorticolimbic system. Rev. appetitive pavlovian approach behavior and the arrhythmogenesis. Circulation 85, 2227–2235
Neurosci. 23, 325–351 (2012). potentiation of conditioned reinforcement and (1992).
14. Luscher, C. & Slesinger, P. A. Emerging roles for G locomotor activity by D‑amphetamine. J. Neurosci. 19, 58. Pettit, H. O., Pan, H. T., Parsons, L. H. &
protein-gated inwardly rectifying potassium (GIRK) 2401–2411 (1999). Justice, J. B. Jr. Extracellular concentrations of cocaine
channels in health and disease. Nature Rev. Neurosci. 38. Corbit, L. H., Muir, J. L. & Balleine, B. W. The role of and dopamine are enhanced during chronic cocaine
11, 301–315 (2010). the nucleus accumbens in instrumental conditioning: administration. J. Neurochem. 55, 798–804 (1990).
15. Hille, B. Ionic Channels of Excitable Membranes 3rd Evidence of a functional dissociation between 59. Badiani, A., Belin, D., Epstein, D., Calu, D. &
edn (Sinauer Associates, 2001). accumbens core and shell. J. Neurosci. 21, Shaham, Y. Opiate versus psychostimulant addiction:
16. Roberts, E. GABAergic malfunction in the limbic 3251–3260 (2001). the differences do matter. Nature Rev. Neurosci. 12,
system resulting from an aboriginal genetic defect in 39. Parkinson, J. A., Willoughby, P. J., Robbins, T. W. & 685–700 (2011).
voltage-gated Na+-channel SCN5A is proposed to give Everitt, B. J. Disconnection of the anterior cingulate 60. Uslaner, J. et al. Amphetamine and cocaine induce
rise to susceptibility to schizophrenia. Adv. Pharmacol. cortex and nucleus accumbens core impairs Pavlovian different patterns of c‑fos mRNA expression in the
54, 119–145 (2006). approach behavior: further evidence for limbic cortical- striatum and subthalamic nucleus depending on
17. Zou, X., Coyle, D., Wong-Lin, K. & Maguire, L. ventral striatopallidal systems. Behav. Neurosci. 114, environmental context. Eur. J. Neurosci. 13,
β-amyloid induced changes in A‑type K+ current can 42–63 (2000). 1977–1983 (2001).
alter hippocampo–septal network dynamics. 40. Floresco, S. B., McLaughlin, R. J. & Haluk, D. M. 61. Di Chiara, G. & Imperato, A. Drugs abused by humans
J. Computat. Neurosci. 32, 465–477 (2012). Opposing roles for the nucleus accumbens core and preferentially increase synaptic dopamine
18. Krishnan, V. et al. Molecular adaptations underlying shell in cue-induced reinstatement of food-seeking concentrations in the mesolimbic system of freely
susceptibility and resistance to social defeat in brain behavior. Neuroscience 154, 877–884 (2008). moving rats. Proc. Natl Acad. Sci. USA 85,
reward regions. Cell 131, 391–404 (2007). 41. Ambroggi, F., Ghazizadeh, A., Nicola, S. M. & 5274–5278 (1988).
19. Zhao, X. et al. A long noncoding RNA contributes to Fields, H. L. Roles of nucleus accumbens core and shell 62. Kourrich, S., Klug, J. R., Mayford, M. & Thomas, M. J.
neuropathic pain by silencing Kcna2 in primary in incentive-cue responding and behavioral inhibition. AMPAR-independent effect of striatal αCaMKII
afferent neurons. Nature Neurosci. 16, 1024–1031 J. Neurosci. 31, 6820–6830 (2011). promotes the sensitization of cocaine reward. J.
(2013). 42. McFarland, K. & Kalivas, P. W. The circuitry mediating Neurosci. 32, 6578–6586 (2012).
20. Beck, H. & Yaari, Y. Plasticity of intrinsic neuronal cocaine-induced reinstatement of drug-seeking 63. Sergeant, G. P. et al. Regulation of Kv4.3 currents by
properties in CNS disorders. Nature Rev. Neurosci. 9, behavior. J. Neurosci. 21, 8655–8663 (2001). Ca2+/calmodulin-dependent protein kinase II. Am.
357–369 (2008). 43. Ito, R., Robbins, T. W. & Everitt, B. J. Differential J. Physiol. Cell Physiol. 288, C304–C313 (2005).
21. Dong, Y. et al. CREB modulates excitability of nucleus control over cocaine-seeking behavior by nucleus 64. Varga, A. W. et al. Calcium-calmodulin-dependent
accumbens neurons. Nature Neurosci. 9, 475–477 accumbens core and shell. Nature Neurosci. 7, kinase II modulates K‑4.2 channel expression and
(2006). 389–397 (2004). upregulates neuronal A‑type potassium currents.
22. Hu, X. T., Basu, S. & White, F. J. Repeated cocaine 44. Fuchs, R. A., Evans, K. A., Parker, M. C. & See, R. E. J. Neurosci. 24, 3643–3654 (2004).
administration suppresses HVA–Ca2+ potentials and Differential involvement of the core and shell 65. Yao, W. D. & Wu, C. F. Distinct roles of CaMKII and
enhances activity of K+ channels in rat nucleus accumbens subregions of the nucleus accumbens in conditioned PKA in regulation of firing patterns and K+ currents in
neurons. J. Neurophysiol. 92, 1597–1607 (2004). cue-induced reinstatement of cocaine seeking in rats. Drosophila neurons. J. Neurophysiol. 85, 1384–1394
23. Ishikawa, M. et al. Homeostatic synapse-driven Psychopharmacol. (Berl.) 176, 459–465 (2004). (2001).
membrane plasticity in nucleus accumbens neurons. 45. Di Ciano, P., Robbins, T. W. & Everitt, B. J. Differential 66. Hayashi, T. & Su, T. P. σ1 receptor chaperones at the
J. Neurosci. 29, 5820–5831 (2009). effects of nucleus accumbens core, shell, or dorsal ER‑mitochondrion interface regulate Ca2+ signaling
24. Kim, J., Park, B. H., Lee, J. H., Park, S. K. & Kim, J. H. striatal inactivations on the persistence, reacquisition, and cell survival. Cell 131, 596–610 (2007).
Cell type-specific alterations in the nucleus accumbens or reinstatement of responding for a drug-paired 67. Hayashi, T. & Su, T. P. σ1 receptor ligands: potential in
by repeated exposures to cocaine. Biol. Psychiatry 69, conditioned reinforcer. Neuropsychopharmacology the treatment of neuropsychiatric disorders. CNS
1026–1034 (2011). 33, 1413–1425 (2008). Drugs 18, 269–284 (2004).
25. Kourrich, S. et al. Dynamic interaction between σ1 46. Bossert, J. M., Poles, G. C., Wihbey, K. A., Koya, E. & 68. Kourrich, S., Su, T. P., Fujimoto, M. & Bonci, A. The σ1
receptor and Kv1.2 shapes neuronal and behavioral Shaham, Y. Differential effects of blockade of dopamine receptor: roles in neuronal plasticity and disease.
responses to cocaine. Cell 152, 236–247 (2013). D1‑family receptors in nucleus accumbens core or shell Trends Neurosci. 35, 762–771 (2012).
26. Kourrich, S. & Thomas, M. J. Similar neurons, opposite on reinstatement of heroin seeking induced by 69. Maurice, T. & Su, T. P. The pharmacology of σ1
adaptations: psychostimulant experience differentially contextual and discrete cues. J. Neurosci. 27, receptors. Pharmacol. Ther. 124, 195–206 (2009).
alters firing properties in accumbens core versus shell. 12655–12663 (2007). 70. Hayashi, T. & Su, T. P. Intracellular dynamics of σ1
J. Neurosci. 29, 12275–12283 (2009). 47. Zahm, D. S. & Brog, J. S. On the significance of receptors (σ1 binding sites) in NG108‑15 cells.
27. Mu, P. et al. Exposure to cocaine dynamically regulates subterritories in the “accumbens” part of the rat J. Pharmacol. Exp. Ther. 306, 726–733 (2003).
the intrinsic membrane excitability of nucleus ventral striatum. Neuroscience 50, 751–767 (1992). 71. Su, T. P., Hayashi, T., Maurice, T., Buch, S. &
accumbens neurons. J. Neurosci. 30, 3689–3699 48. Ghitza, U. E., Fabbricatore, A. T., Prokopenko, V. F. & Ruoho, A. E. The σ1 receptor chaperone as an inter-
(2010). West, M. O. Differences between accumbens core and organelle signaling modulator. Trends Pharmacol. Sci.
28. Zhang, X. F., Cooper, D. C. & White, F. J. Repeated shell neurons exhibiting phasic firing patterns related to 31, 557–566 (2010).
cocaine treatment decreases whole-cell calcium drug-seeking behavior during a discriminative-stimulus 72. Chen, Y., Hajipour, A. R., Sievert, M. K., Arbabian, M.
current in rat nucleus accumbens neurons. task. J. Neurophysiol. 92, 1608–1614 (2004). & Ruoho, A. E. Characterization of the cocaine binding
J. Pharmacol. Exp. Ther. 301, 1119–1125 (2002). 49. Stratford, T. R., Swanson, C. J. & Kelley, A. Specific site on the σ1 receptor. Biochemistry 46, 3532–3542
29. Zhang, X. F., Hu, X. T. & White, F. J. Whole-cell changes in food intake elicited by blockade or (2007).
plasticity in cocaine withdrawal: reduced sodium activation of glutamate receptors in the nucleus 73. Kahoun, J. R. & Ruoho, A. E. (125I)iodoazidococaine, a
currents in nucleus accumbens neurons. J. Neurosci. accumbens shell. Behav. Brain Res. 93, 43–50 photoaffinity label for the haloperidol-sensitive σ
18, 488–498 (1998). (1998). receptor. Proc. Natl Acad. Sci. USA 89, 1393–1397
30. Robinson, T. E. & Berridge, K. C. Review. The 50. Krause, M., German, P. W., Taha, S. A. & Fields, H. L. A (1992).
incentive sensitization theory of addiction: some pause in nucleus accumbens neuron firing is required 74. Paradis, S., Sweeney, S. T. & Davis, G. W. Homeostatic
current issues. Phil. Trans. R. Soc. Lond. B 363, to initiate and maintain feeding. J. Neurosci. 30, control of presynaptic release is triggered by
3137–3146 (2008). 4746–4756 (2010). postsynaptic membrane depolarization. Neuron 30,
31. Wise, R. A. & Bozarth, M. A. A psychomotor stimulant 51. Zahm, D. S. An integrative neuroanatomical 737–749 (2001).
theory of addiction. Psychol. Rev. 94, 469–492 perspective on some subcortical substrates of adaptive 75. Benavides, D. R. et al. Cdk5 modulates cocaine
(1987). responding with emphasis on the nucleus accumbens. reward, motivation, and striatal neuron excitability.
32. Roberts, D. C., Koob, G. F., Klonoff, P. & Fibiger, H. C. Neurosci. Biobehav. Rev. 24, 85–105 (2000). J. Neurosci. 27, 12967–12976 (2007).
Extinction and recovery of cocaine self-administration 52. Witten, I. B. et al. Cholinergic interneurons control 76. Fabbricatore, A. T., Ghitza, U. E., Prokopenko, V. F. &
following 6‑hydroxydopamine lesions of the nucleus local circuit activity and cocaine conditioning. Science West, M. O. Electrophysiological evidence of
accumbens. Pharmacol. Biochem. Behav. 12, 330, 1677–1681 (2010). mediolateral functional dichotomy in the rat
781–787 (1980). 53. Khodorov, B. I., Vornovitskii, E. G., Ignat’eva, V. B., accumbens during cocaine self-administration: tonic
33. Bossert, J. M., Marchant, N. J., Calu, D. J. & Mukumov, M. R. & Kitaigorodskaia, G. M. Mechanism firing patterns. Eur. J. Neurosci. 30, 2387–2400
Shaham, Y. The reinstatement model of drug relapse: of excitation and contraction uncoupling in frog and (2009).
recent neurobiological findings, emerging research guinea pig myocardial fibers during block of slow 77. Ghitza, U. E., Prokopenko, V. F., West, M. O. &
topics, and translational research. sodium-calcium channels by compound D-600. Fabbricatore, A. T. Higher magnitude accumbal phasic
Psychopharmacology (Berl.) 229, 453–476 (2013). Biofizika 21, 1024–1030 (in Russian) (1976). firing changes among core neurons exhibiting tonic
34. Stewart, J. Pathways to relapse: factors controlling the 54. Weidmann, S. Effects of calcium ions and local firing increases during cocaine self-administration.
reinitiation of drug seeking after abstinence. Nebr anesthetics on electrical properties of Purkinje fibres. Neuroscience 137, 1075–1085 (2006).
Symp. Motiv. 50, 197–234 (2004). J. Physiol. 129, 568–582 (1955). 78. Hollander, J. A. & Carelli, R. M. Abstinence from
35. Stewart, J. Review. Psychological and neural 55. Crumb, W. J. Jr & Clarkson, C. W. Characterization of cocaine self-administration heightens neural encoding
mechanisms of relapse. Phil. Trans. R. Soc. B 363, cocaine-induced block of cardiac sodium channels. of goal-directed behaviors in the accumbens.
3147–3158 (2008). Biophys. J. 57, 589–599 (1990). Neuropsychopharmacology 30, 1464–1474 (2005).
79. Hollander, J. A. & Carelli, R. M. Cocaine-associated 101. Britt, J. P. et al. Synaptic and behavioral profile of 126. Wikler, A. Dynamics of drug dependence. Implications
stimuli increase cocaine seeking and activate multiple glutamatergic inputs to the nucleus of a conditioning theory for research and treatment.
accumbens core neurons after abstinence. J. Neurosci. accumbens. Neuron 76, 790–803 (2012). Arch. General Psychiatry 28, 611–616 (1973).
27, 3535–3539 (2007). 102. Pascoli, V., Turiault, M. & Luscher, C. Reversal of cocaine- 127. Nestler, E. J. Common molecular and cellular
80. O’Brien, C. P., Childress, A. R., McLellan, A. T. & evoked synaptic potentiation resets drug-induced substrates of addiction and memory. Neurobiol. Learn.
Ehrman, R. Classical conditioning in drug-dependent adaptive behaviour. Nature 481, 71–75 (2012). Mem. 78, 637–647 (2002).
humans. Ann. NY Acad. Sci. 654, 400–415 (1992). 103. Suska, A., Lee, B. R., Huang, Y. H., Dong, Y. & 128. Gasque, G., Labarca, P., Delgado, R. & Darszon, A.
81. Peoples, L. L., Uzwiak, A. J., Guyette, F. X. & Schluter, O. M. Selective presynaptic enhancement of Bridging behavior and physiology: ion-channel
West, M. O. Tonic inhibition of single nucleus the prefrontal cortex to nucleus accumbens pathway perspective on mushroom body-dependent olfactory
accumbens neurons in the rat: a predominant but not by cocaine. Proc. Natl Acad. Sci. USA 110, 713–718 learning and memory in Drosophila. J. Cell. Physiol.
exclusive firing pattern induced by cocaine self- (2013). 209, 1046–1053 (2006).
administration sessions. Neuroscience 86, 13–22 104. Ma, Y. Y. et al. Bidirectional modulation of incubation 129. Deschaux, O. & Bizot, J. C. Effect of apamin, a
(1998). of cocaine craving by silent synapse-based remodeling selective blocker of Ca2+-activated K+-channel, on
82. Peoples, L. L., Uzwiak, A. J., Gee, F. & West, M. O. of prefrontal cortex to accumbens projections. Neuron habituation and passive avoidance responses in rats.
Tonic firing of rat nucleus accumbens neurons: changes 83, 1453–1467 (2014). Neurosci. Lett. 227, 57–60 (1997).
during the first 2 weeks of daily cocaine self- 105. Turrigiano, G. Homeostatic synaptic plasticity: local and 130. Deschaux, O. & Bizot, J. C. Apamin produces selective
administration sessions. Brain Res. 822, 231–236 global mechanisms for stabilizing neuronal function. improvements of learning in rats. Neurosci. Lett. 386,
(1999). Cold Spring Harb. Perspect. Biol. 4, a005736 (2012). 5–8 (2005).
83. Peoples, L. L. & Cavanaugh, D. Differential changes in 106. Ibata, K., Sun, Q. & Turrigiano, G. G. Rapid synaptic 131. Fournier, C., Kourrich, S., Soumireu-Mourat, B. &
signal and background firing of accumbal neurons scaling induced by changes in postsynaptic firing. Mourre, C. Apamin improves reference memory but not
during cocaine self-administration. J. Neurophysiol. Neuron 57, 819–826 (2008). procedural memory in rats by blocking small conductance
90, 993–1010 (2003). 107. Keck, T. et al. Synaptic scaling and homeostatic Ca2+-activated K+ channels in an olfactory discrimination
84. Peoples, L. L., Kravitz, A. V. & Guillem, K. The role of plasticity in the mouse visual cortex in vivo. Neuron task. Behav. Brain Res. 121, 81–93 (2001).
accumbal hypoactivity in cocaine addiction. 80, 327–334 (2013). 132. Kourrich, S., Mourre, C. & Soumireu-Mourat, B.
ScientificWorldJournal 7, 22–45 (2007). 108. Bachtell, R. K. et al. Role of GluR1 expression in Kaliotoxin, a Kv1.1 and Kv1.3 channel blocker,
85. Guillem, K., Ahmed, S. H. & Peoples, L. L. Escalation of nucleus accumbens neurons in cocaine sensitization improves associative learning in rats. Behav. Brain Res.
cocaine intake and incubation of cocaine seeking are and cocaine-seeking behavior. Eur. J. Neurosci. 27, 120, 35–46 (2001).
correlated with dissociable neuronal processes in 2229–2240 (2008). 133. Kourrich, S., Manrique, C., Salin, P. & Mourre, C.
different accumbens subregions. Biol. Psychiatry 76, 109. Kelz, M. B. et al. Expression of the transcription factor Transient hippocampal down-regulation of Kv1.1
31–39 (2013). δFosB in the brain controls sensitivity to cocaine. subunit mRNA during associative learning in rats.
86. Grimm, J. W., Hope, B. T., Wise, R. A. & Shaham, Y. Nature 401, 272–276 (1999). Learn. Mem. 12, 511–519 (2005).
Neuroadaptation. Incubation of cocaine craving after 110. Anderson, S. M. et al. CaMKII: a biochemical bridge 134. Kourrich, S., Masmejean, F., Martin-Eauclaire, M. F.,
withdrawal. Nature 412, 141–142 (2001). linking accumbens dopamine and glutamate systems Soumireu-Mourat, B. & Mourre, C. Inwardly rectifying
87. Otaka, M. et al. Exposure to cocaine regulates in cocaine seeking. Nature Neurosci. 11, 344–353 Kir3.1 subunit knockdown impairs learning and
inhibitory synaptic transmission in the nucleus (2008). memory in an olfactory associative task in rat. Brain
accumbens. J. Neurosci. 33, 6753–6758 (2013). 111. Pierce, R. C., Bell, K., Duffy, P. & Kalivas, P. W. Res. Mol. Brain Res. 113, 97–106 (2003).
88. Basso, A. M. & Kelley, A. E. Feeding induced by GABAA Repeated cocaine augments excitatory amino acid 135. Chaudhury, D. et al. Rapid regulation of depression-
receptor stimulation within the nucleus accumbens transmission in the nucleus accumbens only in rats related behaviours by control of midbrain dopamine
shell: regional mapping and characterization of having developed behavioral sensitization. J. Neurosci. neurons. Nature 493, 532–536 (2013).
macronutrient and taste preference. Behav. Neurosci. 16, 1550–1560 (1996). 136. Tye, K. M. et al. Dopamine neurons modulate neural
113, 324–336 (1999). 112. Bachtell, R. K. & Self, D. W. Renewed cocaine exposure encoding and expression of depression-related
89. Maldonado-Irizarry, C. S., Swanson, C. J. & Kelley, A. E. produces transient alterations in nucleus accumbens behaviour. Nature 493, 537–541 (2013).
Glutamate receptors in the nucleus accumbens shell AMPA receptor-mediated behavior. J. Neurosci. 28, 137. Nusser, Z. Variability in the subcellular distribution of
control feeding behavior via the lateral hypothalamus. 12808–12814 (2008). ion channels increases neuronal diversity. Trends
J. Neurosci. 15, 6779–6788 (1995). 113. Ferrario, C. R. et al. The role of glutamate receptor Neurosci. 32, 267–274 (2009).
90. Reynolds, S. M. & Berridge, K. C. Fear and feeding in redistribution in locomotor sensitization to cocaine. 138. Grienberger, C. & Konnerth, A. Imaging calcium in
the nucleus accumbens shell: rostrocaudal segregation Neuropsychopharmacology 35, 818–833 (2010). neurons. Neuron 73, 862–885 (2012).
of GABA-elicited defensive behavior versus eating 114. Sutton, M. A. et al. Extinction-induced upregulation in 139. Fortin, D. L., Dunn, T. W. & Kramer, R. H. Engineering
behavior. J. Neurosci. 21, 3261–3270 (2001). AMPA receptors reduces cocaine-seeking behaviour. light-regulated ion channels. Cold Spring Harbor
91. Stratford, T. R. & Kelley, A. E. GABA in the nucleus Nature 421, 70–75 (2003). Protoc. 2011, 579–585 (2011).
accumbens shell participates in the central regulation 115. Wang, X. et al. Kalirin‑7 mediates cocaine-induced 140. Fortin, D. L. et al. Optogenetic photochemical control
of feeding behavior. J. Neurosci. 17, 4434–4440 AMPA receptor and spine plasticity, enabling incentive of designer K+ channels in mammalian neurons.
(1997). sensitization. J. Neurosci. 33, 11012–11022 (2013). J. Neurophysiol. 106, 488–496 (2011).
92. Stratford, T. R. & Kelley, A. E. Evidence of a functional 116. Kalivas, P. W. & Hu, X. T. Exciting inhibition in 141. Chambers, J. J., Banghart, M. R., Trauner, D. &
relationship between the nucleus accumbens shell psychostimulant addiction. Trends Neurosci. 29, Kramer, R. H. Light-induced depolarization of neurons
and lateral hypothalamus subserving the control of 610–616 (2006). using a modified Shaker K+ channel and a molecular
feeding behavior. J. Neurosci. 19, 11040–11048 117. Lee, B. R. et al. Maturation of silent synapses in photoswitch. J. Neurophysiol. 96, 2792–2796 (2006).
(1999). amygdala-accumbens projection contributes to 142. Fortin, D. L. et al. Photochemical control of
93. Kelley, A. E., Baldo, B. A., Pratt, W. E. & Will, M. J. incubation of cocaine craving. Nature Neurosci. 16, endogenous ion channels and cellular excitability.
Corticostriatal-hypothalamic circuitry and food 1644–1651 (2013). Nature Methods 5, 331–338 (2008).
motivation: integration of energy, action and reward. 118. Conrad, K. L. et al. Formation of accumbens 143. Chambers, J. J. & Kramer, R. H. Light-activated ion
Physiol. Behav. 86, 773–795 (2005). GluR2‑lacking AMPA receptors mediates incubation of channels for remote control of neural activity. Methods
94. Baldo, B. A. & Kelley, A. E. Discrete neurochemical cocaine craving. Nature 454, 118–121 (2008). Cell Biol. 90, 217–232 (2008).
coding of distinguishable motivational processes: 119. Disterhoft, J. F. & Oh, M. M. Learning, aging and 144. Kramer, R. H., Mourot, A. & Adesnik, H.
insights from nucleus accumbens control of feeding. intrinsic neuronal plasticity. Trends Neurosci. 29, Optogenetic pharmacology for control of native
Psychopharmacol. (Berl.) 191, 439–459 (2007). 587–599 (2006). neuronal signaling proteins. Nature Neurosci. 16,
95. Harris, G. C., Wimmer, M. & Aston-Jones, G. A role for 120. Moyer, J. R. Jr, Thompson, L. T. & Disterhoft, J. F. 816–823 (2013).
lateral hypothalamic orexin neurons in reward seeking. Trace eyeblink conditioning increases CA1 excitability 145. Mourot, A., Tochitsky, I. & Kramer, R. H. Light at the
Nature 437, 556–559 (2005). in a transient and learning-specific manner. end of the channel: optical manipulation of intrinsic
96. Marchant, N. J. et al. A critical role of lateral J. Neurosci. 16, 5536–5546 (1996). neuronal excitability with chemical photoswitches.
hypothalamus in context-induced relapse to alcohol 121. Thompson, L. T., Moyer, J. R. Jr & Disterhoft, J. F. Frontiers Mol. Neurosci. 6, 5 (2013).
seeking after punishment-imposed abstinence. Transient changes in excitability of rabbit CA3 neurons 146. Mourot, A., Fehrentz, T. & Kramer, R. H. Photochromic
J. Neurosci. 34, 7447–7457 (2014). with a time course appropriate to support memory potassium channel blockers: design and
97. Boudreau, A. C., Reimers, J. M., Milovanovic, M. & consolidation. J. Neurophysiol. 76, 1836–1849 electrophysiological characterization. Methods Mol.
Wolf, M. E. Cell surface AMPA receptors in the rat (1996). Biol. 995, 89–105 (2013).
nucleus accumbens increase during cocaine 122. Zhang, W. & Linden, D. J. The other side of the 147. MacLean, J. N., Zhang, Y., Johnson, B. R. & Harris-
withdrawal but internalize after cocaine challenge in engram: experience-driven changes in neuronal Warrick, R. M. Activity-independent homeostasis in
association with altered activation of mitogen- intrinsic excitability. Nature Rev. Neurosci. 4, 885– rhythmically active neurons. Neuron 37, 109–120
activated protein kinases. J. Neurosci. 27, 900 (2003). (2003).
10621–10635 (2007). 123. Debanne, D. & Poo, M. M. Spike-timing dependent 148. Bergquist, S., Dickman, D. K. & Davis, G. W. A
98. Boudreau, A. C. & Wolf, M. E. Behavioral sensitization plasticity beyond synapse – pre- and post-synaptic hierarchy of cell intrinsic and target-derived
to cocaine is associated with increased AMPA receptor plasticity of intrinsic neuronal excitability. Frontiers homeostatic signaling. Neuron 66, 220–234 (2010).
surface expression in the nucleus accumbens. Synapt. Neurosci. 2, 21 (2010). 149. Turrigiano, G. Too many cooks? Intrinsic and synaptic
J. Neurosci. 25, 9144–9151 (2005). 124. Haber, S. N., Fudge, J. L. & McFarland, N. R. homeostatic mechanisms in cortical circuit refinement.
99. Kourrich, S., Rothwell, P. E., Klug, J. R. & Striatonigrostriatal pathways in primates form an Annu. Rev. Neurosci. 34, 89–103 (2011).
Thomas, M. J. Cocaine experience controls ascending spiral from the shell to the dorsolateral 150. Marder, E. & Goaillard, J. M. Variability, compensation
bidirectional synaptic plasticity in the nucleus striatum. J. Neurosci. 20, 2369–2382 (2000). and homeostasis in neuron and network function.
accumbens. J. Neurosci. 27, 7921–7928 (2007). 125. Carlezon, W. A. Jr & Thomas, M. J. Biological Nature Rev. Neurosci. 7, 563–574 (2006).
100. Pascoli, V. et al. Contrasting forms of cocaine-evoked substrates of reward and aversion: a nucleus 151. Lujan, R. Organisation of potassium channels on the
plasticity control components of relapse. Nature 509, accumbens activity hypothesis. Neuropharmacology neuronal surface. J. Chem. Neuroanat 40, 1–20
459–464 (2014). 56 (Suppl. 1), 122–132 (2009). (2010).
152. Vacher, H., Mohapatra, D. P. & Trimmer, J. S. 163. Doya, K. What are the computations of the cerebellum, 175. Gutkin, B. S., Dehaene, S. & Changeux, J. P. A
Localization and targeting of voltage-dependent ion the basal ganglia and the cerebral cortex? Neural neurocomputational hypothesis for nicotine
channels in mammalian central neurons. Physiol. Rev. Netw. 12, 961–974 (1999). addiction. Proc. Natl Acad. Sci. USA 103,
88, 1407–1447 (2008). 164. Pessiglione, M., Seymour, B., Flandin, G., Dolan, R. J. 1106–1111 (2006).
153. Wolf, J. A. et al. NMDA/AMPA ratio impacts state & Frith, C. D. Dopamine-dependent prediction errors 176. Saddoris, M. P. & Carelli, R. M. Cocaine self-
transitions and entrainment to oscillations in a underpin reward-seeking behaviour in humans. Nature administration abolishes associative neural encoding
computational model of the nucleus accumbens 442, 1042–1045 (2006). in the nucleus accumbens necessary for higher-order
medium spiny projection neuron. J. Neurosci. 25, 165. Dezfouli, A. & Balleine, B. W. Habits, action sequences learning. Biol. Psychiatry 75, 156–164 (2014).
9080–9095 (2005). and reinforcement learning. Eur. J. Neurosci. 35, 177. Saddoris, M. P., Stamatakis, A. & Carelli, R. M. Neural
154. Shen, W., Hernandez-Lopez, S., Tkatch, T., Held, J. E. 1036–1051 (2012). correlates of Pavlovian-to‑instrumental transfer in the
& Surmeier, D. J. Kv1.2‑containing K+ channels 166. Dayan, P. & Balleine, B. W. Reward, motivation, and nucleus accumbens shell are selectively potentiated
regulate subthreshold excitability of striatal medium reinforcement learning. Neuron 36, 285–298 (2002). following cocaine self-administration. Eur. J. Neurosci.
spiny neurons. J. Neurophysiol. 91, 1337–1349 167. O’Doherty, J. et al. Dissociable roles of ventral and 33, 2274–2287 (2011).
(2004). dorsal striatum in instrumental conditioning. Science 178. Takahashi, Y., Roesch, M. R., Stalnaker, T. A. &
155. Steephen, J. E. & Manchanda, R. Differences in 304, 452–454 (2004). Schoenbaum, G. Cocaine exposure shifts the balance
biophysical properties of nucleus accumbens medium 168. Montague, P. R., Hyman, S. E. & Cohen, J. D. of associative encoding from ventral to dorsolateral
spiny neurons emerging from inactivation of inward Computational roles for dopamine in behavioural striatum. Front. Integr. Neurosci. 1, 11 (2007).
rectifying potassium currents. J. Computat. Neurosci. control. Nature 431, 760–767 (2004). 179. Cameron, C. M. & Carelli, R. M. Cocaine abstinence
27, 453–470 (2009). 169. Takahashi, Y., Schoenbaum, G. & Niv, Y. Silencing the alters nucleus accumbens firing dynamics during goal-
156. John, J. & Manchanda, R. Modulation of synaptic critics: understanding the effects of cocaine directed behaviors for cocaine and sucrose. Eur.
potentials and cell excitability by dendritic KIR and sensitization on dorsolateral and ventral striatum in J. Neurosci. 35, 940–951 (2012).
KAs channels in nucleus accumbens medium spiny the context of an actor/critic model. Frontiers 180. Kourrich, S. & Bonci, A. Neurobiology of Mental
neurons: a computational study. J. Biosciences 36, Neurosci. 2, 86–99 (2008). Illness 4th edn Ch.5 (eds Charney, D. S.,
309–328 (2011). 170. Dezfouli, A. et al. A neurocomputational model for Buxbaum, J. D., Sklar, P. & Nestler, E. J.) (Oxford
157. Rescorla, R. A. & Wagner, A. R. in Classical cocaine addiction. Neural Comput. 21, 2869–2893 Univ. Press, 2013).
Conditioning II: Current Research and Theory (eds (2009). 181. Yamaguchi, T., Wang, H. L., Li, X., Ng, T. H. &
Black, A. H. & Prokasy, W. F.) 64–99 (Appleton- 171. Redish, A. D. Addiction as a computational process Morales, M. Mesocorticolimbic glutamatergic
Century-Crofts, 1972). gone awry. Science 306, 1944–1947 (2004). pathway. J. Neurosci. 31, 8476–8490 (2011).
158. Sutton, R. S. & Barto, A. Reinforcement Learning: An 172. Redish, A. D., Jensen, S. & Johnson, A. A unified 182. Tecuapetla, F. et al. Glutamatergic signaling by
Introduction (MIT Press, 1998). framework for addiction: vulnerabilities in the decision mesolimbic dopamine neurons in the nucleus
159. Sutton, R. S. Learning to predict by the method of process. Behav. Brain Sci. 31, 415–437; discussion accumbens. J. Neurosci. 30, 7105–7110 (2010).
temporal diferences. Machine Learn. 3, 9–44 (1988). 437–487 (2008). 183. Stuber, G. D., Hnasko, T. S., Britt, J. P., Edwards, R. H.
160. Suri, R. E., Bargas, J. & Arbib, M. A. Modeling 173. Redish, A. D., Jensen, S., Johnson, A. & Kurth- & Bonci, A. Dopaminergic terminals in the nucleus
functions of striatal dopamine modulation in learning Nelson, Z. Reconciling reinforcement learning models accumbens but not the dorsal striatum corelease
and planning. Neuroscience 103, 65–85 (2001). with behavioral extinction and renewal: implications glutamate. J. Neurosci. 30, 8229–8233 (2010).
161. Joel, D., Niv, Y. & Ruppin, E. Actor-critic models of the for addiction, relapse, and problem gambling. Psychol.
basal ganglia: new anatomical and computational Rev. 114, 784–805 (2007). Acknowledgements
perspectives. Neural Netw. 15, 535–547 (2002). 174. Piray, P., Keramati, M. M., Dezfouli, A., Lucas, C. & The authors thank Y. Shaham, B. C. Finger and G. Schoen‑
162. Atallah, H. E., Lopez-Paniagua, D., Rudy, J. W. & Mokri, A. Individual differences in nucleus accumbens baum for reading an early version of this manuscript.
O’Reilly, R. C. Separate neural substrates for skill dopamine receptors predict development of addiction-
learning and performance in the ventral and dorsal like behavior: a computational approach. Neural Competing interests statement
striatum. Nature Neurosci. 10, 126–131 (2007). Comput. 22, 2334–2368 (2010). The authors declare no competing interests.