Pavlovian-instrumental interactions in active avoidance: The bark of neutral trials
•Computational model of behaviour and dopamine in the approach-avoidance task of Gentry et al. (2016).•Good avoidance of shock is accounted for by purely instrumental factors.•Poor avoidance can be explained by Pavlovian misbehaviour. In active avoidance tasks, subjects have to learn to execute part...
Saved in:
| Published in | Brain research Vol. 1713; pp. 52 - 61 |
|---|---|
| Main Authors | , |
| Format | Journal Article |
| Language | English |
| Published |
Netherlands
Elsevier B.V
15.06.2019
|
| Subjects | |
| Online Access | Get full text |
| ISSN | 0006-8993 1872-6240 1872-6240 |
| DOI | 10.1016/j.brainres.2018.10.011 |
Cover
| Abstract | •Computational model of behaviour and dopamine in the approach-avoidance task of Gentry et al. (2016).•Good avoidance of shock is accounted for by purely instrumental factors.•Poor avoidance can be explained by Pavlovian misbehaviour.
In active avoidance tasks, subjects have to learn to execute particular actions in order to avoid an aversive stimulus, such as a shock. Such paradigms pose a number of psychological and neural enigmas, and so have attracted substantial computational interest. However, the ratio of conjecture to confirmation remains high. Here, we perform a theoretical inquiry into a recent experiment by Gentry, Lee, and Roesch (’Phasic dopamine release in the rat nucleus accumbens predicts approach and avoidance performance’, Nat. Commun., 7:13154) who measured phasic dopamine concentrations in the nucleus accumbens core of rats whilst they avoided shocks, acquired food, or acted to gain no programmed outcome. These last, neutral, trials turned out to be a perfect probe for the workings of avoidance, partly because of the substantial differences between subjects and sessions revealed in the experiment. We suggest a way to interpret this probe, gaining support for opponency-, safety-, and Pavlovian-influenced treatments of avoidance. |
|---|---|
| AbstractList | In active avoidance tasks, subjects have to learn to execute particular actions in order to avoid an aversive stimulus, such as a shock. Such paradigms pose a number of psychological and neural enigmas, and so have attracted substantial computational interest. However, the ratio of conjecture to confirmation remains high. Here, we perform a theoretical inquiry into a recent experiment by Gentry, Lee, and Roesch ('Phasic dopamine release in the rat nucleus accumbens predicts approach and avoidance performance', Nat. Commun., 7:13154) who measured phasic dopamine concentrations in the nucleus accumbens core of rats whilst they avoided shocks, acquired food, or acted to gain no programmed outcome. These last, neutral, trials turned out to be a perfect probe for the workings of avoidance, partly because of the substantial differences between subjects and sessions revealed in the experiment. We suggest a way to interpret this probe, gaining support for opponency-, safety-, and Pavlovian-influenced treatments of avoidance.In active avoidance tasks, subjects have to learn to execute particular actions in order to avoid an aversive stimulus, such as a shock. Such paradigms pose a number of psychological and neural enigmas, and so have attracted substantial computational interest. However, the ratio of conjecture to confirmation remains high. Here, we perform a theoretical inquiry into a recent experiment by Gentry, Lee, and Roesch ('Phasic dopamine release in the rat nucleus accumbens predicts approach and avoidance performance', Nat. Commun., 7:13154) who measured phasic dopamine concentrations in the nucleus accumbens core of rats whilst they avoided shocks, acquired food, or acted to gain no programmed outcome. These last, neutral, trials turned out to be a perfect probe for the workings of avoidance, partly because of the substantial differences between subjects and sessions revealed in the experiment. We suggest a way to interpret this probe, gaining support for opponency-, safety-, and Pavlovian-influenced treatments of avoidance. •Computational model of behaviour and dopamine in the approach-avoidance task of Gentry et al. (2016).•Good avoidance of shock is accounted for by purely instrumental factors.•Poor avoidance can be explained by Pavlovian misbehaviour. In active avoidance tasks, subjects have to learn to execute particular actions in order to avoid an aversive stimulus, such as a shock. Such paradigms pose a number of psychological and neural enigmas, and so have attracted substantial computational interest. However, the ratio of conjecture to confirmation remains high. Here, we perform a theoretical inquiry into a recent experiment by Gentry, Lee, and Roesch (’Phasic dopamine release in the rat nucleus accumbens predicts approach and avoidance performance’, Nat. Commun., 7:13154) who measured phasic dopamine concentrations in the nucleus accumbens core of rats whilst they avoided shocks, acquired food, or acted to gain no programmed outcome. These last, neutral, trials turned out to be a perfect probe for the workings of avoidance, partly because of the substantial differences between subjects and sessions revealed in the experiment. We suggest a way to interpret this probe, gaining support for opponency-, safety-, and Pavlovian-influenced treatments of avoidance. In active avoidance tasks, subjects have to learn to execute particular actions in order to avoid an aversive stimulus, such as a shock. Such paradigms pose a number of psychological and neural enigmas, and so have attracted substantial computational interest. However, the ratio of conjecture to confirmation remains high. Here, we perform a theoretical inquiry into a recent experiment by Gentry, Lee, and Roesch ('Phasic dopamine release in the rat nucleus accumbens predicts approach and avoidance performance', Nat. Commun., 7:13154) who measured phasic dopamine concentrations in the nucleus accumbens core of rats whilst they avoided shocks, acquired food, or acted to gain no programmed outcome. These last, neutral, trials turned out to be a perfect probe for the workings of avoidance, partly because of the substantial differences between subjects and sessions revealed in the experiment. We suggest a way to interpret this probe, gaining support for opponency-, safety-, and Pavlovian-influenced treatments of avoidance. |
| Author | Dayan, Peter Lloyd, Kevin |
| Author_xml | – sequence: 1 givenname: Kevin orcidid: 0000-0001-7744-7562 surname: Lloyd fullname: Lloyd, Kevin email: klloyd@princeton.edu organization: Princeton Neuroscience Institute, Princeton University, United States – sequence: 2 givenname: Peter surname: Dayan fullname: Dayan, Peter organization: Gatsby Computational Neuroscience Unit, University College London, United Kingdom |
| BackLink | https://www.ncbi.nlm.nih.gov/pubmed/30308188$$D View this record in MEDLINE/PubMed |
| BookMark | eNqNkE1LHTEUhoNY9PrxF2SW3cw1mUyTTCmiSGsLQgvadTiTnMFc5yY2yQz475vhahdu7OrkHN7nhTxHZN8Hj4ScMbpmlInzzbqP4HzEtG4oU-W4poztkRVTsqlF09J9sqKUilp1HT8kRyltysp5Rw_IIaecKqbUitz9gnkMswNfO59ynLboM4yV8xkjmOyCT2WplueMFczBWfAGP1f3D1j1EB-rMFQepxwLlaODMZ2QD0MZePoyj8nvb1_vr7_Xtz9vflxf3dambXiubctlR4UcBmmxbwUq4ILJTkluOYD41JtGGeitAiGsUtDA0CrFGq5kq4aWH5OPu96nGP5MmLLeumRwHMFjmJJuGCt_b6VUJXr2Ep36LVr9FN0W4rN-FVECYhcwMaQUcfgXYVQvxvVGvxrXi_HlXowX8Msb0LgMi7dixI3v45c7HIuo2WHUyTgsgq2LaLK2wb1fcfGmwozOOwPjIz7_T8FfsuW2tQ |
| CitedBy_id | crossref_primary_10_52547_shefa_9_4_51 crossref_primary_10_3389_fnsys_2022_926388 crossref_primary_10_1371_journal_pcbi_1011569 |
| Cites_doi | 10.1007/BF00115009 10.1016/j.neuron.2014.02.010 10.1146/annurev.neuro.29.051605.112851 10.1016/j.neuron.2015.04.015 10.1038/nature05051 10.1038/npp.2010.151 10.1038/npp.2017.304 10.1523/JNEUROSCI.3087-12.2012 10.1038/s41467-018-03438-y 10.3758/BF03200092 10.1523/JNEUROSCI.2489-13.2014 10.1037/h0058316 10.1371/journal.pcbi.1004622 10.1016/j.nlm.2016.08.008 10.1177/105971230200900205 10.3389/fnbeh.2015.00163 10.1016/j.neunet.2006.03.002 10.1037/0033-295X.113.2.300 10.1037/h0028589 10.1146/annurev.neuro.051508.135607 10.1523/ENEURO.0058-18.2018 10.1523/JNEUROSCI.6376-10.2011 10.1016/j.neuropharm.2013.03.019 10.1046/j.0953-816x.2001.01577.x 10.1016/0301-0082(92)90018-A 10.1007/s00213-006-0502-4 10.1038/nn.3100 10.1016/0091-3057(95)02135-3 10.1007/BF03392126 10.1016/S0893-6080(02)00048-5 10.1037/h0040613 10.1101/lm.978708 10.1007/s00213-006-0668-9 10.1021/ac500771q 10.1523/JNEUROSCI.5562-08.2009 10.1146/annurev.neuro.29.051605.113038 10.7554/eLife.06346 10.1146/annurev-neuro-061010-113641 10.1901/jeab.1969.12-301 10.1016/j.baga.2016.02.001 10.1038/ncomms13154 10.1038/nature09588 10.1016/j.tics.2014.01.003 10.1017/S0033291715002597 10.1016/S0893-6080(02)00052-7 10.1016/S0165-0173(98)00019-8 10.1016/j.cub.2014.07.041 10.1523/JNEUROSCI.21-09-03261.2001 10.1111/j.1460-9568.2012.08026.x 10.1146/annurev-neuro-072116-031109 10.1016/j.cub.2014.12.002 10.1016/j.neuroimage.2012.04.024 10.1016/j.neuroscience.2013.11.028 10.1016/j.conb.2012.11.012 10.1016/j.bandc.2009.03.009 10.3389/fnins.2012.00137 10.1016/j.nlm.2014.07.010 10.1037/h0093649 10.1523/JNEUROSCI.1343-10.2010 10.1021/cn500255p 10.1038/nn.4173 10.1016/j.neuron.2012.10.021 10.1038/nature10754 10.1901/jeab.1969.12-511 10.1038/nature08028 10.1007/BF03392107 10.1038/379449a0 10.1186/1744-9081-1-6 10.1126/science.275.5306.1593 10.1126/science.1093360 10.1523/JNEUROSCI.16-05-01936.1996 10.1080/09548980802192784 10.1162/neco.2006.18.7.1637 10.1523/JNEUROSCI.4961-07.2008 10.1162/jocn_a_00090 10.1016/j.neuron.2008.11.005 10.1016/j.neuron.2008.01.022 10.1016/0165-0173(83)90038-3 10.1038/nn.4187 10.1038/nature12475 10.1038/nn1923 10.1038/npp.2013.48 10.1016/j.cell.2015.07.014 10.1146/annurev.ps.39.020188.000355 10.1016/S0166-4328(02)00291-7 10.1016/S0079-7421(08)60385-0 10.1037/h0062725 10.3758/LB.38.1.50 10.1016/j.physbeh.2005.08.061 10.1038/s41467-018-04840-2 10.1523/JNEUROSCI.23-30-09913.2003 10.1523/JNEUROSCI.2513-09.2009 10.1016/j.neuroscience.2010.09.058 10.1016/S0166-2236(03)00177-2 10.1016/j.neuropharm.2013.05.040 10.1037/0735-7044.116.2.267 |
| ContentType | Journal Article |
| Copyright | 2018 Elsevier B.V. Copyright © 2018 Elsevier B.V. All rights reserved. |
| Copyright_xml | – notice: 2018 Elsevier B.V. – notice: Copyright © 2018 Elsevier B.V. All rights reserved. |
| DBID | AAYXX CITATION NPM 7X8 |
| DOI | 10.1016/j.brainres.2018.10.011 |
| DatabaseName | CrossRef PubMed MEDLINE - Academic |
| DatabaseTitle | CrossRef PubMed MEDLINE - Academic |
| DatabaseTitleList | MEDLINE - Academic PubMed |
| Database_xml | – sequence: 1 dbid: NPM name: PubMed url: https://proxy.k.utb.cz/login?url=http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed sourceTypes: Index Database |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Anatomy & Physiology |
| EISSN | 1872-6240 |
| EndPage | 61 |
| ExternalDocumentID | 30308188 10_1016_j_brainres_2018_10_011 S0006899318305158 |
| Genre | Research Support, Non-U.S. Gov't Journal Article |
| GroupedDBID | --- --K --M -DZ -~X .1- .FO .~1 0R~ 1B1 1P~ 1RT 1~. 1~5 23N 4.4 457 4G. 5GY 5RE 6J9 7-5 71M 8P~ 9JM AABNK AAEDT AAEDW AAIKJ AAKOC AALRI AAOAW AAQFI AATTM AAXKI AAXLA AAXUO AAYWO ABCQJ ABFNM ABFRF ABIVO ABJNI ABLJU ABMAC ABTEW ACDAQ ACGFO ACGFS ACIUM ACNCT ACRLP ACVFH ADBBV ADCNI ADEZE AEBSH AEFWE AEIPS AEKER AENEX AEUPX AEVXI AFPUW AFRHN AFTJW AFXIZ AGCQF AGUBO AGWIK AGYEJ AIEXJ AIIUN AIKHN AITUG AJUYK AKBMS AKRWK AKYEP ALMA_UNASSIGNED_HOLDINGS AMRAJ ANKPU APXCP AXJTR BKOJK BLXMC CS3 DU5 EBS EFJIC EFKBS EJD EO8 EO9 EP2 EP3 F5P FDB FIRID FNPLU FYGXN G-Q GBLVA IHE J1W K-O KOM L7B M2V M41 MO0 MOBAO N9A O-L O9- OAUVE OP~ OZT P-8 P-9 P2P PC. Q38 ROL RPZ SCC SDF SDG SES SPCBC SSN SSZ T5K Z5R ZGI ~G- AACTN AADPK AAIAV ABYKQ AFCTW AFKWA AHHHB AJOXV AMFUW EFLBG RIG .55 .GJ 41~ 53G 5VS AAQXK AAYJJ AAYXX ABWVN ABXDB ACRPL ADIYS ADMUD ADNMO AFJKZ AGHFR AGQPQ AGRNS AI. AIGII ASPBG AVWKF AZFZN BNPGV CITATION FEDTE FGOYB G-2 HMQ HVGLF HZ~ MVM R2- SEW SNS SSH VH1 WUQ X7M XPP NPM 7X8 |
| ID | FETCH-LOGICAL-c423t-d4379067ff7deb46e8a36179873d3aa65bc28cabd8a66d88a2af4881238748f43 |
| IEDL.DBID | AIKHN |
| ISSN | 0006-8993 1872-6240 |
| IngestDate | Fri Sep 05 14:30:59 EDT 2025 Wed Feb 19 02:30:33 EST 2025 Tue Jul 01 04:34:52 EDT 2025 Thu Apr 24 23:03:16 EDT 2025 Fri Feb 23 02:19:44 EST 2024 Tue Aug 26 16:31:42 EDT 2025 |
| IsPeerReviewed | true |
| IsScholarly | true |
| Keywords | Nucleus accumbens Active avoidance Dopamine Pavlovian misbehavior |
| Language | English |
| License | Copyright © 2018 Elsevier B.V. All rights reserved. |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-c423t-d4379067ff7deb46e8a36179873d3aa65bc28cabd8a66d88a2af4881238748f43 |
| Notes | ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 23 |
| ORCID | 0000-0001-7744-7562 |
| PMID | 30308188 |
| PQID | 2119934778 |
| PQPubID | 23479 |
| PageCount | 10 |
| ParticipantIDs | proquest_miscellaneous_2119934778 pubmed_primary_30308188 crossref_primary_10_1016_j_brainres_2018_10_011 crossref_citationtrail_10_1016_j_brainres_2018_10_011 elsevier_sciencedirect_doi_10_1016_j_brainres_2018_10_011 elsevier_clinicalkey_doi_10_1016_j_brainres_2018_10_011 |
| ProviderPackageCode | CITATION AAYXX |
| PublicationCentury | 2000 |
| PublicationDate | 2019-06-15 |
| PublicationDateYYYYMMDD | 2019-06-15 |
| PublicationDate_xml | – month: 06 year: 2019 text: 2019-06-15 day: 15 |
| PublicationDecade | 2010 |
| PublicationPlace | Netherlands |
| PublicationPlace_xml | – name: Netherlands |
| PublicationTitle | Brain research |
| PublicationTitleAlternate | Brain Res |
| PublicationYear | 2019 |
| Publisher | Elsevier B.V |
| Publisher_xml | – name: Elsevier B.V |
| References | Howe, Tierney, Sandberg, Phillips, Graybiel (b0225) 2013; 500 Bolles (b0045) 1972; 6 Frank, Claus (b0140) 2006; 113 Lloyd, Dayan (b0295) 2016; 12 Sidman (b0460) 2006; 29 Gerfen, Surmeier (b0160) 2011; 34 Tops, Russo, Boksem, Tucker (b0495) 2009; 71 Deakin (b0100) 1983; Vol. 2 Hart, Rutledge, Glimcher, Phillips (b0215) 2014; 34 Huys, Gölzer, Friedel, Heinz, Cools, Dayan, Dolan (b0230) 2016; 46 Lammel, Lim, Malenka (b0265) 2014; 76 Daw, Kakade, Dayan (b0075) 2002; 15 Flagel, Clark, Robinson, Mayo, Czuj, Willuhn, Akers, Clinton, Phillips, Akil (b0130) 2011; 469 Mirenowicz, Schultz (b0335) 1996; 379 Johnson, Li, Li, Klopf (b0240) 2001; 9 Day, Roitman, Wightman, Carelli (b0080) 2007; 10 Luo, Li, Zhong (b0305) 2016; 135 Dayan, Niv, Seymour, Daw (b0095) 2006; 19 Schweimer, Ungless (b0445) 2010; 171 Guitart-Masip, Fuentemilla, Bach, Huys, Dayan, Dolan, Duzel (b0190) 2011; 31 Dinsmoor (b0110) 1954; 61 Sutton (b0480) 1988; 3 Cohen, Amoroso, Uchida (b0055) 2015; 4 Guitart-Masip, Duzel, Dolan, Dayan (b0185) 2014; 18 Estes (b0115) 1943; 32 Hall, Parkinson, Connor, Dickinson, Everitt (b0200) 2001; 13 Kravitz, Tye, Kreitzer (b0250) 2012; 15 Fanselow, Lester (b0120) 1988 Pultorak, Schelp, Isaacs, Krzystyniak, Oleson (b0405) 2018 Berridge, Robinson (b0025) 1998; 28 Faure, Reynolds, Richard, Berridge (b0125) 2008; 28 Garofalo, di Pellegrino (b0145) 2015; 9 Beninger (b0020) 1983; 6 Guitart-Masip, Huys, Fuentemilla, Dayan, Duzel, Dolan (b0195) 2012; 62 Schultz, Dayan, Montague (b0440) 1997; 275 Lichtenberg, Kashtelyan, Burton, Bissonette, Roesch (b0280) 2014; 258 Balleine (b0005) 2005; 86 Beierholm, Guitart-Masip, Economides, Chowdhury, Düzel, Dolan, Dayan (b0015) 2013; 38 Lloyd, Dayan (b0290) 2015; 11 Iigaya, Fonseca, Murakami, Mainen, Dayan (b0235) 2018; 9 Solomon, Wynne (b0465) 1953; 67 Matsumoto, Hikosaka (b0315) 2009; 459 Dayan (b0085) 2012; 35 Graybiel (b0175) 2008; 31 Mowrer (b0360) 1947; 17 Miyazaki, Miyazaki, Tanaka, Yamanaka, Takahashi, Tabuchi, Doya (b0340) 2014; 24 Lerner, Shilyansky, Davidson, Evans, Beier, Zalocusky, Crow, Malenka, Luo, Tomer (b0270) 2015; 162 McClure, Daw, Montague (b0320) 2003; 26 Moran, Kishida, Lohrenz, Saez, Laxton, Witcher, Tatter, Ellis, Phillips, Dayan, Montague (b0350) 2018; 43 Graeff, Guimarães, De Andrade, Deakin (b0170) 1996; 54 Robinson, Yager, Cogan, Saunders (b0415) 2014; 76 Dayan, Huys (b0090) 2009; 32 Williams, Williams (b0515) 1969; 12 Fonseca, Murakami, Mainen (b0135) 2015; 25 Blackburn, Pfaus, Phillips (b0030) 1992; 39 Crockett, Clark, Robbins (b0065) 2009; 29 Kreitzer, Malenka (b0255) 2008; 60 Sombers, Beyene, Carelli, Wightman (b0470) 2009; 29 Watabe-Uchida, Eshel, Uchida (b0505) 2017; 40 Pignatelli, Bonci (b0400) 2015; 86 Guitart-Masip, Beierholm, Dolan, Duzel, Dayan (b0180) 2011; 23 Oleson, Gentry, Chioma, Cheer (b0380) 2012; 32 Satoh, Nakai, Sato, Kimura (b0430) 2003; 23 Setlow, Holland, Gallagher (b0450) 2002; 116 Hamid, Pettibone, Mabrouk, Hetrick, Schmidt, Vander Weele, Kennedy, Aragona, Berke (b0205) 2016; 19 Schultz (b0435) 2013; 23 Gentry, Lee, Roesch (b0150) 2016; 7 Niv, Daw, Joel, Dayan (b0370) 2007; 191 Salamone, Correa, Farrar, Mingote (b0425) 2007; 191 Moutoussis, Bentall, Williams, Dayan (b0355) 2008; 19 Maia (b0310) 2010; 38 Bolles (b0040) 1970; 77 Lottem, Banerjee, Vertechi, Sarra, Lohuis, Mainen (b0300) 2018; 9 McCutcheon, Ebner, Loriaux, Roitman (b0325) 2012; 6 Salamone, Correa (b0420) 2012; 76 Lex, Hauber (b0275) 2008; 15 Montague, Dayan, Sejnowski (b0345) 1996; 16 Daw, Courville, Touretzky (b0070) 2006; 18 Parkinson, Dalley, Cardinal, Bamford, Fehnert, Lachenal, Rudarakanchana, Halkerston, Robbins, Everitt (b0385) 2002; 137 Sulzer, Cragg, Rice (b0475) 2016; 6 Gentry, Schuweiler, Roesch (b0155) 2018 Kakade, Dayan (b0245) 2002; 15 Deakin, Graeff (b0105) 1991 Hart, Clark, Phillips (b0210) 2015; 117 McKearney (b0330) 1969; 12 Reynolds, Berridge (b0410) 2001; 21 Baron, Galizio (b0010) 2005; 28 Ungless, Magill, Bolam (b0500) 2004; 303 Shadmehr, de Xivry, Xu-Wilson, Shih (b0455) 2010; 30 Sutton, Barto (b0485) 1998 Lammel, Hetzel, Häckel, Jones, Roeper (b0260) 2008; 57 Mowrer (b0365) 1956; 63 Hershberger (b0220) 1986; 14 Wenzel, Rauscher, Cheer, Oleson (b0510) 2014; 6 Gold, Shadlen (b0165) 2007; 30 Niv, Duff, Dayan (b0375) 2005; 1 Blanchard, Blanchard (b0035) 1988; 39 Liu, Zhou, Li, Hu, Lu, Ma, Feng, Zhang, Wang, Zeng (b0285) 2014; 81 Pearl (b0390) 2009 Syed, Grima, Magill, Bogacz, Brown, Walton (b0490) 2016; 19 Boureau, Dayan (b0050) 2010; 36 Yildirim, Bayindir (b0520) 2014; 86 Pessiglione, Seymour, Flandin, Dolan, Frith (b0395) 2006; 442 Cohen, Haesler, Vong, Lowell, Uchida (b0060) 2012; 482 Guitart-Masip (10.1016/j.brainres.2018.10.011_b0190) 2011; 31 Oleson (10.1016/j.brainres.2018.10.011_b0380) 2012; 32 Mirenowicz (10.1016/j.brainres.2018.10.011_b0335) 1996; 379 Parkinson (10.1016/j.brainres.2018.10.011_b0385) 2002; 137 Schultz (10.1016/j.brainres.2018.10.011_b0435) 2013; 23 Ungless (10.1016/j.brainres.2018.10.011_b0500) 2004; 303 Montague (10.1016/j.brainres.2018.10.011_b0345) 1996; 16 Pearl (10.1016/j.brainres.2018.10.011_b0390) 2009 Mowrer (10.1016/j.brainres.2018.10.011_b0360) 1947; 17 Estes (10.1016/j.brainres.2018.10.011_b0115) 1943; 32 Sutton (10.1016/j.brainres.2018.10.011_b0480) 1988; 3 Crockett (10.1016/j.brainres.2018.10.011_b0065) 2009; 29 Shadmehr (10.1016/j.brainres.2018.10.011_b0455) 2010; 30 Gentry (10.1016/j.brainres.2018.10.011_b0150) 2016; 7 Schultz (10.1016/j.brainres.2018.10.011_b0440) 1997; 275 Lloyd (10.1016/j.brainres.2018.10.011_b0295) 2016; 12 Pultorak (10.1016/j.brainres.2018.10.011_b0405) 2018 Dayan (10.1016/j.brainres.2018.10.011_b0090) 2009; 32 Guitart-Masip (10.1016/j.brainres.2018.10.011_b0195) 2012; 62 Luo (10.1016/j.brainres.2018.10.011_b0305) 2016; 135 Sombers (10.1016/j.brainres.2018.10.011_b0470) 2009; 29 Bolles (10.1016/j.brainres.2018.10.011_b0045) 1972; 6 Robinson (10.1016/j.brainres.2018.10.011_b0415) 2014; 76 Schweimer (10.1016/j.brainres.2018.10.011_b0445) 2010; 171 Hershberger (10.1016/j.brainres.2018.10.011_b0220) 1986; 14 Satoh (10.1016/j.brainres.2018.10.011_b0430) 2003; 23 Setlow (10.1016/j.brainres.2018.10.011_b0450) 2002; 116 Lerner (10.1016/j.brainres.2018.10.011_b0270) 2015; 162 Johnson (10.1016/j.brainres.2018.10.011_b0240) 2001; 9 Kravitz (10.1016/j.brainres.2018.10.011_b0250) 2012; 15 Williams (10.1016/j.brainres.2018.10.011_b0515) 1969; 12 Moran (10.1016/j.brainres.2018.10.011_b0350) 2018; 43 Niv (10.1016/j.brainres.2018.10.011_b0375) 2005; 1 Blackburn (10.1016/j.brainres.2018.10.011_b0030) 1992; 39 Graybiel (10.1016/j.brainres.2018.10.011_b0175) 2008; 31 Bolles (10.1016/j.brainres.2018.10.011_b0040) 1970; 77 Liu (10.1016/j.brainres.2018.10.011_b0285) 2014; 81 Dayan (10.1016/j.brainres.2018.10.011_b0095) 2006; 19 Matsumoto (10.1016/j.brainres.2018.10.011_b0315) 2009; 459 Hamid (10.1016/j.brainres.2018.10.011_b0205) 2016; 19 McClure (10.1016/j.brainres.2018.10.011_b0320) 2003; 26 Guitart-Masip (10.1016/j.brainres.2018.10.011_b0180) 2011; 23 Sulzer (10.1016/j.brainres.2018.10.011_b0475) 2016; 6 McCutcheon (10.1016/j.brainres.2018.10.011_b0325) 2012; 6 Daw (10.1016/j.brainres.2018.10.011_b0070) 2006; 18 Beninger (10.1016/j.brainres.2018.10.011_b0020) 1983; 6 Daw (10.1016/j.brainres.2018.10.011_b0075) 2002; 15 Gentry (10.1016/j.brainres.2018.10.011_b0155) 2018 Watabe-Uchida (10.1016/j.brainres.2018.10.011_b0505) 2017; 40 Berridge (10.1016/j.brainres.2018.10.011_b0025) 1998; 28 Lichtenberg (10.1016/j.brainres.2018.10.011_b0280) 2014; 258 McKearney (10.1016/j.brainres.2018.10.011_b0330) 1969; 12 Dayan (10.1016/j.brainres.2018.10.011_b0085) 2012; 35 Miyazaki (10.1016/j.brainres.2018.10.011_b0340) 2014; 24 Kakade (10.1016/j.brainres.2018.10.011_b0245) 2002; 15 Yildirim (10.1016/j.brainres.2018.10.011_b0520) 2014; 86 Lammel (10.1016/j.brainres.2018.10.011_b0260) 2008; 57 Graeff (10.1016/j.brainres.2018.10.011_b0170) 1996; 54 Lottem (10.1016/j.brainres.2018.10.011_b0300) 2018; 9 Cohen (10.1016/j.brainres.2018.10.011_b0060) 2012; 482 Fanselow (10.1016/j.brainres.2018.10.011_b0120) 1988 Tops (10.1016/j.brainres.2018.10.011_b0495) 2009; 71 Syed (10.1016/j.brainres.2018.10.011_b0490) 2016; 19 Wenzel (10.1016/j.brainres.2018.10.011_b0510) 2014; 6 Sidman (10.1016/j.brainres.2018.10.011_b0460) 2006; 29 Deakin (10.1016/j.brainres.2018.10.011_b0105) 1991 Flagel (10.1016/j.brainres.2018.10.011_b0130) 2011; 469 Pessiglione (10.1016/j.brainres.2018.10.011_b0395) 2006; 442 Cohen (10.1016/j.brainres.2018.10.011_b0055) 2015; 4 Sutton (10.1016/j.brainres.2018.10.011_b0485) 1998 Hart (10.1016/j.brainres.2018.10.011_b0215) 2014; 34 Salamone (10.1016/j.brainres.2018.10.011_b0425) 2007; 191 Day (10.1016/j.brainres.2018.10.011_b0080) 2007; 10 Garofalo (10.1016/j.brainres.2018.10.011_b0145) 2015; 9 Huys (10.1016/j.brainres.2018.10.011_b0230) 2016; 46 Hall (10.1016/j.brainres.2018.10.011_b0200) 2001; 13 Faure (10.1016/j.brainres.2018.10.011_b0125) 2008; 28 Reynolds (10.1016/j.brainres.2018.10.011_b0410) 2001; 21 Kreitzer (10.1016/j.brainres.2018.10.011_b0255) 2008; 60 Salamone (10.1016/j.brainres.2018.10.011_b0420) 2012; 76 Hart (10.1016/j.brainres.2018.10.011_b0210) 2015; 117 Niv (10.1016/j.brainres.2018.10.011_b0370) 2007; 191 Guitart-Masip (10.1016/j.brainres.2018.10.011_b0185) 2014; 18 Lex (10.1016/j.brainres.2018.10.011_b0275) 2008; 15 Mowrer (10.1016/j.brainres.2018.10.011_b0365) 1956; 63 Solomon (10.1016/j.brainres.2018.10.011_b0465) 1953; 67 Boureau (10.1016/j.brainres.2018.10.011_b0050) 2010; 36 Howe (10.1016/j.brainres.2018.10.011_b0225) 2013; 500 Fonseca (10.1016/j.brainres.2018.10.011_b0135) 2015; 25 Dinsmoor (10.1016/j.brainres.2018.10.011_b0110) 1954; 61 Lammel (10.1016/j.brainres.2018.10.011_b0265) 2014; 76 Gerfen (10.1016/j.brainres.2018.10.011_b0160) 2011; 34 Deakin (10.1016/j.brainres.2018.10.011_b0100) 1983; Vol. 2 Baron (10.1016/j.brainres.2018.10.011_b0010) 2005; 28 Balleine (10.1016/j.brainres.2018.10.011_b0005) 2005; 86 Lloyd (10.1016/j.brainres.2018.10.011_b0290) 2015; 11 Moutoussis (10.1016/j.brainres.2018.10.011_b0355) 2008; 19 Blanchard (10.1016/j.brainres.2018.10.011_b0035) 1988; 39 Gold (10.1016/j.brainres.2018.10.011_b0165) 2007; 30 Beierholm (10.1016/j.brainres.2018.10.011_b0015) 2013; 38 Pignatelli (10.1016/j.brainres.2018.10.011_b0400) 2015; 86 Maia (10.1016/j.brainres.2018.10.011_b0310) 2010; 38 Iigaya (10.1016/j.brainres.2018.10.011_b0235) 2018; 9 Frank (10.1016/j.brainres.2018.10.011_b0140) 2006; 113 |
| References_xml | – volume: 6 year: 2012 ident: b0325 article-title: Encoding of aversion by dopamine and the nucleus accumbens publication-title: Front. Neurosci. – volume: 116 start-page: 267 year: 2002 end-page: 275 ident: b0450 article-title: Disconnection of the basolateral amygdala complex and nucleus accumbens impairs appetitive pavlovian second-order conditioned responses publication-title: Behav. Neurosci. – volume: 38 start-page: 1495 year: 2013 end-page: 1503 ident: b0015 article-title: Dopamine modulates reward-related vigor publication-title: Neuropsychopharmacology – volume: 76 start-page: 450 year: 2014 end-page: 459 ident: b0415 article-title: On the motivational properties of reward cues: Individual differences publication-title: Neuropharmacology – volume: 15 start-page: 549 year: 2002 end-page: 559 ident: b0245 article-title: Dopamine: generalization and bonuses publication-title: Neural Networks – volume: 54 start-page: 129 year: 1996 end-page: 141 ident: b0170 article-title: Role of 5-HT in stress, anxiety, and depression publication-title: Pharmacol. Biochem. Behav. – volume: Vol. 2 start-page: 149 year: 1983 end-page: 193 ident: b0100 article-title: Roles of serotonergic systems in escape, avoidance and other behaviours publication-title: Theory in Psychopharmacology – volume: 34 start-page: 698 year: 2014 end-page: 704 ident: b0215 article-title: Phasic dopamine release in the rat nucleus accumbens symmetrically encodes a reward prediction error term publication-title: J. Neurosci. – volume: 23 start-page: 9913 year: 2003 end-page: 9923 ident: b0430 article-title: Correlated coding of motivation and outcome of decision by dopamine neurons publication-title: J. Neurosci. – volume: 62 start-page: 154 year: 2012 end-page: 166 ident: b0195 article-title: Go and no-go learning in reward and punishment: Interactions between affect and effect publication-title: NeuroImage – volume: 13 start-page: 1984 year: 2001 end-page: 1992 ident: b0200 article-title: Involvement of the central nucleus of the amygdala and nucleus accumbens core in mediating pavlovian influences on instrumental behaviour publication-title: Eur. J. Neurosci. – volume: 57 start-page: 760 year: 2008 end-page: 773 ident: b0260 article-title: Unique properties of mesoprefrontal neurons within a dual mesocorticolimbic dopamine system publication-title: Neuron – volume: 40 start-page: 373 year: 2017 end-page: 394 ident: b0505 article-title: Neural circuitry of reward prediction error publication-title: Annu. Rev. Neurosci. – volume: 14 start-page: 443 year: 1986 end-page: 451 ident: b0220 article-title: An approach through the looking-glass publication-title: Animal Learn. Behav. – volume: 28 start-page: 309 year: 1998 end-page: 369 ident: b0025 article-title: What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience? publication-title: Brain Res. Rev. – volume: 191 start-page: 507 year: 2007 end-page: 520 ident: b0370 article-title: Tonic dopamine: opportunity costs and the control of response vigor publication-title: Psychopharmacology – volume: 43 start-page: 1425 year: 2018 end-page: 1435 ident: b0350 article-title: The protective action encoding of serotonin transients in the human brain publication-title: Neuropsychopharmacol.: Off. Publ. Am. College Neuropsychopharmacology – volume: 29 start-page: 11993 year: 2009 end-page: 11999 ident: b0065 article-title: Reconciling the role of serotonin in behavioral inhibition and aversion: acute tryptophan depletion abolishes punishment-induced inhibition in humans publication-title: J. Neurosci. – volume: 35 start-page: 1152 year: 2012 end-page: 1168 ident: b0085 article-title: Instrumental vigour in punishment and reward publication-title: Eur. J. Neurosci. – volume: 11 start-page: e1004622 year: 2015 ident: b0290 article-title: Tamping ramping: algorithmic, implementational, and computational explanations of phasic dopamine signals in the accumbens publication-title: PLoS Comput. Biol. – volume: 4 year: 2015 ident: b0055 article-title: Serotonergic neurons signal reward and punishment on multiple timescales publication-title: eLife – start-page: 185 year: 1988 end-page: 211 ident: b0120 article-title: A functional behavioristic approach to aversive motivated behavior: Predatory imminence as a determinant of the topography of defensive behavior publication-title: Evolution and Learning – volume: 15 start-page: 603 year: 2002 end-page: 616 ident: b0075 article-title: Opponent interactions between serotonin and dopamine publication-title: Neural Networks – volume: 67 start-page: 1 year: 1953 ident: b0465 article-title: Traumatic avoidance learning: acquisition in normal dogs publication-title: Psychol. Monographs: General Appl. – volume: 30 start-page: 535 year: 2007 end-page: 574 ident: b0165 article-title: The neural basis of decision making publication-title: Annu. Rev. Neurosci. – volume: 31 start-page: 7867 year: 2011 end-page: 7875 ident: b0190 article-title: Action dominates valence in anticipatory representations in the human striatum and dopaminergic midbrain publication-title: J. Neurosci.: Off. J. Soc. Neurosci. – volume: 303 start-page: 2040 year: 2004 end-page: 2042 ident: b0500 article-title: Uniform inhibition of dopamine neurons in the ventral tegmental area by aversive stimuli publication-title: Science – year: 1991 ident: b0105 article-title: 5-HT and mechanisms of defence publication-title: J. Psychopharmacol. – volume: 12 start-page: 301 year: 1969 end-page: 313 ident: b0330 article-title: Fixed-interval schedules of electric shock presentation: Extinction and recovery of performance under different shock intensities and fixed-interval durations 1 publication-title: J. Exp. Anal. Behav. – volume: 162 start-page: 635 year: 2015 end-page: 647 ident: b0270 article-title: Intact-brain analyses reveal distinct information carried by SNc dopamine subcircuits publication-title: Cell – volume: 500 start-page: 575 year: 2013 end-page: 579 ident: b0225 article-title: Prolonged dopamine signalling in striatum signals proximity and value of distant rewards publication-title: Nature – volume: 28 start-page: 7184 year: 2008 end-page: 7192 ident: b0125 article-title: Mesolimbic dopamine in desire and dread: enabling motivation to be generated by localized glutamate disruptions in nucleus accumbens publication-title: J. Neurosci. – volume: 482 start-page: 85 year: 2012 end-page: 90 ident: b0060 article-title: Neuron-type-specific signals for reward and punishment in the ventral tegmental area publication-title: Nature – volume: 34 start-page: 441 year: 2011 end-page: 466 ident: b0160 article-title: Modulation of striatal projection systems by dopamine publication-title: Annu. Rev. Neurosci. – volume: 16 start-page: 1936 year: 1996 end-page: 1947 ident: b0345 article-title: A framework for mesencephalic dopamine systems based on predictive hebbian learning publication-title: J. Neurosci. – volume: 19 start-page: 117 year: 2016 end-page: 126 ident: b0205 article-title: Mesolimbic dopamine signals the value of work publication-title: Nat. Neurosci. – volume: 7 start-page: 13154 year: 2016 ident: b0150 article-title: Phasic dopamine release in the rat nucleus accumbens predicts approach and avoidance performance publication-title: Nature Commun. – volume: 10 start-page: 1020 year: 2007 end-page: 1028 ident: b0080 article-title: Associative learning mediates dynamic shifts in dopamine signaling in the nucleus accumbens publication-title: Nat. Neurosci. – volume: 60 start-page: 543 year: 2008 end-page: 554 ident: b0255 article-title: Striatal plasticity and basal ganglia function publication-title: Neuron – volume: 6 start-page: 123 year: 2016 end-page: 148 ident: b0475 article-title: Striatal dopamine neurotransmission: regulation of release and uptake publication-title: Basal Ganglia – volume: 6 start-page: 97 year: 1972 end-page: 139 ident: b0045 article-title: The avoidance learning problem publication-title: Psychol. Learn. Motivation – volume: 275 start-page: 1593 year: 1997 end-page: 1599 ident: b0440 article-title: A neural substrate of prediction and reward publication-title: Science – volume: 19 start-page: 137 year: 2008 end-page: 160 ident: b0355 article-title: A temporal difference account of avoidance learning publication-title: Network: Comput. Neural Syst. – volume: 86 start-page: 717 year: 2005 end-page: 730 ident: b0005 article-title: Neural bases of food-seeking: affect, arousal and reward in corticostriatolimbic circuits publication-title: Physiol. Behav. – volume: 137 start-page: 149 year: 2002 end-page: 163 ident: b0385 article-title: Nucleus accumbens dopamine depletion impairs both acquisition and performance of appetitive pavlovian approach behaviour: implications for mesoaccumbens dopamine function publication-title: Behav. Brain Res. – volume: 15 start-page: 483 year: 2008 end-page: 491 ident: b0275 article-title: Dopamine D1 and D2 receptors in the nucleus accumbens core and shell mediate Pavlovian-instrumental transfer publication-title: Learn. Memory – volume: 17 start-page: 102 year: 1947 end-page: 150 ident: b0360 article-title: On the dual nature of learning: a reinterpretation of conditioning and problem-solving publication-title: Harvard Educat. Rev. – volume: 38 start-page: 50 year: 2010 end-page: 67 ident: b0310 article-title: Two-factor theory, the actor-critic model, and conditioned avoidance publication-title: Learn. Behav. – year: 2018 ident: b0155 article-title: Dopamine signals related to appetitive and aversive avents in paradigms that manipulate reward and avoidability publication-title: Brain Res. – volume: 39 start-page: 247 year: 1992 end-page: 279 ident: b0030 article-title: Dopamine functions in appetitive and defensive behaviours publication-title: Prog. Neurobiol. – volume: 76 start-page: 351 year: 2014 end-page: 359 ident: b0265 article-title: Reward and aversion in a heterogeneous midbrain dopamine system publication-title: Neuropharmacology – volume: 19 start-page: 1153 year: 2006 end-page: 1160 ident: b0095 article-title: The misbehavior of value and the discipline of the will publication-title: Neural Networks – volume: 77 start-page: 32 year: 1970 end-page: 48 ident: b0040 article-title: Species-specific defense reactions and avoidance learning publication-title: Psychol. Rev. – volume: 46 start-page: 1027 year: 2016 end-page: 1035 ident: b0230 article-title: The specificity of pavlovian regulation is associated with recovery from depression publication-title: Psychol. Med. – volume: 32 start-page: 95 year: 2009 end-page: 126 ident: b0090 article-title: Serotonin in affective control publication-title: Annu. Rev. Neurosci. – volume: 32 start-page: 150 year: 1943 end-page: 155 ident: b0115 article-title: Discriminative conditioning, i: a discriminative property of conditioned anticipation publication-title: J. Exp. Psychol. – volume: 26 start-page: 423 year: 2003 end-page: 428 ident: b0320 article-title: A computational substrate for incentive salience publication-title: Trends Neurosci. – volume: 24 start-page: 2033 year: 2014 end-page: 2040 ident: b0340 article-title: Optogenetic activation of dorsal raphe serotonin neurons enhances patience for future rewards publication-title: Curr. Biol. – volume: 6 start-page: 173 year: 1983 end-page: 196 ident: b0020 article-title: The role of dopamine in locomotor activity and learning publication-title: Brain Res. Rev. – volume: 3 start-page: 9 year: 1988 end-page: 44 ident: b0480 article-title: Learning to predict by the methods of temporal differences publication-title: Machine Learn. – volume: 117 start-page: 84 year: 2015 end-page: 92 ident: b0210 article-title: Dynamic shaping of dopamine signals during probabilistic pavlovian conditioning publication-title: Neurobiol. Learn. Mem. – volume: 21 start-page: 3261 year: 2001 end-page: 3270 ident: b0410 article-title: Fear and feeding in the nucleus accumbens shell: rostrocaudal segregation of gaba-elicited defensive behavior versus eating behavior publication-title: J. Neurosci. – volume: 469 start-page: 53 year: 2011 end-page: 57 ident: b0130 article-title: A selective role for dopamine in stimulus-reward learning publication-title: Nature – volume: 1 start-page: 6 year: 2005 ident: b0375 article-title: Dopamine, uncertainty and TD learning publication-title: Behav. Brain Funct. – volume: 23 start-page: 3933 year: 2011 end-page: 3938 ident: b0180 article-title: Vigor in the face of fluctuating rates of reward: an experimental examination publication-title: J. Cognitive Neurosci. – volume: 86 start-page: 1145 year: 2015 end-page: 1157 ident: b0400 article-title: Role of dopamine neurons in reward and aversion: a synaptic plasticity perspective publication-title: Neuron – volume: 171 start-page: 1209 year: 2010 end-page: 1215 ident: b0445 article-title: Phasic responses in dorsal raphe serotonin neurons to noxious stimuli publication-title: Neuroscience – volume: 71 start-page: 427 year: 2009 end-page: 436 ident: b0495 article-title: Serotonin: modulator of a drive to withdraw publication-title: Brain Cognition – volume: 12 year: 2016 ident: b0295 article-title: Safety out of control: dopamine and defence publication-title: Behav. Brain Funct. – volume: 32 start-page: 14804 year: 2012 end-page: 14808 ident: b0380 article-title: Subsecond dopamine release in the nucleus accumbens predicts conditioned punishment and its successful avoidance publication-title: J. Neurosci. – year: 2009 ident: b0390 article-title: Causality: Models, reasoning, and inference (second edition) – volume: 12 start-page: 511 year: 1969 end-page: 520 ident: b0515 article-title: Auto-maintenance in the pigeon: sustained pecking despite contingent non-reinforcement publication-title: J. Exp. Anal. Behav. – volume: 18 start-page: 194 year: 2014 end-page: 202 ident: b0185 article-title: Action versus valence in decision making publication-title: Trends Cognitive Sci. – volume: 6 start-page: 16 year: 2014 end-page: 26 ident: b0510 article-title: A role for phasic dopamine release within the nucleus accumbens in encoding aversion: a review of the neurochemical literature publication-title: ACS Chem. Neurosci. – volume: 25 start-page: 306 year: 2015 end-page: 315 ident: b0135 article-title: Activation of dorsal raphe serotonergic neurons promotes waiting but is not reinforcing publication-title: Curr. Biol. – volume: 81 start-page: 1360 year: 2014 end-page: 1374 ident: b0285 article-title: Dorsal raphe neurons signal reward through 5-HT and glutamate publication-title: Neuron – volume: 31 start-page: 359 year: 2008 end-page: 387 ident: b0175 article-title: Habits, rituals, and the evaluative brain publication-title: Annu. Rev. Neurosci. – volume: 28 start-page: 85 year: 2005 end-page: 98 ident: b0010 article-title: Positive and negative reinforcement: should the distinction be preserved? publication-title: Behav. Anal. – volume: 459 start-page: 837 year: 2009 end-page: 841 ident: b0315 article-title: Two types of dopamine neuron distinctly convey positive and negative motivational signals publication-title: Nature – year: 1998 ident: b0485 article-title: Reinforcement Learning: An Introduction – volume: 113 start-page: 300 year: 2006 end-page: 326 ident: b0140 article-title: Anatomy of a decision: striato-orbitofrontal interactions in reinforcement learning, decision making, and reversal publication-title: Psychol. Rev. – volume: 135 start-page: 40 year: 2016 end-page: 49 ident: b0305 article-title: Do dorsal raphe 5-ht neurons encode beneficialness? publication-title: Neurobiol. Learn. Memory – volume: 19 start-page: 34 year: 2016 end-page: 36 ident: b0490 article-title: Action initiation shapes mesolimbic dopamine encoding of future rewards publication-title: Nat. Neurosci. – volume: 29 start-page: 1735 year: 2009 end-page: 1742 ident: b0470 article-title: Synaptic overflow of dopamine in the nucleus accumbens arises from neuronal activity in the ventral tegmental area publication-title: J. Neurosci. – volume: 18 start-page: 1637 year: 2006 end-page: 1677 ident: b0070 article-title: Representation and timing in theories of the dopamine system publication-title: Neural Comput. – volume: 9 start-page: 2477 year: 2018 ident: b0235 article-title: An effect of serotonergic stimulation on learning rates for rewards apparent after long intertrial intervals publication-title: Nature Commun. – volume: 23 start-page: 229 year: 2013 end-page: 238 ident: b0435 article-title: Updating dopamine reward signals publication-title: Curr. Opin. Neurobiol. – volume: 379 start-page: 449 year: 1996 end-page: 451 ident: b0335 article-title: Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli publication-title: Nature – volume: 36 start-page: 74 year: 2010 end-page: 97 ident: b0050 article-title: Opponency revisited: competition and cooperation between dopamine and serotonin publication-title: Neuropsychopharmacology – volume: 191 start-page: 461 year: 2007 end-page: 482 ident: b0425 article-title: Effort-related functions of nucleus accumbens dopamine and associated forebrain circuits publication-title: Psychopharmacology – volume: 15 start-page: 816 year: 2012 end-page: 819 ident: b0250 article-title: Distinct roles for direct and indirect pathway striatal neurons in reinforcement publication-title: Nat. Neurosci. – volume: 39 start-page: 43 year: 1988 end-page: 68 ident: b0035 article-title: Ethoexperimental approaches to the biology of emotion publication-title: Annu. Rev. Psychol. – volume: 61 start-page: 34 year: 1954 end-page: 46 ident: b0110 article-title: Punishment: I. the avoidance hypothesis publication-title: Psychol. Rev. – volume: 9 start-page: 163 year: 2015 ident: b0145 article-title: Individual differences in the influence of task-irrelevant pavlovian cues on human behavior publication-title: Front. Behav. Neurosci. – volume: 63 start-page: 114 year: 1956 end-page: 128 ident: b0365 article-title: Two-factor learning theory reconsidered, with special reference to secondary reinforcement and the concept of habit publication-title: Psychol. Rev. – volume: 30 start-page: 10507 year: 2010 end-page: 10516 ident: b0455 article-title: Temporal discounting of reward and the cost of time in motor control publication-title: J. Neurosci. – volume: 442 start-page: 1042 year: 2006 end-page: 1045 ident: b0395 article-title: Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans publication-title: Nature – volume: 76 start-page: 470 year: 2012 end-page: 485 ident: b0420 article-title: The mysterious motivational functions of mesolimbic dopamine publication-title: Neuron – volume: 9 start-page: 1000 year: 2018 ident: b0300 article-title: Activation of serotonin neurons promotes active persistence in a probabilistic foraging task publication-title: Nature Commun. – year: 2018 ident: b0405 article-title: A transient dopamine signal represents avoidance value and causally influences the demand to avoid publication-title: eNeuro – volume: 29 start-page: 135 year: 2006 end-page: 139 ident: b0460 article-title: The distinction between positive and negative reinforcement: some additional considerations publication-title: Behav. Anal. – volume: 86 start-page: 5508 year: 2014 end-page: 5512 ident: b0520 article-title: Turn-on fluorescent dopamine sensing based on in situ formation of visible light emitting polydopamine nanoparticles publication-title: Anal. Chem. – volume: 9 start-page: 91 year: 2001 end-page: 104 ident: b0240 article-title: A computational model of learned avoidance behavior in a one-way avoidance experiment publication-title: Adaptive Behav. – volume: 258 start-page: 340 year: 2014 end-page: 346 ident: b0280 article-title: Nucleus accumbens core lesions enhance two-way active avoidance publication-title: Neuroscience – volume: 3 start-page: 9 issue: 1 year: 1988 ident: 10.1016/j.brainres.2018.10.011_b0480 article-title: Learning to predict by the methods of temporal differences publication-title: Machine Learn. doi: 10.1007/BF00115009 – volume: 81 start-page: 1360 issue: 6 year: 2014 ident: 10.1016/j.brainres.2018.10.011_b0285 article-title: Dorsal raphe neurons signal reward through 5-HT and glutamate publication-title: Neuron doi: 10.1016/j.neuron.2014.02.010 – year: 2018 ident: 10.1016/j.brainres.2018.10.011_b0155 article-title: Dopamine signals related to appetitive and aversive avents in paradigms that manipulate reward and avoidability publication-title: Brain Res. – volume: 31 start-page: 359 year: 2008 ident: 10.1016/j.brainres.2018.10.011_b0175 article-title: Habits, rituals, and the evaluative brain publication-title: Annu. Rev. Neurosci. doi: 10.1146/annurev.neuro.29.051605.112851 – volume: 86 start-page: 1145 issue: 5 year: 2015 ident: 10.1016/j.brainres.2018.10.011_b0400 article-title: Role of dopamine neurons in reward and aversion: a synaptic plasticity perspective publication-title: Neuron doi: 10.1016/j.neuron.2015.04.015 – volume: 442 start-page: 1042 year: 2006 ident: 10.1016/j.brainres.2018.10.011_b0395 article-title: Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans publication-title: Nature doi: 10.1038/nature05051 – volume: 36 start-page: 74 issue: 1 year: 2010 ident: 10.1016/j.brainres.2018.10.011_b0050 article-title: Opponency revisited: competition and cooperation between dopamine and serotonin publication-title: Neuropsychopharmacology doi: 10.1038/npp.2010.151 – volume: 43 start-page: 1425 year: 2018 ident: 10.1016/j.brainres.2018.10.011_b0350 article-title: The protective action encoding of serotonin transients in the human brain publication-title: Neuropsychopharmacol.: Off. Publ. Am. College Neuropsychopharmacology doi: 10.1038/npp.2017.304 – volume: 32 start-page: 14804 issue: 42 year: 2012 ident: 10.1016/j.brainres.2018.10.011_b0380 article-title: Subsecond dopamine release in the nucleus accumbens predicts conditioned punishment and its successful avoidance publication-title: J. Neurosci. doi: 10.1523/JNEUROSCI.3087-12.2012 – volume: 9 start-page: 1000 year: 2018 ident: 10.1016/j.brainres.2018.10.011_b0300 article-title: Activation of serotonin neurons promotes active persistence in a probabilistic foraging task publication-title: Nature Commun. doi: 10.1038/s41467-018-03438-y – volume: 14 start-page: 443 year: 1986 ident: 10.1016/j.brainres.2018.10.011_b0220 article-title: An approach through the looking-glass publication-title: Animal Learn. Behav. doi: 10.3758/BF03200092 – year: 1991 ident: 10.1016/j.brainres.2018.10.011_b0105 article-title: 5-HT and mechanisms of defence publication-title: J. Psychopharmacol. – volume: 34 start-page: 698 issue: 3 year: 2014 ident: 10.1016/j.brainres.2018.10.011_b0215 article-title: Phasic dopamine release in the rat nucleus accumbens symmetrically encodes a reward prediction error term publication-title: J. Neurosci. doi: 10.1523/JNEUROSCI.2489-13.2014 – volume: 32 start-page: 150 year: 1943 ident: 10.1016/j.brainres.2018.10.011_b0115 article-title: Discriminative conditioning, i: a discriminative property of conditioned anticipation publication-title: J. Exp. Psychol. doi: 10.1037/h0058316 – volume: 11 start-page: e1004622 issue: 12 year: 2015 ident: 10.1016/j.brainres.2018.10.011_b0290 article-title: Tamping ramping: algorithmic, implementational, and computational explanations of phasic dopamine signals in the accumbens publication-title: PLoS Comput. Biol. doi: 10.1371/journal.pcbi.1004622 – volume: 135 start-page: 40 year: 2016 ident: 10.1016/j.brainres.2018.10.011_b0305 article-title: Do dorsal raphe 5-ht neurons encode beneficialness? publication-title: Neurobiol. Learn. Memory doi: 10.1016/j.nlm.2016.08.008 – volume: 9 start-page: 91 issue: 2 year: 2001 ident: 10.1016/j.brainres.2018.10.011_b0240 article-title: A computational model of learned avoidance behavior in a one-way avoidance experiment publication-title: Adaptive Behav. doi: 10.1177/105971230200900205 – volume: 9 start-page: 163 year: 2015 ident: 10.1016/j.brainres.2018.10.011_b0145 article-title: Individual differences in the influence of task-irrelevant pavlovian cues on human behavior publication-title: Front. Behav. Neurosci. doi: 10.3389/fnbeh.2015.00163 – volume: 19 start-page: 1153 issue: 8 year: 2006 ident: 10.1016/j.brainres.2018.10.011_b0095 article-title: The misbehavior of value and the discipline of the will publication-title: Neural Networks doi: 10.1016/j.neunet.2006.03.002 – volume: Vol. 2 start-page: 149 year: 1983 ident: 10.1016/j.brainres.2018.10.011_b0100 article-title: Roles of serotonergic systems in escape, avoidance and other behaviours – volume: 113 start-page: 300 issue: 2 year: 2006 ident: 10.1016/j.brainres.2018.10.011_b0140 article-title: Anatomy of a decision: striato-orbitofrontal interactions in reinforcement learning, decision making, and reversal publication-title: Psychol. Rev. doi: 10.1037/0033-295X.113.2.300 – volume: 77 start-page: 32 issue: 1 year: 1970 ident: 10.1016/j.brainres.2018.10.011_b0040 article-title: Species-specific defense reactions and avoidance learning publication-title: Psychol. Rev. doi: 10.1037/h0028589 – volume: 32 start-page: 95 year: 2009 ident: 10.1016/j.brainres.2018.10.011_b0090 article-title: Serotonin in affective control publication-title: Annu. Rev. Neurosci. doi: 10.1146/annurev.neuro.051508.135607 – year: 2018 ident: 10.1016/j.brainres.2018.10.011_b0405 article-title: A transient dopamine signal represents avoidance value and causally influences the demand to avoid publication-title: eNeuro doi: 10.1523/ENEURO.0058-18.2018 – volume: 31 start-page: 7867 year: 2011 ident: 10.1016/j.brainres.2018.10.011_b0190 article-title: Action dominates valence in anticipatory representations in the human striatum and dopaminergic midbrain publication-title: J. Neurosci.: Off. J. Soc. Neurosci. doi: 10.1523/JNEUROSCI.6376-10.2011 – volume: 76 start-page: 351 year: 2014 ident: 10.1016/j.brainres.2018.10.011_b0265 article-title: Reward and aversion in a heterogeneous midbrain dopamine system publication-title: Neuropharmacology doi: 10.1016/j.neuropharm.2013.03.019 – volume: 13 start-page: 1984 issue: 10 year: 2001 ident: 10.1016/j.brainres.2018.10.011_b0200 article-title: Involvement of the central nucleus of the amygdala and nucleus accumbens core in mediating pavlovian influences on instrumental behaviour publication-title: Eur. J. Neurosci. doi: 10.1046/j.0953-816x.2001.01577.x – volume: 39 start-page: 247 year: 1992 ident: 10.1016/j.brainres.2018.10.011_b0030 article-title: Dopamine functions in appetitive and defensive behaviours publication-title: Prog. Neurobiol. doi: 10.1016/0301-0082(92)90018-A – volume: 191 start-page: 507 issue: 3 year: 2007 ident: 10.1016/j.brainres.2018.10.011_b0370 article-title: Tonic dopamine: opportunity costs and the control of response vigor publication-title: Psychopharmacology doi: 10.1007/s00213-006-0502-4 – year: 2009 ident: 10.1016/j.brainres.2018.10.011_b0390 – volume: 15 start-page: 816 issue: 6 year: 2012 ident: 10.1016/j.brainres.2018.10.011_b0250 article-title: Distinct roles for direct and indirect pathway striatal neurons in reinforcement publication-title: Nat. Neurosci. doi: 10.1038/nn.3100 – volume: 54 start-page: 129 issue: 1 year: 1996 ident: 10.1016/j.brainres.2018.10.011_b0170 article-title: Role of 5-HT in stress, anxiety, and depression publication-title: Pharmacol. Biochem. Behav. doi: 10.1016/0091-3057(95)02135-3 – volume: 29 start-page: 135 issue: 1 year: 2006 ident: 10.1016/j.brainres.2018.10.011_b0460 article-title: The distinction between positive and negative reinforcement: some additional considerations publication-title: Behav. Anal. doi: 10.1007/BF03392126 – volume: 15 start-page: 549 year: 2002 ident: 10.1016/j.brainres.2018.10.011_b0245 article-title: Dopamine: generalization and bonuses publication-title: Neural Networks doi: 10.1016/S0893-6080(02)00048-5 – volume: 63 start-page: 114 issue: 2 year: 1956 ident: 10.1016/j.brainres.2018.10.011_b0365 article-title: Two-factor learning theory reconsidered, with special reference to secondary reinforcement and the concept of habit publication-title: Psychol. Rev. doi: 10.1037/h0040613 – volume: 15 start-page: 483 year: 2008 ident: 10.1016/j.brainres.2018.10.011_b0275 article-title: Dopamine D1 and D2 receptors in the nucleus accumbens core and shell mediate Pavlovian-instrumental transfer publication-title: Learn. Memory doi: 10.1101/lm.978708 – year: 1998 ident: 10.1016/j.brainres.2018.10.011_b0485 – volume: 191 start-page: 461 year: 2007 ident: 10.1016/j.brainres.2018.10.011_b0425 article-title: Effort-related functions of nucleus accumbens dopamine and associated forebrain circuits publication-title: Psychopharmacology doi: 10.1007/s00213-006-0668-9 – volume: 86 start-page: 5508 year: 2014 ident: 10.1016/j.brainres.2018.10.011_b0520 article-title: Turn-on fluorescent dopamine sensing based on in situ formation of visible light emitting polydopamine nanoparticles publication-title: Anal. Chem. doi: 10.1021/ac500771q – volume: 29 start-page: 1735 issue: 6 year: 2009 ident: 10.1016/j.brainres.2018.10.011_b0470 article-title: Synaptic overflow of dopamine in the nucleus accumbens arises from neuronal activity in the ventral tegmental area publication-title: J. Neurosci. doi: 10.1523/JNEUROSCI.5562-08.2009 – volume: 30 start-page: 535 year: 2007 ident: 10.1016/j.brainres.2018.10.011_b0165 article-title: The neural basis of decision making publication-title: Annu. Rev. Neurosci. doi: 10.1146/annurev.neuro.29.051605.113038 – volume: 4 year: 2015 ident: 10.1016/j.brainres.2018.10.011_b0055 article-title: Serotonergic neurons signal reward and punishment on multiple timescales publication-title: eLife doi: 10.7554/eLife.06346 – volume: 34 start-page: 441 year: 2011 ident: 10.1016/j.brainres.2018.10.011_b0160 article-title: Modulation of striatal projection systems by dopamine publication-title: Annu. Rev. Neurosci. doi: 10.1146/annurev-neuro-061010-113641 – volume: 12 start-page: 301 issue: 2 year: 1969 ident: 10.1016/j.brainres.2018.10.011_b0330 article-title: Fixed-interval schedules of electric shock presentation: Extinction and recovery of performance under different shock intensities and fixed-interval durations 1 publication-title: J. Exp. Anal. Behav. doi: 10.1901/jeab.1969.12-301 – start-page: 185 year: 1988 ident: 10.1016/j.brainres.2018.10.011_b0120 article-title: A functional behavioristic approach to aversive motivated behavior: Predatory imminence as a determinant of the topography of defensive behavior – volume: 6 start-page: 123 issue: 3 year: 2016 ident: 10.1016/j.brainres.2018.10.011_b0475 article-title: Striatal dopamine neurotransmission: regulation of release and uptake publication-title: Basal Ganglia doi: 10.1016/j.baga.2016.02.001 – volume: 12 issue: 15 year: 2016 ident: 10.1016/j.brainres.2018.10.011_b0295 article-title: Safety out of control: dopamine and defence publication-title: Behav. Brain Funct. – volume: 7 start-page: 13154 year: 2016 ident: 10.1016/j.brainres.2018.10.011_b0150 article-title: Phasic dopamine release in the rat nucleus accumbens predicts approach and avoidance performance publication-title: Nature Commun. doi: 10.1038/ncomms13154 – volume: 469 start-page: 53 issue: 7328 year: 2011 ident: 10.1016/j.brainres.2018.10.011_b0130 article-title: A selective role for dopamine in stimulus-reward learning publication-title: Nature doi: 10.1038/nature09588 – volume: 18 start-page: 194 issue: 4 year: 2014 ident: 10.1016/j.brainres.2018.10.011_b0185 article-title: Action versus valence in decision making publication-title: Trends Cognitive Sci. doi: 10.1016/j.tics.2014.01.003 – volume: 46 start-page: 1027 year: 2016 ident: 10.1016/j.brainres.2018.10.011_b0230 article-title: The specificity of pavlovian regulation is associated with recovery from depression publication-title: Psychol. Med. doi: 10.1017/S0033291715002597 – volume: 15 start-page: 603 year: 2002 ident: 10.1016/j.brainres.2018.10.011_b0075 article-title: Opponent interactions between serotonin and dopamine publication-title: Neural Networks doi: 10.1016/S0893-6080(02)00052-7 – volume: 28 start-page: 309 issue: 3 year: 1998 ident: 10.1016/j.brainres.2018.10.011_b0025 article-title: What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience? publication-title: Brain Res. Rev. doi: 10.1016/S0165-0173(98)00019-8 – volume: 24 start-page: 2033 issue: 17 year: 2014 ident: 10.1016/j.brainres.2018.10.011_b0340 article-title: Optogenetic activation of dorsal raphe serotonin neurons enhances patience for future rewards publication-title: Curr. Biol. doi: 10.1016/j.cub.2014.07.041 – volume: 21 start-page: 3261 issue: 9 year: 2001 ident: 10.1016/j.brainres.2018.10.011_b0410 article-title: Fear and feeding in the nucleus accumbens shell: rostrocaudal segregation of gaba-elicited defensive behavior versus eating behavior publication-title: J. Neurosci. doi: 10.1523/JNEUROSCI.21-09-03261.2001 – volume: 35 start-page: 1152 issue: 7 year: 2012 ident: 10.1016/j.brainres.2018.10.011_b0085 article-title: Instrumental vigour in punishment and reward publication-title: Eur. J. Neurosci. doi: 10.1111/j.1460-9568.2012.08026.x – volume: 40 start-page: 373 year: 2017 ident: 10.1016/j.brainres.2018.10.011_b0505 article-title: Neural circuitry of reward prediction error publication-title: Annu. Rev. Neurosci. doi: 10.1146/annurev-neuro-072116-031109 – volume: 25 start-page: 306 issue: 3 year: 2015 ident: 10.1016/j.brainres.2018.10.011_b0135 article-title: Activation of dorsal raphe serotonergic neurons promotes waiting but is not reinforcing publication-title: Curr. Biol. doi: 10.1016/j.cub.2014.12.002 – volume: 62 start-page: 154 year: 2012 ident: 10.1016/j.brainres.2018.10.011_b0195 article-title: Go and no-go learning in reward and punishment: Interactions between affect and effect publication-title: NeuroImage doi: 10.1016/j.neuroimage.2012.04.024 – volume: 258 start-page: 340 year: 2014 ident: 10.1016/j.brainres.2018.10.011_b0280 article-title: Nucleus accumbens core lesions enhance two-way active avoidance publication-title: Neuroscience doi: 10.1016/j.neuroscience.2013.11.028 – volume: 23 start-page: 229 year: 2013 ident: 10.1016/j.brainres.2018.10.011_b0435 article-title: Updating dopamine reward signals publication-title: Curr. Opin. Neurobiol. doi: 10.1016/j.conb.2012.11.012 – volume: 71 start-page: 427 year: 2009 ident: 10.1016/j.brainres.2018.10.011_b0495 article-title: Serotonin: modulator of a drive to withdraw publication-title: Brain Cognition doi: 10.1016/j.bandc.2009.03.009 – volume: 6 year: 2012 ident: 10.1016/j.brainres.2018.10.011_b0325 article-title: Encoding of aversion by dopamine and the nucleus accumbens publication-title: Front. Neurosci. doi: 10.3389/fnins.2012.00137 – volume: 117 start-page: 84 year: 2015 ident: 10.1016/j.brainres.2018.10.011_b0210 article-title: Dynamic shaping of dopamine signals during probabilistic pavlovian conditioning publication-title: Neurobiol. Learn. Mem. doi: 10.1016/j.nlm.2014.07.010 – volume: 67 start-page: 1 issue: 4 year: 1953 ident: 10.1016/j.brainres.2018.10.011_b0465 article-title: Traumatic avoidance learning: acquisition in normal dogs publication-title: Psychol. Monographs: General Appl. doi: 10.1037/h0093649 – volume: 17 start-page: 102 year: 1947 ident: 10.1016/j.brainres.2018.10.011_b0360 article-title: On the dual nature of learning: a reinterpretation of conditioning and problem-solving publication-title: Harvard Educat. Rev. – volume: 30 start-page: 10507 issue: 31 year: 2010 ident: 10.1016/j.brainres.2018.10.011_b0455 article-title: Temporal discounting of reward and the cost of time in motor control publication-title: J. Neurosci. doi: 10.1523/JNEUROSCI.1343-10.2010 – volume: 6 start-page: 16 issue: 1 year: 2014 ident: 10.1016/j.brainres.2018.10.011_b0510 article-title: A role for phasic dopamine release within the nucleus accumbens in encoding aversion: a review of the neurochemical literature publication-title: ACS Chem. Neurosci. doi: 10.1021/cn500255p – volume: 19 start-page: 117 issue: 1 year: 2016 ident: 10.1016/j.brainres.2018.10.011_b0205 article-title: Mesolimbic dopamine signals the value of work publication-title: Nat. Neurosci. doi: 10.1038/nn.4173 – volume: 76 start-page: 470 year: 2012 ident: 10.1016/j.brainres.2018.10.011_b0420 article-title: The mysterious motivational functions of mesolimbic dopamine publication-title: Neuron doi: 10.1016/j.neuron.2012.10.021 – volume: 482 start-page: 85 year: 2012 ident: 10.1016/j.brainres.2018.10.011_b0060 article-title: Neuron-type-specific signals for reward and punishment in the ventral tegmental area publication-title: Nature doi: 10.1038/nature10754 – volume: 12 start-page: 511 year: 1969 ident: 10.1016/j.brainres.2018.10.011_b0515 article-title: Auto-maintenance in the pigeon: sustained pecking despite contingent non-reinforcement publication-title: J. Exp. Anal. Behav. doi: 10.1901/jeab.1969.12-511 – volume: 459 start-page: 837 year: 2009 ident: 10.1016/j.brainres.2018.10.011_b0315 article-title: Two types of dopamine neuron distinctly convey positive and negative motivational signals publication-title: Nature doi: 10.1038/nature08028 – volume: 28 start-page: 85 issue: 2 year: 2005 ident: 10.1016/j.brainres.2018.10.011_b0010 article-title: Positive and negative reinforcement: should the distinction be preserved? publication-title: Behav. Anal. doi: 10.1007/BF03392107 – volume: 379 start-page: 449 year: 1996 ident: 10.1016/j.brainres.2018.10.011_b0335 article-title: Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli publication-title: Nature doi: 10.1038/379449a0 – volume: 1 start-page: 6 issue: 1 year: 2005 ident: 10.1016/j.brainres.2018.10.011_b0375 article-title: Dopamine, uncertainty and TD learning publication-title: Behav. Brain Funct. doi: 10.1186/1744-9081-1-6 – volume: 275 start-page: 1593 year: 1997 ident: 10.1016/j.brainres.2018.10.011_b0440 article-title: A neural substrate of prediction and reward publication-title: Science doi: 10.1126/science.275.5306.1593 – volume: 303 start-page: 2040 issue: 5666 year: 2004 ident: 10.1016/j.brainres.2018.10.011_b0500 article-title: Uniform inhibition of dopamine neurons in the ventral tegmental area by aversive stimuli publication-title: Science doi: 10.1126/science.1093360 – volume: 16 start-page: 1936 issue: 5 year: 1996 ident: 10.1016/j.brainres.2018.10.011_b0345 article-title: A framework for mesencephalic dopamine systems based on predictive hebbian learning publication-title: J. Neurosci. doi: 10.1523/JNEUROSCI.16-05-01936.1996 – volume: 19 start-page: 137 issue: 2 year: 2008 ident: 10.1016/j.brainres.2018.10.011_b0355 article-title: A temporal difference account of avoidance learning publication-title: Network: Comput. Neural Syst. doi: 10.1080/09548980802192784 – volume: 18 start-page: 1637 year: 2006 ident: 10.1016/j.brainres.2018.10.011_b0070 article-title: Representation and timing in theories of the dopamine system publication-title: Neural Comput. doi: 10.1162/neco.2006.18.7.1637 – volume: 28 start-page: 7184 issue: 28 year: 2008 ident: 10.1016/j.brainres.2018.10.011_b0125 article-title: Mesolimbic dopamine in desire and dread: enabling motivation to be generated by localized glutamate disruptions in nucleus accumbens publication-title: J. Neurosci. doi: 10.1523/JNEUROSCI.4961-07.2008 – volume: 23 start-page: 3933 issue: 12 year: 2011 ident: 10.1016/j.brainres.2018.10.011_b0180 article-title: Vigor in the face of fluctuating rates of reward: an experimental examination publication-title: J. Cognitive Neurosci. doi: 10.1162/jocn_a_00090 – volume: 60 start-page: 543 issue: 4 year: 2008 ident: 10.1016/j.brainres.2018.10.011_b0255 article-title: Striatal plasticity and basal ganglia function publication-title: Neuron doi: 10.1016/j.neuron.2008.11.005 – volume: 57 start-page: 760 year: 2008 ident: 10.1016/j.brainres.2018.10.011_b0260 article-title: Unique properties of mesoprefrontal neurons within a dual mesocorticolimbic dopamine system publication-title: Neuron doi: 10.1016/j.neuron.2008.01.022 – volume: 6 start-page: 173 year: 1983 ident: 10.1016/j.brainres.2018.10.011_b0020 article-title: The role of dopamine in locomotor activity and learning publication-title: Brain Res. Rev. doi: 10.1016/0165-0173(83)90038-3 – volume: 19 start-page: 34 issue: 1 year: 2016 ident: 10.1016/j.brainres.2018.10.011_b0490 article-title: Action initiation shapes mesolimbic dopamine encoding of future rewards publication-title: Nat. Neurosci. doi: 10.1038/nn.4187 – volume: 500 start-page: 575 year: 2013 ident: 10.1016/j.brainres.2018.10.011_b0225 article-title: Prolonged dopamine signalling in striatum signals proximity and value of distant rewards publication-title: Nature doi: 10.1038/nature12475 – volume: 10 start-page: 1020 issue: 8 year: 2007 ident: 10.1016/j.brainres.2018.10.011_b0080 article-title: Associative learning mediates dynamic shifts in dopamine signaling in the nucleus accumbens publication-title: Nat. Neurosci. doi: 10.1038/nn1923 – volume: 38 start-page: 1495 year: 2013 ident: 10.1016/j.brainres.2018.10.011_b0015 article-title: Dopamine modulates reward-related vigor publication-title: Neuropsychopharmacology doi: 10.1038/npp.2013.48 – volume: 162 start-page: 635 issue: 3 year: 2015 ident: 10.1016/j.brainres.2018.10.011_b0270 article-title: Intact-brain analyses reveal distinct information carried by SNc dopamine subcircuits publication-title: Cell doi: 10.1016/j.cell.2015.07.014 – volume: 39 start-page: 43 year: 1988 ident: 10.1016/j.brainres.2018.10.011_b0035 article-title: Ethoexperimental approaches to the biology of emotion publication-title: Annu. Rev. Psychol. doi: 10.1146/annurev.ps.39.020188.000355 – volume: 137 start-page: 149 issue: 1 year: 2002 ident: 10.1016/j.brainres.2018.10.011_b0385 article-title: Nucleus accumbens dopamine depletion impairs both acquisition and performance of appetitive pavlovian approach behaviour: implications for mesoaccumbens dopamine function publication-title: Behav. Brain Res. doi: 10.1016/S0166-4328(02)00291-7 – volume: 6 start-page: 97 year: 1972 ident: 10.1016/j.brainres.2018.10.011_b0045 article-title: The avoidance learning problem publication-title: Psychol. Learn. Motivation doi: 10.1016/S0079-7421(08)60385-0 – volume: 61 start-page: 34 year: 1954 ident: 10.1016/j.brainres.2018.10.011_b0110 article-title: Punishment: I. the avoidance hypothesis publication-title: Psychol. Rev. doi: 10.1037/h0062725 – volume: 38 start-page: 50 issue: 1 year: 2010 ident: 10.1016/j.brainres.2018.10.011_b0310 article-title: Two-factor theory, the actor-critic model, and conditioned avoidance publication-title: Learn. Behav. doi: 10.3758/LB.38.1.50 – volume: 86 start-page: 717 issue: 5 year: 2005 ident: 10.1016/j.brainres.2018.10.011_b0005 article-title: Neural bases of food-seeking: affect, arousal and reward in corticostriatolimbic circuits publication-title: Physiol. Behav. doi: 10.1016/j.physbeh.2005.08.061 – volume: 9 start-page: 2477 year: 2018 ident: 10.1016/j.brainres.2018.10.011_b0235 article-title: An effect of serotonergic stimulation on learning rates for rewards apparent after long intertrial intervals publication-title: Nature Commun. doi: 10.1038/s41467-018-04840-2 – volume: 23 start-page: 9913 issue: 30 year: 2003 ident: 10.1016/j.brainres.2018.10.011_b0430 article-title: Correlated coding of motivation and outcome of decision by dopamine neurons publication-title: J. Neurosci. doi: 10.1523/JNEUROSCI.23-30-09913.2003 – volume: 29 start-page: 11993 issue: 38 year: 2009 ident: 10.1016/j.brainres.2018.10.011_b0065 article-title: Reconciling the role of serotonin in behavioral inhibition and aversion: acute tryptophan depletion abolishes punishment-induced inhibition in humans publication-title: J. Neurosci. doi: 10.1523/JNEUROSCI.2513-09.2009 – volume: 171 start-page: 1209 year: 2010 ident: 10.1016/j.brainres.2018.10.011_b0445 article-title: Phasic responses in dorsal raphe serotonin neurons to noxious stimuli publication-title: Neuroscience doi: 10.1016/j.neuroscience.2010.09.058 – volume: 26 start-page: 423 issue: 8 year: 2003 ident: 10.1016/j.brainres.2018.10.011_b0320 article-title: A computational substrate for incentive salience publication-title: Trends Neurosci. doi: 10.1016/S0166-2236(03)00177-2 – volume: 76 start-page: 450 issue: Pt B year: 2014 ident: 10.1016/j.brainres.2018.10.011_b0415 article-title: On the motivational properties of reward cues: Individual differences publication-title: Neuropharmacology doi: 10.1016/j.neuropharm.2013.05.040 – volume: 116 start-page: 267 year: 2002 ident: 10.1016/j.brainres.2018.10.011_b0450 article-title: Disconnection of the basolateral amygdala complex and nucleus accumbens impairs appetitive pavlovian second-order conditioned responses publication-title: Behav. Neurosci. doi: 10.1037/0735-7044.116.2.267 |
| SSID | ssj0003390 |
| Score | 2.3182707 |
| Snippet | •Computational model of behaviour and dopamine in the approach-avoidance task of Gentry et al. (2016).•Good avoidance of shock is accounted for by purely... In active avoidance tasks, subjects have to learn to execute particular actions in order to avoid an aversive stimulus, such as a shock. Such paradigms pose a... |
| SourceID | proquest pubmed crossref elsevier |
| SourceType | Aggregation Database Index Database Enrichment Source Publisher |
| StartPage | 52 |
| SubjectTerms | Active avoidance Dopamine Nucleus accumbens Pavlovian misbehavior |
| Title | Pavlovian-instrumental interactions in active avoidance: The bark of neutral trials |
| URI | https://www.clinicalkey.com/#!/content/1-s2.0-S0006899318305158 https://dx.doi.org/10.1016/j.brainres.2018.10.011 https://www.ncbi.nlm.nih.gov/pubmed/30308188 https://www.proquest.com/docview/2119934778 |
| Volume | 1713 |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV1La9tAEB5i59JLaeukdR9mCyE32ZZW2l31ZkyD-4gxbQy-iV3tCuSkUkhsQy_97Z3Rw7QH40KPEhokjb6dx2rmG4ALZ4y2gcCVZn3uhSaOPJ1x4ykMkWQY83Fa8Wxfz8VsGX5eRasTmLa9MFRW2dj-2qZX1ro5M2q0ObrPc-rxHQvMFgiUNKhEdeA04LGIunA6-fRlNt8bZM7rrRZKnkngj0bh9dDQJAbMbKnKSw2p0Mv3D_moQzFo5YuunsHTJohkk_o5n8OJK15Ab1JgAv3jJ7tkVVlntV_eg-8Lvbsrd4gCL6_YYms2f0Y8EQ91V8MjHjBdGT6md2VuCQkfGCKIGf1wy8qMFW5LWyKsGvLxeAbLq48305nXTFLwUgyXNp4l1kH0S1kmrTOhcEpzQVRlkluutYhMGqhUG6u0EFYpHegMVzZ6NSVDlYX8HLpFWbhXwNCtZZGjRMmY0HLEgAwEsfiZ2Agxln2IWt0laUMzTtMu7pK2nmydtDpPSOd0HnXeh9Fe7r4m2jgqIdtPk7RtpGj4EvQFRyXjveRfYPsn2fctChJcifR7RReu3OJFPhVDhlKqPrys4bF_E060QL5Sr__jzm_gCR4RZ4TnR2-hi4hx7zAi2pgBdIa__AHifvrt62LQ4P833RUM7Q |
| linkProvider | Elsevier |
| linkToHtml | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV1LSwMxEB60HvQivq3PCOJtbbfJJqm3Ikp9FUEFb0uyyUKr7oqPgv_emX0UPYiCx8122O30yzzSmW8A9r21xnUk7jQX8kDYbhSYlNtAY4ikRJe3k4Jn-2og-3fi_D66n4LjuheGyior21_a9MJaVyutSput5-GQenzbErMFAiUNKtHTMCMizPYaMNM7u-gPJgaZ8_KohZJnEvjSKDw6tDSJATNbqvLSh1ToFYY_-aifYtDCF50uwHwVRLJe-Z6LMOWzJVjuZZhAP32wA1aUdRbn5ctwc23Gj_kYURAMC7bYks2fEU_ES9nV8IoXzBSGj5lxPnSEhCOGCGLWvDywPGWZf6cjEVYM-XhdgbvTk9vjflBNUggSDJfeAkesg-iX0lQ5b4X02nBJVGWKO26MjGzS0YmxThspndamY1Lc2ejVtBI6FXwVGlme-XVg6NbSyFOiZK1wHDGgOpJY_GzXStlWTYhq3cVJRTNO0y4e47qebBTXOo9J57SOOm9CayL3XBJt_Cqh6p8mrttI0fDF6At-lexOJL-B7U-yezUKYtyJ9PeKyXz-jh8KqRhSKKWbsFbCY_JNONEChVpv_OPJuzDbv726jC_PBhebMId3iD8iCKMtaCB6_DZGR292p0L_J-J8DUc |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Pavlovian-instrumental+interactions+in+active+avoidance%3A+The+bark+of+neutral+trials&rft.jtitle=Brain+research&rft.au=Lloyd%2C+Kevin&rft.au=Dayan%2C+Peter&rft.date=2019-06-15&rft.issn=0006-8993&rft.volume=1713&rft.spage=52&rft.epage=61&rft_id=info:doi/10.1016%2Fj.brainres.2018.10.011&rft.externalDBID=n%2Fa&rft.externalDocID=10_1016_j_brainres_2018_10_011 |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0006-8993&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0006-8993&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0006-8993&client=summon |