Dopamine, uncertainty and TD learning
Substantial evidence suggests that the phasic activities of dopaminergic neurons in the primate midbrain represent a temporal difference (TD) error in predictions of future reward, with increases above and decreases below baseline consequent on positive and negative prediction errors, respectively....
Saved in:
| Published in | Behavioral and brain functions Vol. 1; no. 1; p. 6 |
|---|---|
| Main Authors | , , |
| Format | Journal Article |
| Language | English |
| Published |
England
BioMed Central Ltd
04.05.2005
BioMed Central BMC |
| Subjects | |
| Online Access | Get full text |
| ISSN | 1744-9081 1744-9081 |
| DOI | 10.1186/1744-9081-1-6 |
Cover
Loading…
| Abstract | Substantial evidence suggests that the phasic activities of dopaminergic neurons in the primate midbrain represent a temporal difference (TD) error in predictions of future reward, with increases above and decreases below baseline consequent on positive and negative prediction errors, respectively. However, dopamine cells have very low baseline activity, which implies that the representation of these two sorts of error is asymmetric. We explore the implications of this seemingly innocuous asymmetry for the interpretation of dopaminergic firing patterns in experiments with probabilistic rewards which bring about persistent prediction errors. In particular, we show that when averaging the non-stationary prediction errors across trials, a ramping in the activity of the dopamine neurons should be apparent, whose magnitude is dependent on the learning rate. This exact phenomenon was observed in a recent experiment, though being interpreted there in antipodal terms as a within-trial encoding of uncertainty. |
|---|---|
| AbstractList | Substantial evidence suggests that the phasic activities of dopaminergic neurons in the primate midbrain represent a temporal difference (TD) error in predictions of future reward, with increases above and decreases below baseline consequent on positive and negative prediction errors, respectively. However, dopamine cells have very low baseline activity, which implies that the representation of these two sorts of error is asymmetric. We explore the implications of this seemingly innocuous asymmetry for the interpretation of dopaminergic firing patterns in experiments with probabilistic rewards which bring about persistent prediction errors. In particular, we show that when averaging the non-stationary prediction errors across trials, a ramping in the activity of the dopamine neurons should be apparent, whose magnitude is dependent on the learning rate. This exact phenomenon was observed in a recent experiment, though being interpreted there in antipodal terms as a within-trial encoding of uncertainty. Substantial evidence suggests that the phasic activities of dopaminergic neurons in the primate midbrain represent a temporal difference (TD) error in predictions of future reward, with increases above and decreases below baseline consequent on positive and negative prediction errors, respectively. However, dopamine cells have very low baseline activity, which implies that the representation of these two sorts of error is asymmetric. We explore the implications of this seemingly innocuous asymmetry for the interpretation of dopaminergic firing patterns in experiments with probabilistic rewards which bring about persistent prediction errors. In particular, we show that when averaging the non-stationary prediction errors across trials, a ramping in the activity of the dopamine neurons should be apparent, whose magnitude is dependent on the learning rate. This exact phenomenon was observed in a recent experiment, though being interpreted there in antipodal terms as a within-trial encoding of uncertainty.Substantial evidence suggests that the phasic activities of dopaminergic neurons in the primate midbrain represent a temporal difference (TD) error in predictions of future reward, with increases above and decreases below baseline consequent on positive and negative prediction errors, respectively. However, dopamine cells have very low baseline activity, which implies that the representation of these two sorts of error is asymmetric. We explore the implications of this seemingly innocuous asymmetry for the interpretation of dopaminergic firing patterns in experiments with probabilistic rewards which bring about persistent prediction errors. In particular, we show that when averaging the non-stationary prediction errors across trials, a ramping in the activity of the dopamine neurons should be apparent, whose magnitude is dependent on the learning rate. This exact phenomenon was observed in a recent experiment, though being interpreted there in antipodal terms as a within-trial encoding of uncertainty. Abstract Substantial evidence suggests that the phasic activities of dopaminergic neurons in the primate midbrain represent a temporal difference (TD) error in predictions of future reward, with increases above and decreases below baseline consequent on positive and negative prediction errors, respectively. However, dopamine cells have very low baseline activity, which implies that the representation of these two sorts of error is asymmetric. We explore the implications of this seemingly innocuous asymmetry for the interpretation of dopaminergic firing patterns in experiments with probabilistic rewards which bring about persistent prediction errors. In particular, we show that when averaging the non-stationary prediction errors across trials, a ramping in the activity of the dopamine neurons should be apparent, whose magnitude is dependent on the learning rate. This exact phenomenon was observed in a recent experiment, though being interpreted there in antipodal terms as a within-trial encoding of uncertainty. |
| ArticleNumber | 6 |
| Author | Niv, Yael Dayan, Peter Duff, Michael O |
| AuthorAffiliation | 2 Gatsby Computational Neuroscience Unit, University College London, London, UK 1 Interdisciplinary Center for Neural Computation, Hebrew University, Jerusalem, Israel |
| AuthorAffiliation_xml | – name: 2 Gatsby Computational Neuroscience Unit, University College London, London, UK – name: 1 Interdisciplinary Center for Neural Computation, Hebrew University, Jerusalem, Israel |
| Author_xml | – sequence: 1 givenname: Yael surname: Niv fullname: Niv, Yael – sequence: 2 givenname: Michael O surname: Duff fullname: Duff, Michael O – sequence: 3 givenname: Peter surname: Dayan fullname: Dayan, Peter |
| BackLink | https://www.ncbi.nlm.nih.gov/pubmed/15953384$$D View this record in MEDLINE/PubMed |
| BookMark | eNqFkstv1DAQxi1URB9w5Ir2AicCntiO7QsCtTwqVeJSztbYmSyuEntxskj970nYsuryECfPeD7__M3Yp-wo5USMPQX-CsA0r0FLWVluoIKqecBO9vnRvfiYnY7jDefCyLp-xI5BWSXm5IQ9v8gbHGKil6ttClQmjGm6XWFqV9cXq56wpJjWj9nDDvuRntytZ-zLh_fX55-qq88fL8_fXVW-Ec1UBd94xQ33nRCkg2i5Ak4GSXYGAQmkRRCh89p7kkp5RKh1J1tjjUAN4oxd7rhtxhu3KXHAcusyRvdzI5e1wzLF0JMj32pt2ja0VEuptUWUys_XCAWSfJhZb3aszdYP1AZKU8H-AHpYSfGrW-fvDkCDbewMeLsD-Jj_ATishDy4ZeRuGbkD18yIF3ceSv62pXFyQxwD9T0mytvRNdraWiv9XyFYqY2yC_HZ_a72bn696CwQO0EoeRwLdS7ECaeYF4-xd8Dd8m_-MFr9dmoP_qv-B6fhw9M |
| CitedBy_id | crossref_primary_10_1007_s00422_008_0265_6 crossref_primary_10_1038_nn2062 crossref_primary_10_1016_j_neunet_2006_03_004 crossref_primary_10_1152_jn_00564_2014 crossref_primary_10_1093_cercor_bhw005 crossref_primary_10_1073_pnas_1014269108 crossref_primary_10_1007_s11390_023_2839_0 crossref_primary_10_1371_journal_pone_0007362 crossref_primary_10_1038_nrn3289 crossref_primary_10_1152_physrev_00023_2014 crossref_primary_10_1073_pnas_1312125110 crossref_primary_10_1002_hbm_22433 crossref_primary_10_1523_ENEURO_0372_23_2024 crossref_primary_10_1162_neco_2006_18_7_1637 crossref_primary_10_1037_0096_3445_135_2_184 crossref_primary_10_1186_1744_9081_1_7 crossref_primary_10_1016_j_neuron_2010_06_016 crossref_primary_10_1111_ejn_14917 crossref_primary_10_1016_j_jmp_2008_12_005 crossref_primary_10_1016_j_bbr_2014_10_011 crossref_primary_10_1016_j_brainres_2018_10_011 crossref_primary_10_1016_j_neuroimage_2022_119831 crossref_primary_10_1016_j_tics_2010_10_002 crossref_primary_10_1523_JNEUROSCI_5498_10_2012 crossref_primary_10_1016_j_baga_2012_06_005 crossref_primary_10_1002_wcs_1420 crossref_primary_10_1016_j_nlm_2022_107653 crossref_primary_10_1111_cogs_12506 crossref_primary_10_1146_annurev_neuro_29_051605_112903 crossref_primary_10_1162_jocn_a_01411 crossref_primary_10_1007_s00422_013_0571_5 crossref_primary_10_1016_j_neuron_2006_06_024 crossref_primary_10_1016_j_neuropsychologia_2016_08_007 crossref_primary_10_1038_s41386_018_0099_4 crossref_primary_10_1016_j_cognition_2017_03_001 crossref_primary_10_1186_1471_2202_6_37 crossref_primary_10_1016_j_beproc_2019_05_009 crossref_primary_10_1007_s00213_024_06600_1 crossref_primary_10_1016_j_neuroimage_2009_12_068 crossref_primary_10_1016_j_neuroimage_2017_11_048 crossref_primary_10_1016_j_conb_2005_10_006 crossref_primary_10_1162_neco_2008_11_07_654 crossref_primary_10_3389_fnins_2022_802396 crossref_primary_10_1523_JNEUROSCI_0259_08_2008 crossref_primary_10_1523_JNEUROSCI_0400_07_2007 crossref_primary_10_1002_hipo_20535 crossref_primary_10_1016_j_nlm_2014_07_010 crossref_primary_10_1016_j_conb_2006_03_006 crossref_primary_10_1155_2018_4356767 crossref_primary_10_1016_j_neulet_2007_10_039 crossref_primary_10_1523_JNEUROSCI_2157_21_2022 crossref_primary_10_1093_cercor_bhj004 crossref_primary_10_1016_j_brainresrev_2007_07_014 crossref_primary_10_1146_annurev_neuro_29_051605_112851 crossref_primary_10_1038_s41583_019_0180_y crossref_primary_10_1038_s41593_022_01109_2 crossref_primary_10_1016_j_brainres_2008_07_013 crossref_primary_10_1371_journal_pone_0035946 crossref_primary_10_1162_neco_a_01023 crossref_primary_10_1016_j_neures_2023_07_003 crossref_primary_10_1371_journal_pcbi_1000903 crossref_primary_10_1016_j_biopsych_2013_09_005 crossref_primary_10_1016_j_cub_2022_01_025 crossref_primary_10_1016_j_jneumeth_2018_05_005 crossref_primary_10_1016_j_neunet_2009_06_008 crossref_primary_10_1371_journal_pcbi_1004622 crossref_primary_10_1521_soco_2008_26_5_593 crossref_primary_10_1111_j_1747_9991_2007_00099_x crossref_primary_10_3758_CABN_9_4_343 crossref_primary_10_1073_pnas_2215352119 crossref_primary_10_1371_journal_pone_0265808 crossref_primary_10_1016_j_neunet_2008_09_004 crossref_primary_10_5334_cpsy_64 crossref_primary_10_1177_0956797620910993 crossref_primary_10_1038_nature12475 crossref_primary_10_1016_j_neuron_2016_02_002 crossref_primary_10_1038_nrn2787 crossref_primary_10_1111_j_1749_6632_2011_06256_x crossref_primary_10_3389_fnbot_2021_629210 crossref_primary_10_1196_annals_1390_005 |
| Cites_doi | 10.1126/science.275.5306.1593 10.1038/nature03015 10.1152/jn.1998.80.1.1 10.1038/1124 10.1037/0033-295X.107.2.289 10.1016/S0896-6273(03)00869-9 10.1126/science.1077349 10.1038/nature02581 10.1016/S0893-6080(02)00052-7 10.1523/JNEUROSCI.13-03-00900.1993 10.1152/jn.00238.2004 10.1037/0033-295X.87.6.532 10.1152/jn.1992.67.1.145 10.1523/JNEUROSCI.16-05-01936.1996 10.1523/JNEUROSCI.23-32-10402.2003 10.1016/j.neuron.2004.06.012 10.1016/S0896-6273(03)00169-7 10.1038/81504 10.1016/S0306-4522(98)00697-6 |
| ContentType | Journal Article |
| Copyright | Copyright © 2005 Niv et al; licensee BioMed Central Ltd. 2005 Niv et al; licensee BioMed Central Ltd. |
| Copyright_xml | – notice: Copyright © 2005 Niv et al; licensee BioMed Central Ltd. 2005 Niv et al; licensee BioMed Central Ltd. |
| DBID | AAYXX CITATION NPM 7QG 7TK 7X8 5PM DOA |
| DOI | 10.1186/1744-9081-1-6 |
| DatabaseName | CrossRef PubMed Animal Behavior Abstracts Neurosciences Abstracts MEDLINE - Academic PubMed Central (Full Participant titles) DOAJ Directory of Open Access Journals |
| DatabaseTitle | CrossRef PubMed Neurosciences Abstracts Animal Behavior Abstracts MEDLINE - Academic |
| DatabaseTitleList | CrossRef PubMed Neurosciences Abstracts MEDLINE - Academic |
| Database_xml | – sequence: 1 dbid: DOA name: DOAJ Directory of Open Access Journals url: https://www.doaj.org/ sourceTypes: Open Website – sequence: 2 dbid: NPM name: PubMed url: https://proxy.k.utb.cz/login?url=http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed sourceTypes: Index Database |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Medicine Anatomy & Physiology Psychology |
| EISSN | 1744-9081 |
| EndPage | 6 |
| ExternalDocumentID | oai_doaj_org_article_ebd778ddcde244779aa45b8a13514ebc PMC1171969 oai_biomedcentral_com_1744_9081_1_6 15953384 10_1186_1744_9081_1_6 |
| Genre | Journal Article |
| GroupedDBID | --- 0R~ 23N 2WC 4.4 53G 5GY 5VS 6J9 AAFWJ AAYXX ABDBF ABIVO ACGFO ACGFS ACPRK ACUHS ADBBV ADRAZ ADUKV AENEX AFPKN AHBYD AHMBA AHSBF AHYZX ALIPV ALMA_UNASSIGNED_HOLDINGS AMKLP AMTXH AOIJS BAPOH BAWUL BCNDV BFQNJ BMC C1A C6C CITATION CS3 DIK DU5 E3Z EBD EBLON EBS EJD ESX F5P GROUPED_DOAJ GX1 H13 HYE IAO IHR INH INR IPNFZ IPY KQ8 M~E O5R O5S OK1 OVT P2P PGMZT RBZ RIG RNS ROL RPM RSV SOJ TR2 TUS WOQ WOW XSB ~8M -A0 ADINQ C24 NPM 7QG 7TK 7X8 AFGXO AFNRJ 5PM |
| ID | FETCH-LOGICAL-b636t-cb6b5080bf33e7c3d0510e8ae4f8a1ae149a13cfb7bbe455baa127f4d8983a713 |
| IEDL.DBID | RBZ |
| ISSN | 1744-9081 |
| IngestDate | Wed Aug 27 01:29:53 EDT 2025 Thu Aug 21 18:32:00 EDT 2025 Tue Apr 16 22:54:39 EDT 2024 Fri Jul 11 04:22:51 EDT 2025 Fri Jul 11 10:13:55 EDT 2025 Thu Jan 02 21:58:42 EST 2025 Thu Apr 24 23:11:36 EDT 2025 Tue Jul 01 02:07:10 EDT 2025 |
| IsDoiOpenAccess | true |
| IsOpenAccess | true |
| IsPeerReviewed | true |
| IsScholarly | true |
| Issue | 1 |
| Language | English |
| License | This is an Open Access article distributed under the terms of the Creative Commons Attribution License (), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-b636t-cb6b5080bf33e7c3d0510e8ae4f8a1ae149a13cfb7bbe455baa127f4d8983a713 |
| Notes | ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 23 |
| OpenAccessLink | http://dx.doi.org/10.1186/1744-9081-1-6 |
| PMID | 15953384 |
| PQID | 19478596 |
| PQPubID | 23462 |
| PageCount | 1 |
| ParticipantIDs | doaj_primary_oai_doaj_org_article_ebd778ddcde244779aa45b8a13514ebc pubmedcentral_primary_oai_pubmedcentral_nih_gov_1171969 biomedcentral_primary_oai_biomedcentral_com_1744_9081_1_6 proquest_miscellaneous_67992757 proquest_miscellaneous_19478596 pubmed_primary_15953384 crossref_citationtrail_10_1186_1744_9081_1_6 crossref_primary_10_1186_1744_9081_1_6 |
| ProviderPackageCode | CITATION AAYXX |
| PublicationCentury | 2000 |
| PublicationDate | 2005-05-04 |
| PublicationDateYYYYMMDD | 2005-05-04 |
| PublicationDate_xml | – month: 05 year: 2005 text: 2005-05-04 day: 04 |
| PublicationDecade | 2000 |
| PublicationPlace | England |
| PublicationPlace_xml | – name: England – name: London |
| PublicationTitle | Behavioral and brain functions |
| PublicationTitleAlternate | Behav Brain Funct |
| PublicationYear | 2005 |
| Publisher | BioMed Central Ltd BioMed Central BMC |
| Publisher_xml | – name: BioMed Central Ltd – name: BioMed Central – name: BMC |
| References | RS Sutton (6_CR9) 1998 J O'Doherty (6_CR3) 2003; 38 W Schultz (6_CR2) 1998; 80 RE Suri (6_CR21) 1999; 91 JM Pearce (6_CR22) 1980; 87 CR Gallistel (6_CR19) 2000; 107 P Tobler (6_CR12) 2003; 23 Y Takikawa (6_CR13) 2004; 92 6_CR25 PR Montague (6_CR5) 2004; 431 J Hollerman (6_CR10) 1998; 1 T Ljungberg (6_CR1) 1992; 67 A Barto (6_CR17) 1990 W Schultz (6_CR11) 1993; 13 ND Daw (6_CR20) 2002; 15 PR Montague (6_CR6) 1996; 16 RS Sutton (6_CR8) 1988; 3 P Dayan (6_CR23) 2000; 3 J Wickens (6_CR26) 1995 H Nakahara (6_CR18) 2004; 41 W Schultz (6_CR7) 1997; 275 H Bayer (6_CR14) 2004 P Dayan (6_CR24) 2002 G Morris (6_CR16) 2004; 43 C Fiorillo (6_CR15) 2003; 299 B Seymour (6_CR4) 2004; 429 12649484 - Science. 2003 Mar 21;299(5614):1898-902 11127841 - Nat Neurosci. 2000 Nov;3 Suppl:1218-23 1552316 - J Neurophysiol. 1992 Jan;67(1):145-63 9054347 - Science. 1997 Mar 14;275(5306):1593-9 15483596 - Nature. 2004 Oct 14;431(7010):760-7 15190354 - Nature. 2004 Jun 10;429(6992):664-7 14741107 - Neuron. 2004 Jan 22;41(2):269-80 15958162 - Behav Brain Funct. 2005 Jun 15;1(1):7 7443916 - Psychol Rev. 1980 Nov;87(6):532-52 15163669 - J Neurophysiol. 2004 Oct;92(4):2520-9 12718865 - Neuron. 2003 Apr 24;38(2):329-37 14614099 - J Neurosci. 2003 Nov 12;23(32):10402-10 9658025 - J Neurophysiol. 1998 Jul;80(1):1-27 8441015 - J Neurosci. 1993 Mar;13(3):900-13 10195164 - Nat Neurosci. 1998 Aug;1(4):304-9 15233923 - Neuron. 2004 Jul 8;43(1):133-43 10391468 - Neuroscience. 1999;91(3):871-90 8774460 - J Neurosci. 1996 Mar 1;16(5):1936-47 10789198 - Psychol Rev. 2000 Apr;107(2):289-344 12371515 - Neural Netw. 2002 Jun-Jul;15(4-6):603-16 |
| References_xml | – volume: 275 start-page: 1593 year: 1997 ident: 6_CR7 publication-title: Science doi: 10.1126/science.275.5306.1593 – volume: 3 start-page: 9 year: 1988 ident: 6_CR8 publication-title: Machine Learning – volume: 431 start-page: 760 year: 2004 ident: 6_CR5 publication-title: Nature doi: 10.1038/nature03015 – volume: 80 start-page: 1 year: 1998 ident: 6_CR2 publication-title: Journal of Neurophysiology doi: 10.1152/jn.1998.80.1.1 – start-page: 187 volume-title: Models of Information Processing in the Basal Ganglia year: 1995 ident: 6_CR26 – volume: 1 start-page: 304 year: 1998 ident: 6_CR10 publication-title: Nature Neuroscience doi: 10.1038/1124 – volume: 107 start-page: 289 year: 2000 ident: 6_CR19 publication-title: Psychological Review doi: 10.1037/0033-295X.107.2.289 – volume: 41 start-page: 269 year: 2004 ident: 6_CR18 publication-title: Neuron doi: 10.1016/S0896-6273(03)00869-9 – volume: 299 start-page: 1898 issue: 5614 year: 2003 ident: 6_CR15 publication-title: Science doi: 10.1126/science.1077349 – start-page: 539 volume-title: Learning and Computational Neuroscience: Foundations of Adaptive Networks year: 1990 ident: 6_CR17 – volume-title: Reinforcement learning: An introduction year: 1998 ident: 6_CR9 – start-page: 189 volume-title: Advances in Neural Information Processing Sysytems year: 2002 ident: 6_CR24 – volume: 429 start-page: 664 year: 2004 ident: 6_CR4 publication-title: Nature doi: 10.1038/nature02581 – volume-title: PhD thesis, New York University year: 2004 ident: 6_CR14 – volume: 15 start-page: 603 issue: 4–6 year: 2002 ident: 6_CR20 publication-title: Neural Networks doi: 10.1016/S0893-6080(02)00052-7 – volume: 13 start-page: 900 year: 1993 ident: 6_CR11 publication-title: The Journal of Neuroscience doi: 10.1523/JNEUROSCI.13-03-00900.1993 – volume: 92 start-page: 2520 year: 2004 ident: 6_CR13 publication-title: Journal of Neurophysiology doi: 10.1152/jn.00238.2004 – volume: 87 start-page: 532 year: 1980 ident: 6_CR22 publication-title: Psychological Review doi: 10.1037/0033-295X.87.6.532 – volume: 67 start-page: 145 year: 1992 ident: 6_CR1 publication-title: Journal Neurophysiol doi: 10.1152/jn.1992.67.1.145 – ident: 6_CR25 – volume: 16 start-page: 1936 year: 1996 ident: 6_CR6 publication-title: The Journal of Neuroscience doi: 10.1523/JNEUROSCI.16-05-01936.1996 – volume: 23 start-page: 10402 issue: 32 year: 2003 ident: 6_CR12 publication-title: Journal of Neuroscience doi: 10.1523/JNEUROSCI.23-32-10402.2003 – volume: 43 start-page: 133 year: 2004 ident: 6_CR16 publication-title: Neuron doi: 10.1016/j.neuron.2004.06.012 – volume: 38 start-page: 329 year: 2003 ident: 6_CR3 publication-title: Neuron doi: 10.1016/S0896-6273(03)00169-7 – volume: 3 start-page: 1218 year: 2000 ident: 6_CR23 publication-title: Nature Neuroscience doi: 10.1038/81504 – volume: 91 start-page: 871 year: 1999 ident: 6_CR21 publication-title: Neuroscience doi: 10.1016/S0306-4522(98)00697-6 – reference: 14614099 - J Neurosci. 2003 Nov 12;23(32):10402-10 – reference: 1552316 - J Neurophysiol. 1992 Jan;67(1):145-63 – reference: 15958162 - Behav Brain Funct. 2005 Jun 15;1(1):7 – reference: 10195164 - Nat Neurosci. 1998 Aug;1(4):304-9 – reference: 10391468 - Neuroscience. 1999;91(3):871-90 – reference: 9658025 - J Neurophysiol. 1998 Jul;80(1):1-27 – reference: 9054347 - Science. 1997 Mar 14;275(5306):1593-9 – reference: 15233923 - Neuron. 2004 Jul 8;43(1):133-43 – reference: 12718865 - Neuron. 2003 Apr 24;38(2):329-37 – reference: 12371515 - Neural Netw. 2002 Jun-Jul;15(4-6):603-16 – reference: 15483596 - Nature. 2004 Oct 14;431(7010):760-7 – reference: 15190354 - Nature. 2004 Jun 10;429(6992):664-7 – reference: 11127841 - Nat Neurosci. 2000 Nov;3 Suppl:1218-23 – reference: 10789198 - Psychol Rev. 2000 Apr;107(2):289-344 – reference: 8441015 - J Neurosci. 1993 Mar;13(3):900-13 – reference: 8774460 - J Neurosci. 1996 Mar 1;16(5):1936-47 – reference: 14741107 - Neuron. 2004 Jan 22;41(2):269-80 – reference: 15163669 - J Neurophysiol. 2004 Oct;92(4):2520-9 – reference: 7443916 - Psychol Rev. 1980 Nov;87(6):532-52 – reference: 12649484 - Science. 2003 Mar 21;299(5614):1898-902 |
| SSID | ssj0038422 |
| Score | 2.0856388 |
| Snippet | Substantial evidence suggests that the phasic activities of dopaminergic neurons in the primate midbrain represent a temporal difference (TD) error in... Abstract Substantial evidence suggests that the phasic activities of dopaminergic neurons in the primate midbrain represent a temporal difference (TD) error in... |
| SourceID | doaj pubmedcentral biomedcentral proquest pubmed crossref |
| SourceType | Open Website Open Access Repository Aggregation Database Index Database Enrichment Source |
| StartPage | 6 |
| SubjectTerms | Primates Short Paper |
| SummonAdditionalLinks | – databaseName: DOAJ Directory of Open Access Journals dbid: DOA link: http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrV1Lb9QwEB6hHlAvCLY8wjMH6KlRm_gx9rFQqgqpnFqpN8tPQGrTCraH_feMnWRpVlRckHJyRoo9HnvmsyffALy3QgcMvmtSGwmgqKAbq5NrMHWtdzEhC_kc8vSrPDnnXy7ExZ1SXzknbKAHHhS3H11AVCH4EMkTIWpruXDK5spyPDqfd1_yeROYGvZgpni5P6BwmzeavN7Erqnk_rqNwJPc-M39cuadCon_3yLPzQTKOx7p-DE8GkPJ-nAYwhN4EPsF7Bz2BKOvVvVuXZI7y6n5Ah6ejnfoC9he73mrHfhwRKD5itr3anJwQ3rAclXbPtRnR_VYUuLbUzg__nz26aQZKyc0TjK5bLyTjiKvA5cYi-hZyEsvKht5Is3ZSLCIFOiTQ-ciF8JZ23aYeFBaMUu49Rls9dd9fAG1l-h8bFGlfFykuBWdlwfWO8EyNz2rQM80aG4GlgyTeavnb2gJmax9k7VvWiMr2Ju0bfxISZ4rY1yaAk2U3BTfXYtPX7lH8GOeullXSgMZlhkNy_zLsCp4N028oSWX71FsH69vf5lWc1RCy_slJGrdocAKng-G8qe_IufzKl4Bzkxo1tf5m_7H90L73baYuYxe_o_BvYLtwkGbH_4atpY_b-Mbiq6W7m1ZSL8BsN4jZw priority: 102 providerName: Directory of Open Access Journals |
| Title | Dopamine, uncertainty and TD learning |
| URI | https://www.ncbi.nlm.nih.gov/pubmed/15953384 https://www.proquest.com/docview/19478596 https://www.proquest.com/docview/67992757 http://dx.doi.org/10.1186/1744-9081-1-6 https://pubmed.ncbi.nlm.nih.gov/PMC1171969 https://doaj.org/article/ebd778ddcde244779aa45b8a13514ebc |
| Volume | 1 |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV3NTxUxEJ8oJoaLgYcfK4p7UE5spNuPaY8gEmKCBwMJ8dL0U0xgMfo4vP_etm_34W7gZLKn7my2mXY6n_0NwHvDlUfv2iaSkBwU6VVjVLQNxpY4GyJSn-OQp1_FyTn7csEv7kCSJhl8IsXHZDKzRiXNlZwd8RietAxZ7tHw7fD7cORSyUq6YEU6gGlOP5_car8aKaOC2X-foTmtl_xHAR1vwLPecqwPlku9CY9CN4Otgy55zdeLercutZwlSD6Dp6d9ynwG66sjbrEFH46Sj3ydxvfqpM-W1QDzRW06X58d1X0HiR_P4fz489mnk6ZvlNBYQcW8cVbYZGjt20hpQEd9lrQgTWBRGmJC8oIMoS5atDYwzq0xpMXIvFSSmuSmvoC17qYLr6B2Aq0LBGXM0SHJDG-d2DfOcpqh6GkFasRB_WsJiqEzTPX4TZIYnbmvM_c10aKCvYHb2vUI5LkRxpUunogUU_LdFfnwlwcID_PSjaZSBtI20r0A6mA9ovTe-ZAsGkRlDOM2sSdfZQjWVfBuWHidJCynTUwXbm7_aKIYSq7EwxQClWqRYwUvlxvlbr48l-9KVgGOttBoruM33c_LgvJNCGbootf_wfBtWC9Is_lhb2Bt_vs2vE021NzulNjDTpGivxEDGpM |
| linkProvider | BioMedCentral |
| linkToHtml | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV1Lb9QwEB6VIkEvCLZQwqs5QE-NqOPH2MeWUi3Q7QFtpYqLZTtOQdpmUdke9t9jO8m2WdETUk7ORLFmPOMZe-YbgPeGqworVxY18SFAkZUqjKptgXVJnPU10iqeQ07OxPicfb3gFxsw7WthbovTQyBtY5eEaN9bEdwtSJ8lK94nj7W6L8XH4F-zQoVtLkRG4gE8RM4xquv3ox-9faaSpbuFFWmPvLn--VoJ_GywcyWA_395pevJlXd2q5On8KRzM_PDdubPYMM3I9g-bEKIfbXM9_KU-JlO1EfwaNLdr49ga2UPl9vw4TgE1FdhfD8PzGlTBxbLPHAsnx7nXbuJy-dwfvJ5-mlcdF0VCiuoWBTOChu8sgNbU-rR0SqqpZfGs1oaYnwImQyhrrZorWecW2NIiTWrpJLUhJj2BWw288a_hNwJtM4TlHU8SpLM8NKJA-MspxG3nmagBhzUv1sEDR0xrYdvgjR15L6O3NdEiwz2e25r18GVx64ZM53CFinWyfdW5P1f7iE8iqIbTCUNzK8vdbeetLcVoqwqV_ng_iAqYxi3gT2x7sFbl8FuL3gd1DHesZjGz2_-aKIYSq7E_RQClSqRYwY77UK5nS-Pub6SZYCDJTSY6_BN8-tnggQnBCPO0av_YPguPB5PJ6f69MvZt9ewlSBq48PewObi-sa_Dc7Xwr5LuvQX8D8vIw |
| linkToPdf | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV1LT9wwEB5RKiEuVbv0Efogh5YTEXj9PkK3K_oA9cBKqBfLT6i6ZBEsh_33tZ1kIatyqpRDZE8Ua-yx57NnPgN81FQ67uywCshHgCKcrLQMpuJhiKzxgWOX9iFPTtnxhHw7p-drMOlyYe6T0yOQNumWhDS_N13wMCF9mmfx-GL_7F-70Bi_YPvRwSaVjOtchEbsCTzliWIqgfijX90EjQXJhwtL0Y56c_XzlRz4aW_pygz__3JLV6MrHyxX4-fwrPUzy8NmYLyANV8PYOuwjhj7alHuljnyM2-pD2DjpD1gH8DmckJcbMGnUUTUV7F8r4zaaWIH5osyqqw8G5XtfRMXL2Ey_nL2-bhqr1WoDMNsXlnDTHTLDkzA2HOLXbJLL7QnQWikfcRMGmEbDDfGE0qN1mjIA3FCCqwjqH0F6_Ws9m-gtIwb6xEXIe0lCaLp0LIDbQ3FibgeFyB7GlTXDYWGSqTW_ZrYnSppXyXtK6RYAXudtpVt-crTtRlTlXGLYKviu0vx7i-PCB6lrus1JRfMbi5Ua67KG8e5cM46H_0fzqXWhJqonpT44I0tYKfreBXtMR2y6NrP7m4VkoQLKtnjEoxLOeSUF_C6GSj37aUp2FeQAnhvCPXa2q-pf19mTnCEeCI62v4Phe_Axs_RWP34evr9LWxmitr0kHewPr-58--j8zU3H7Ip_QVnuS7u |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Dopamine%2C+uncertainty+and+TD+learning&rft.jtitle=Behavioral+and+brain+functions&rft.au=Niv%2C+Yael&rft.au=Duff%2C+Michael+O&rft.au=Dayan%2C+Peter&rft.date=2005-05-04&rft.issn=1744-9081&rft.eissn=1744-9081&rft.volume=1&rft_id=info:doi/10.1186%2F1744-9081-1-6&rft.externalDBID=NO_FULL_TEXT |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1744-9081&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1744-9081&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1744-9081&client=summon |