Reward and avoidance learning in the context of aversive environments and possible implications for depressive symptoms
Background Aversive stimuli in the environment influence human actions. This includes valence-dependent influences on action selection, e.g., increased avoidance but decreased approach behavior. However, it is yet unclear how aversive stimuli interact with complex learning and decision-making in the...
Saved in:
| Published in | Psychopharmacology Vol. 236; no. 8; pp. 2437 - 2449 |
|---|---|
| Main Authors | , , , , , , , , |
| Format | Journal Article |
| Language | English |
| Published |
Berlin/Heidelberg
Springer Berlin Heidelberg
01.08.2019
Springer Springer Nature B.V |
| Subjects | |
| Online Access | Get full text |
Cover
Loading…
| Abstract | Background
Aversive stimuli in the environment influence human actions. This includes valence-dependent influences on action selection, e.g., increased avoidance but decreased approach behavior. However, it is yet unclear how aversive stimuli interact with complex learning and decision-making in the reward and avoidance domain. Moreover, the underlying computational mechanisms of these decision-making biases are unknown.
Methods
To elucidate these mechanisms, 54 healthy young male subjects performed a two-step sequential decision-making task, which allows to computationally model different aspects of learning, e.g., model-free, habitual, and model-based, goal-directed learning. We used a within-subject design, crossing task valence (reward vs. punishment learning) with emotional context (aversive vs. neutral background stimuli). We analyzed choice data, applied a computational model, and performed simulations.
Results
Whereas model-based learning was not affected, aversive stimuli interacted with model-free learning in a way that depended on task valence. Thus, aversive stimuli increased model-free avoidance learning but decreased model-free reward learning. The computational model confirmed this effect: the parameter lambda that indicates the influence of reward prediction errors on decision values was increased in the punishment condition but decreased in the reward condition when aversive stimuli were present. Further, by using the inferred computational parameters to simulate choice data, our effects were captured. Exploratory analyses revealed that the observed biases were associated with subclinical depressive symptoms.
Conclusion
Our data show that aversive environmental stimuli affect complex learning and decision-making, which depends on task valence. Further, we provide a model of the underlying computations of this affective modulation. Finally, our finding of increased decision-making biases in subjects reporting subclinical depressive symptoms matches recent reports of amplified Pavlovian influences on action selection in depression and suggests a potential vulnerability factor for mood disorders. We discuss our findings in the light of the involvement of the neuromodulators serotonin and dopamine. |
|---|---|
| AbstractList | Aversive stimuli in the environment influence human actions. This includes valence-dependent influences on action selection, e.g., increased avoidance but decreased approach behavior. However, it is yet unclear how aversive stimuli interact with complex learning and decision-making in the reward and avoidance domain. Moreover, the underlying computational mechanisms of these decision-making biases are unknown. To elucidate these mechanisms, 54 healthy young male subjects performed a two-step sequential decision-making task, which allows to computationally model different aspects of learning, e.g., model-free, habitual, and model-based, goal-directed learning. We used a within-subject design, crossing task valence (reward vs. punishment learning) with emotional context (aversive vs. neutral background stimuli). We analyzed choice data, applied a computational model, and performed simulations. Whereas model-based learning was not affected, aversive stimuli interacted with model-free learning in a way that depended on task valence. Thus, aversive stimuli increased model-free avoidance learning but decreased model-free reward learning. The computational model confirmed this effect: the parameter lambda that indicates the influence of reward prediction errors on decision values was increased in the punishment condition but decreased in the reward condition when aversive stimuli were present. Further, by using the inferred computational parameters to simulate choice data, our effects were captured. Exploratory analyses revealed that the observed biases were associated with subclinical depressive symptoms. Our data show that aversive environmental stimuli affect complex learning and decision-making, which depends on task valence. Further, we provide a model of the underlying computations of this affective modulation. Finally, our finding of increased decision-making biases in subjects reporting subclinical depressive symptoms matches recent reports of amplified Pavlovian influences on action selection in depression and suggests a potential vulnerability factor for mood disorders. We discuss our findings in the light of the involvement of the neuromodulators serotonin and dopamine. BackgroundAversive stimuli in the environment influence human actions. This includes valence-dependent influences on action selection, e.g., increased avoidance but decreased approach behavior. However, it is yet unclear how aversive stimuli interact with complex learning and decision-making in the reward and avoidance domain. Moreover, the underlying computational mechanisms of these decision-making biases are unknown.MethodsTo elucidate these mechanisms, 54 healthy young male subjects performed a two-step sequential decision-making task, which allows to computationally model different aspects of learning, e.g., model-free, habitual, and model-based, goal-directed learning. We used a within-subject design, crossing task valence (reward vs. punishment learning) with emotional context (aversive vs. neutral background stimuli). We analyzed choice data, applied a computational model, and performed simulations.ResultsWhereas model-based learning was not affected, aversive stimuli interacted with model-free learning in a way that depended on task valence. Thus, aversive stimuli increased model-free avoidance learning but decreased model-free reward learning. The computational model confirmed this effect: the parameter lambda that indicates the influence of reward prediction errors on decision values was increased in the punishment condition but decreased in the reward condition when aversive stimuli were present. Further, by using the inferred computational parameters to simulate choice data, our effects were captured. Exploratory analyses revealed that the observed biases were associated with subclinical depressive symptoms.ConclusionOur data show that aversive environmental stimuli affect complex learning and decision-making, which depends on task valence. Further, we provide a model of the underlying computations of this affective modulation. Finally, our finding of increased decision-making biases in subjects reporting subclinical depressive symptoms matches recent reports of amplified Pavlovian influences on action selection in depression and suggests a potential vulnerability factor for mood disorders. We discuss our findings in the light of the involvement of the neuromodulators serotonin and dopamine. Background Aversive stimuli in the environment influence human actions. This includes valence-dependent influences on action selection, e.g., increased avoidance but decreased approach behavior. However, it is yet unclear how aversive stimuli interact with complex learning and decision-making in the reward and avoidance domain. Moreover, the underlying computational mechanisms of these decision-making biases are unknown. Methods To elucidate these mechanisms, 54 healthy young male subjects performed a two-step sequential decision-making task, which allows to computationally model different aspects of learning, e.g., model-free, habitual, and model-based, goal-directed learning. We used a within-subject design, crossing task valence (reward vs. punishment learning) with emotional context (aversive vs. neutral background stimuli). We analyzed choice data, applied a computational model, and performed simulations. Results Whereas model-based learning was not affected, aversive stimuli interacted with model-free learning in a way that depended on task valence. Thus, aversive stimuli increased model-free avoidance learning but decreased model-free reward learning. The computational model confirmed this effect: the parameter lambda that indicates the influence of reward prediction errors on decision values was increased in the punishment condition but decreased in the reward condition when aversive stimuli were present. Further, by using the inferred computational parameters to simulate choice data, our effects were captured. Exploratory analyses revealed that the observed biases were associated with subclinical depressive symptoms. Conclusion Our data show that aversive environmental stimuli affect complex learning and decision-making, which depends on task valence. Further, we provide a model of the underlying computations of this affective modulation. Finally, our finding of increased decision-making biases in subjects reporting subclinical depressive symptoms matches recent reports of amplified Pavlovian influences on action selection in depression and suggests a potential vulnerability factor for mood disorders. We discuss our findings in the light of the involvement of the neuromodulators serotonin and dopamine. Aversive stimuli in the environment influence human actions. This includes valence-dependent influences on action selection, e.g., increased avoidance but decreased approach behavior. However, it is yet unclear how aversive stimuli interact with complex learning and decision-making in the reward and avoidance domain. Moreover, the underlying computational mechanisms of these decision-making biases are unknown.BACKGROUNDAversive stimuli in the environment influence human actions. This includes valence-dependent influences on action selection, e.g., increased avoidance but decreased approach behavior. However, it is yet unclear how aversive stimuli interact with complex learning and decision-making in the reward and avoidance domain. Moreover, the underlying computational mechanisms of these decision-making biases are unknown.To elucidate these mechanisms, 54 healthy young male subjects performed a two-step sequential decision-making task, which allows to computationally model different aspects of learning, e.g., model-free, habitual, and model-based, goal-directed learning. We used a within-subject design, crossing task valence (reward vs. punishment learning) with emotional context (aversive vs. neutral background stimuli). We analyzed choice data, applied a computational model, and performed simulations.METHODSTo elucidate these mechanisms, 54 healthy young male subjects performed a two-step sequential decision-making task, which allows to computationally model different aspects of learning, e.g., model-free, habitual, and model-based, goal-directed learning. We used a within-subject design, crossing task valence (reward vs. punishment learning) with emotional context (aversive vs. neutral background stimuli). We analyzed choice data, applied a computational model, and performed simulations.Whereas model-based learning was not affected, aversive stimuli interacted with model-free learning in a way that depended on task valence. Thus, aversive stimuli increased model-free avoidance learning but decreased model-free reward learning. The computational model confirmed this effect: the parameter lambda that indicates the influence of reward prediction errors on decision values was increased in the punishment condition but decreased in the reward condition when aversive stimuli were present. Further, by using the inferred computational parameters to simulate choice data, our effects were captured. Exploratory analyses revealed that the observed biases were associated with subclinical depressive symptoms.RESULTSWhereas model-based learning was not affected, aversive stimuli interacted with model-free learning in a way that depended on task valence. Thus, aversive stimuli increased model-free avoidance learning but decreased model-free reward learning. The computational model confirmed this effect: the parameter lambda that indicates the influence of reward prediction errors on decision values was increased in the punishment condition but decreased in the reward condition when aversive stimuli were present. Further, by using the inferred computational parameters to simulate choice data, our effects were captured. Exploratory analyses revealed that the observed biases were associated with subclinical depressive symptoms.Our data show that aversive environmental stimuli affect complex learning and decision-making, which depends on task valence. Further, we provide a model of the underlying computations of this affective modulation. Finally, our finding of increased decision-making biases in subjects reporting subclinical depressive symptoms matches recent reports of amplified Pavlovian influences on action selection in depression and suggests a potential vulnerability factor for mood disorders. We discuss our findings in the light of the involvement of the neuromodulators serotonin and dopamine.CONCLUSIONOur data show that aversive environmental stimuli affect complex learning and decision-making, which depends on task valence. Further, we provide a model of the underlying computations of this affective modulation. Finally, our finding of increased decision-making biases in subjects reporting subclinical depressive symptoms matches recent reports of amplified Pavlovian influences on action selection in depression and suggests a potential vulnerability factor for mood disorders. We discuss our findings in the light of the involvement of the neuromodulators serotonin and dopamine. Aversive stimuli in the environment influence human actions. This includes valence-dependent influences on action selection, e.g., increased avoidance but decreased approach behavior. However, it is yet unclear how aversive stimuli interact with complex learning and decision-making in the reward and avoidance domain. Moreover, the underlying computational mechanisms of these decision-making biases are unknown. To elucidate these mechanisms, 54 healthy young male subjects performed a two-step sequential decision-making task, which allows to computationally model different aspects of learning, e.g., model-free, habitual, and model-based, goal-directed learning. We used a within-subject design, crossing task valence (reward vs. punishment learning) with emotional context (aversive vs. neutral background stimuli). We analyzed choice data, applied a computational model, and performed simulations. Whereas model-based learning was not affected, aversive stimuli interacted with model-free learning in a way that depended on task valence. Thus, aversive stimuli increased model-free avoidance learning but decreased model-free reward learning. The computational model confirmed this effect: the parameter lambda that indicates the influence of reward prediction errors on decision values was increased in the punishment condition but decreased in the reward condition when aversive stimuli were present. Further, by using the inferred computational parameters to simulate choice data, our effects were captured. Exploratory analyses revealed that the observed biases were associated with subclinical depressive symptoms. Our data show that aversive environmental stimuli affect complex learning and decision-making, which depends on task valence. Further, we provide a model of the underlying computations of this affective modulation. Finally, our finding of increased decision-making biases in subjects reporting subclinical depressive symptoms matches recent reports of amplified Pavlovian influences on action selection in depression and suggests a potential vulnerability factor for mood disorders. We discuss our findings in the light of the involvement of the neuromodulators serotonin and dopamine. Background Aversive stimuli in the environment influence human actions. This includes valence-dependent influences on action selection, e.g., increased avoidance but decreased approach behavior. However, it is yet unclear how aversive stimuli interact with complex learning and decision-making in the reward and avoidance domain. Moreover, the underlying computational mechanisms of these decision-making biases are unknown. Methods To elucidate these mechanisms, 54 healthy young male subjects performed a two-step sequential decision-making task, which allows to computationally model different aspects of learning, e.g., model-free, habitual, and model-based, goal-directed learning. We used a within-subject design, crossing task valence (reward vs. punishment learning) with emotional context (aversive vs. neutral background stimuli). We analyzed choice data, applied a computational model, and performed simulations. Results Whereas model-based learning was not affected, aversive stimuli interacted with model-free learning in a way that depended on task valence. Thus, aversive stimuli increased model-free avoidance learning but decreased model-free reward learning. The computational model confirmed this effect: the parameter lambda that indicates the influence of reward prediction errors on decision values was increased in the punishment condition but decreased in the reward condition when aversive stimuli were present. Further, by using the inferred computational parameters to simulate choice data, our effects were captured. Exploratory analyses revealed that the observed biases were associated with subclinical depressive symptoms. Conclusion Our data show that aversive environmental stimuli affect complex learning and decision-making, which depends on task valence. Further, we provide a model of the underlying computations of this affective modulation. Finally, our finding of increased decision-making biases in subjects reporting subclinical depressive symptoms matches recent reports of amplified Pavlovian influences on action selection in depression and suggests a potential vulnerability factor for mood disorders. We discuss our findings in the light of the involvement of the neuromodulators serotonin and dopamine. |
| Audience | Academic |
| Author | Garbusow, M. Sebold, Miriam Schlagenhauf, F. Jetzschmann, P. Nebe, S. Heinz, A. Romanczuk-Seiferth, N. Rapp, M. Schad, D. J. |
| Author_xml | – sequence: 1 givenname: Miriam orcidid: 0000-0002-6006-3201 surname: Sebold fullname: Sebold, Miriam email: miriam.sebold@charite.de organization: Department of Psychiatry and Psychotherapy, Charité – Universitätsmedizin Berlin, Department for Social and Preventive Medicine, University of Potsdam – sequence: 2 givenname: M. surname: Garbusow fullname: Garbusow, M. organization: Department of Psychiatry and Psychotherapy, Charité – Universitätsmedizin Berlin – sequence: 3 givenname: P. surname: Jetzschmann fullname: Jetzschmann, P. organization: Department of Psychiatry and Psychotherapy, Charité – Universitätsmedizin Berlin – sequence: 4 givenname: D. J. surname: Schad fullname: Schad, D. J. organization: Cognitive Science, University of Potsdam – sequence: 5 givenname: S. surname: Nebe fullname: Nebe, S. organization: Zurich Center for Neuroeconomics, Department of Economics, University of Zurich – sequence: 6 givenname: F. surname: Schlagenhauf fullname: Schlagenhauf, F. organization: Department of Psychiatry and Psychotherapy, Charité – Universitätsmedizin Berlin, Max Planck Institute for Human Cognitive and Brain Sciences – sequence: 7 givenname: A. surname: Heinz fullname: Heinz, A. organization: Department of Psychiatry and Psychotherapy, Charité – Universitätsmedizin Berlin – sequence: 8 givenname: M. surname: Rapp fullname: Rapp, M. organization: Department for Social and Preventive Medicine, University of Potsdam – sequence: 9 givenname: N. surname: Romanczuk-Seiferth fullname: Romanczuk-Seiferth, N. organization: Department of Psychiatry and Psychotherapy, Charité – Universitätsmedizin Berlin |
| BackLink | https://www.ncbi.nlm.nih.gov/pubmed/31254091$$D View this record in MEDLINE/PubMed |
| BookMark | eNp9kl1rFDEUhoNU7If-AS8k4I03U_M9kxuhFL-gIIheh0xyZpsyk4zJ7Nb-e7O7tbVFmhACyfOenJP3HKODmCIg9JqSU0pI-74QwihvCNUNkUzrRj9DR1Rw1jDSsgN0RAjnDaeyO0THpVyROkQnXqBDTpkURNMjdP0drm322Ma6Nil4Gx3gEWyOIa5wiHi5BOxSXOD3gtNQIcglbABD3ISc4gRxKTv5nEoJ_Qg4TPMYnF1CigUPKWMPc4ayU5WbaV7SVF6i54MdC7y63U_Qz08ff5x_aS6-ff56fnbROCno0nRCDa2SneOEaOK7ngNoz5RnXkgleE-079t6SL2lXd-L1mtHZdtT6YEywU_Qh33ced1P4F3NNtvRzDlMNt-YZIN5eBPDpVmljVFKS65kDfDuNkBOv9ZQFjOF4mAcbYS0LoYxSRTlHeUVffsIvUrrHGt5lRJdq5mk9J5a2RFMiEOq77ptUHMmtVLVtHab9-l_qDo9TKHaAUOo5w8Eb_4t9K7Cv1ZXgO0Bl6tRGYY7hBKz7Sez7ydT-8ns-snoKuoeiVxYds7WdML4tJTvpaW-E1eQ73_jCdUf9y3f5g |
| CitedBy_id | crossref_primary_10_3389_fnins_2020_604867 crossref_primary_10_1007_s00213_019_05320_1 crossref_primary_10_1016_j_neubiorev_2022_104959 crossref_primary_10_1159_000525579 crossref_primary_10_1016_j_biosystems_2023_105104 crossref_primary_10_1111_acer_14354 crossref_primary_10_1371_journal_pcbi_1010805 crossref_primary_10_1080_20008066_2024_2301844 crossref_primary_10_3389_fpsyg_2021_767022 |
| Cites_doi | 10.1523/JNEUROSCI.2513-09.2009 10.1038/npp.2014.193 10.1162/jocn_a_00425 10.1016/j.cognition.2009.03.013 10.1038/s41598-019-43245-z 10.1038/sj.npp.1301182 10.1056/NEJMra073096 10.1111/adb.12243 10.1080/17470210500417738 10.1016/j.neuron.2012.03.042 10.1016/j.jmva.2016.10.004 10.1007/s00213-014-3682-3 10.1177/2167702614562040 10.1523/JNEUROSCI.0085-17.2017 10.1016/S0893-133X(99)00040-8 10.1038/npp.2012.75 10.1098/rstb.2016.0206 10.1038/mp.2011.106 10.1146/annurev-neuro-071714-033928 10.1016/0091-3057(95)02135-3 10.3389/fnbeh.2017.00179 10.3758/s13415-014-0277-8 10.1111/ejn.12377 10.1162/jocn.2010.21548 10.1038/nn.2342 10.1371/journal.pone.0150165 10.1016/j.neuroimage.2018.10.075 10.1001/archpsyc.62.2.146 10.1093/ijnp/pyv013 10.3389/fpsyg.2015.01667 10.1037/h0049114 10.1159/000362840 10.1016/j.neunet.2006.03.002 10.3389/fnbeh.2017.00063 10.3758/s13415-015-0347-6 10.3389/fnbeh.2014.00237 10.1038/mp.2015.46 10.1038/s41598-018-30828-5 10.1016/j.euroneuro.2015.12.033 10.1016/j.psyneuen.2014.12.017 10.2147/NDT.S117846 10.1073/pnas.1312011110 10.1523/JNEUROSCI.2749-13.2013 10.1101/606145 10.3389/fnins.2012.00134 10.1159/000363507 10.1073/pnas.1202229109 10.1016/j.biopsych.2010.01.027 10.1126/science.1102941 10.3389/fpsyg.2014.01450 10.1177/0146167204271309 10.1523/JNEUROSCI.6376-10.2011 10.1080/00140137108931291 10.1016/j.tics.2007.10.011 10.1093/cercor/11.12.1136 10.3758/BF03328005 10.1162/0898929052880093 10.1016/j.brat.2018.09.007 10.1016/j.tics.2014.01.003 10.1016/S0149-7634(01)00009-4 10.1016/j.neuron.2011.02.027 10.1073/pnas.0503880102 10.3389/fnhum.2014.00587 10.1037/0033-2909.84.4.690 10.1002/mpr.1387 10.1016/j.bbr.2004.11.003 10.18637/jss.v067.i01 10.1111/j.1600-0447.1983.tb09716.x 10.1007/s00213-014-3762-4 10.1093/oso/9780195169157.003.0003 10.1038/nn1366 10.1111/adb.12490 10.1037/0033-2909.103.3.345 |
| ContentType | Journal Article |
| Copyright | The Author(s) 2019 COPYRIGHT 2019 Springer Psychopharmacology is a copyright of Springer, (2019). All Rights Reserved. © 2019. This work is published under http://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License. |
| Copyright_xml | – notice: The Author(s) 2019 – notice: COPYRIGHT 2019 Springer – notice: Psychopharmacology is a copyright of Springer, (2019). All Rights Reserved. © 2019. This work is published under http://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License. |
| DBID | C6C AAYXX CITATION NPM 3V. 7QG 7QR 7RV 7TK 7X7 7XB 88E 88G 8AO 8FD 8FI 8FJ 8FK ABUWG AFKRA AZQEC BENPR CCPQU DWQXO FR3 FYUFA GHDGH GNUQQ K9. KB0 M0S M1P M2M NAPCQ P64 PHGZM PHGZT PJZUB PKEHL PPXIY PQEST PQQKQ PQUKI PRINS PSYQQ Q9U 7X8 5PM |
| DOI | 10.1007/s00213-019-05299-9 |
| DatabaseName | SpringerOpen CrossRef PubMed ProQuest Central (Corporate) Animal Behavior Abstracts Chemoreception Abstracts Nursing & Allied Health Database Neurosciences Abstracts Health & Medical Collection ProQuest Central (purchase pre-March 2016) Medical Database (Alumni Edition) Psychology Database (Alumni) ProQuest Pharma Collection Technology Research Database Hospital Premium Collection Hospital Premium Collection (Alumni Edition) ProQuest Central (Alumni) (purchase pre-March 2016) ProQuest Central (Alumni) ProQuest Central UK/Ireland ProQuest Central Essentials ProQuest Central ProQuest One ProQuest Central Engineering Research Database Health Research Premium Collection Health Research Premium Collection (Alumni) ProQuest Central Student ProQuest Health & Medical Complete (Alumni) Nursing & Allied Health Database (Alumni Edition) Health & Medical Collection (Alumni) Medical Database Psychology Database Nursing & Allied Health Premium Biotechnology and BioEngineering Abstracts ProQuest Central Premium ProQuest One Academic ProQuest Health & Medical Research Collection ProQuest One Academic Middle East (New) ProQuest One Health & Nursing ProQuest One Academic Eastern Edition (DO NOT USE) ProQuest One Academic ProQuest One Academic UKI Edition ProQuest Central China ProQuest One Psychology ProQuest Central Basic MEDLINE - Academic PubMed Central (Full Participant titles) |
| DatabaseTitle | CrossRef PubMed ProQuest One Psychology ProQuest Central Student Technology Research Database ProQuest One Academic Middle East (New) ProQuest Central Essentials ProQuest Health & Medical Complete (Alumni) ProQuest Central (Alumni Edition) ProQuest One Community College ProQuest One Health & Nursing ProQuest Pharma Collection ProQuest Central China ProQuest Central ProQuest Health & Medical Research Collection Health Research Premium Collection Health and Medicine Complete (Alumni Edition) ProQuest Central Korea Health & Medical Research Collection Chemoreception Abstracts ProQuest Central (New) ProQuest Medical Library (Alumni) ProQuest Central Basic ProQuest One Academic Eastern Edition ProQuest Nursing & Allied Health Source ProQuest Hospital Collection Health Research Premium Collection (Alumni) ProQuest Psychology Journals (Alumni) Neurosciences Abstracts ProQuest Hospital Collection (Alumni) Biotechnology and BioEngineering Abstracts Nursing & Allied Health Premium ProQuest Health & Medical Complete ProQuest Medical Library ProQuest Psychology Journals ProQuest One Academic UKI Edition Animal Behavior Abstracts ProQuest Nursing & Allied Health Source (Alumni) Engineering Research Database ProQuest One Academic ProQuest One Academic (New) ProQuest Central (Alumni) MEDLINE - Academic |
| DatabaseTitleList | ProQuest One Psychology MEDLINE - Academic PubMed |
| Database_xml | – sequence: 1 dbid: C6C name: Springer Nature OA Free Journals url: http://www.springeropen.com/ sourceTypes: Publisher – sequence: 2 dbid: NPM name: PubMed url: https://proxy.k.utb.cz/login?url=http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed sourceTypes: Index Database – sequence: 3 dbid: BENPR name: ProQuest Central (ProQuest) url: https://www.proquest.com/central sourceTypes: Aggregation Database |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Medicine Pharmacy, Therapeutics, & Pharmacology |
| EISSN | 1432-2072 |
| EndPage | 2449 |
| ExternalDocumentID | PMC6695365 A596600374 31254091 10_1007_s00213_019_05299_9 |
| Genre | Journal Article |
| GeographicLocations | Germany |
| GeographicLocations_xml | – name: Germany |
| GroupedDBID | -4W -BR 40D 40E 95. 95~ ABMNI AGWIL ALMA_UNASSIGNED_HOLDINGS C6C RHV SBY SOJ ~EX .55 3SX AAYXX CITATION KOW N2Q R9- X7M --- -Y2 .86 .GJ .VR 04C 06C 06D 0R~ 0VY 123 199 1N0 1SB 2.D 203 28- 29P 29~ 2J2 2JN 2JY 2KG 2KM 2LR 2P1 2QV 2VQ 2~H 30V 36B 3O- 4.4 406 408 409 53G 5QI 5RE 5VS 67N 67Z 6NX 78A 7RV 7X7 88E 8AO 8FI 8FJ 8TC 8UJ 95- 96X AAAVM AABHQ AACDK AAHNG AAIAL AAJBT AAJKR AANXM AANZL AAPKM AARHV AARTL AASML AATNV AATVU AAUYE AAWCG AAYIU AAYQN AAYTO AAYZH ABAKF ABBBX ABBXA ABDBE ABDBF ABDZT ABECU ABFTV ABHLI ABHQN ABIPD ABIVO ABJNI ABJOX ABKCH ABKTR ABMQK ABNWP ABPLI ABQBU ABQSL ABSXP ABTAH ABTEG ABTHY ABTKH ABTMW ABULA ABUWG ABWNU ABXPI ACAOD ACBXY ACDTI ACGFS ACHSB ACHXU ACIWK ACKNC ACMDZ ACMLO ACNCT ACOKC ACOMO ACPIV ACPRK ACUHS ACZOJ ADBBV ADHHG ADHIR ADHKG ADIMF ADJJI ADKNI ADKPE ADRFC ADTPH ADURQ ADYFF ADYPR ADZKW AEBTG AEFIE AEFQL AEGAL AEGNC AEJHL AEJRE AEKMD AEMSY AENEX AEOHA AEPYU AESKC AETLH AEVLU AEXYK AFBBN AFEXP AFFNX AFGCZ AFKRA AFLOW AFQWF AFRAH AFWTZ AFZKB AGAYW AGDGC AGGDS AGJBK AGMZJ AGQEE AGQMX AGRTI AGWZB AGYKE AHAVH AHBYD AHIZS AHKAY AHMBA AHPBZ AHSBF AHYZX AIAKS AIGIU AIIXL AILAN AITGF AJBLW AJRNO AJZVZ AKMHD ALIPV ALWAN AMKLP AMXSW AMYLF AMYQR AOCGG ARMRJ ASPBG AVWKF AXYYD AYFIA AZFZN AZQEC B-. B0M BA0 BBWZM BDATZ BENPR BGNMA BKEYQ BMSDO BPHCQ BSONS BVXVI CAG CCPQU COF CS3 CSCUP DDRTE DL5 DNIVK DPUIP DU5 DWQXO DXH EAD EAP EBC EBD EBLON EBS EIHBH EIOEI EJD EMB EMK EMOBN EN4 EPAXT EPL EPS ESBYG ESX EX3 F5P FEDTE FERAY FFXSO FIGPU FINBP FNLPD FRRFC FSGXE FWDCC FYUFA G-Y G-Z GGCAI GGRSB GJIRD GNUQQ GNWQR GQ7 GQ8 GXS H13 HF~ HG5 HG6 HMCUK HMJXF HQYDN HRMNR HVGLF HZ~ I09 IAO ICJ IHE IHR IJ- IKXTQ IMOTQ INH INR IPY ITM IWAJR IXC IZIGR IZQ I~X I~Z J-C J0Z JBSCW JCJTX JZLTJ KDC KOV KPH LAS LLZTM M1P M2M M4Y MA- MK0 N9A NAPCQ NB0 NDZJH NPM NPVJJ NQJWS NU0 O9- O93 O9G O9I O9J OAM P19 P2P PF- PHGZT PQQKQ PROAC PSQYO PSYQQ PT4 PT5 Q2X QOK QOR QOS R4E R89 R9I RIG RNI ROL RPX RRX RSV RZK S16 S1Z S26 S27 S28 S3A S3B SAP SBL SCLPG SDH SDM SHX SISQX SJYHP SNE SNPRN SNX SOHCF SPISZ SRMVM SSLCW SSXJD STPWE SV3 SZN T13 T16 TN5 TSG TSK TSV TUC TUS U2A U9L UAP UG4 UKHRP UOJIU UTJUX UZXMN VC2 VFIZW W23 W48 WH7 WIP WJK WK6 WK8 WOW XOL YLTOR YQJ YYP Z45 ZGI ZMTXR ZOVNA ZY4 ~8M 3V. 7QG 7QR 7TK 7XB 8FD 8FK FR3 K9. P64 PHGZM PJZUB PKEHL PPXIY PQEST PQUKI PRINS Q9U 7X8 ABBRH ABFSG ACSTC AEZWR AFDZB AFHIU AFOHR AHWEU AIXLP ATHPR 5PM |
| ID | FETCH-LOGICAL-c541t-846f7658c30090d8b3ee9d26d2d45643b09db73ee1da18bb47d9c157b15de1243 |
| IEDL.DBID | U2A |
| ISSN | 0033-3158 1432-2072 |
| IngestDate | Thu Aug 21 18:06:30 EDT 2025 Fri Jul 11 11:50:53 EDT 2025 Sat Aug 16 12:12:22 EDT 2025 Tue Mar 18 23:29:38 EDT 2025 Sat Mar 08 18:13:10 EST 2025 Thu Apr 03 07:07:09 EDT 2025 Thu Apr 24 22:51:56 EDT 2025 Tue Jul 01 04:16:55 EDT 2025 Fri Feb 21 02:34:07 EST 2025 |
| IsDoiOpenAccess | true |
| IsOpenAccess | true |
| IsPeerReviewed | true |
| IsScholarly | true |
| Issue | 8 |
| Keywords | Decision-making Computational psychiatry Avoidance learning Reward learning Depression symptoms Reinforcement learning Affective modulation |
| Language | English |
| License | Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-c541t-846f7658c30090d8b3ee9d26d2d45643b09db73ee1da18bb47d9c157b15de1243 |
| Notes | ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 14 ObjectType-Article-2 ObjectType-Feature-1 content type line 23 |
| ORCID | 0000-0002-6006-3201 |
| OpenAccessLink | https://link.springer.com/10.1007/s00213-019-05299-9 |
| PMID | 31254091 |
| PQID | 2248792511 |
| PQPubID | 47309 |
| PageCount | 13 |
| ParticipantIDs | pubmedcentral_primary_oai_pubmedcentral_nih_gov_6695365 proquest_miscellaneous_2250613813 proquest_journals_2248792511 gale_infotracmisc_A596600374 gale_infotracacademiconefile_A596600374 pubmed_primary_31254091 crossref_primary_10_1007_s00213_019_05299_9 crossref_citationtrail_10_1007_s00213_019_05299_9 springer_journals_10_1007_s00213_019_05299_9 |
| ProviderPackageCode | CITATION AAYXX |
| PublicationCentury | 2000 |
| PublicationDate | 2019-08-01 |
| PublicationDateYYYYMMDD | 2019-08-01 |
| PublicationDate_xml | – month: 08 year: 2019 text: 2019-08-01 day: 01 |
| PublicationDecade | 2010 |
| PublicationPlace | Berlin/Heidelberg |
| PublicationPlace_xml | – name: Berlin/Heidelberg – name: Germany – name: Heidelberg |
| PublicationTitle | Psychopharmacology |
| PublicationTitleAbbrev | Psychopharmacology |
| PublicationTitleAlternate | Psychopharmacology (Berl) |
| PublicationYear | 2019 |
| Publisher | Springer Berlin Heidelberg Springer Springer Nature B.V |
| Publisher_xml | – name: Springer Berlin Heidelberg – name: Springer – name: Springer Nature B.V |
| References | CrockettMJClarkLRoiserJPRobinsonOJCoolsRChaseHWden OudenHApergis-SchouteACampbell-MeikeljohnDSeymourBSahakianBJRogersRDRobbinsTWConverging evidence for central 5-HT effects in acute tryptophan depletionMol Psychiatry20121712112310.1038/mp.2011.1061:CAS:528:DC%2BC38XhsVWhsLk%3D21876544 DayanPNivYSeymourBDawNDThe misbehavior of value and the discipline of the willNeural Netw2006191153116010.1016/j.neunet.2006.03.00216938432 Gillan C et al. (2019) Experimentally-induced and real-world acute anxiety have no effect on goal-directed behaviour bioRxiv:606145 https://doi.org/10.1101/606145 RoelofsKFreeze for action: neurobiological mechanisms in animal and human freezingPhilos Trans R Soc Lond Ser B Biol Sci20173722016020610.1098/rstb.2016.02061:CAS:528:DC%2BC1cXjsVSntrg%3D HuysQJDawNDDayanPDepression: a decision-theoretic analysisAnnu Rev Neurosci20153812310.1146/annurev-neuro-071714-0339281:CAS:528:DC%2BC2MXhsVCjurbL25705929 BelmakerRHAgamGMajor depressive disorderN Engl J Med2008358556810.1056/NEJMra0730961:CAS:528:DC%2BD1cXisFWjsQ%3D%3D18172175 CoolsRBarkerRASahakianBJRobbinsTWEnhanced or impaired cognitive function in Parkinson’s disease as a function of dopaminergic medication and task demandsCereb Cortex2001111136114310.1093/cercor/11.12.11361:STN:280:DC%2BD3MnovFKmug%3D%3D11709484 CampeseVDKimITRojasGLeDouxJEPavlovian extinction and recovery effects in aversive Pavlovian to instrumental transferFront Behav Neurosci20171110.3389/fnbeh.2017.00179289937265622165 HellerASEzieCECOttoARTimpanoKRModel-based learning and individual differences in depression: the moderating role of stressBehav Res Ther2018111192610.1016/j.brat.2018.09.00730273768 CrockettMJClarkLApergis-SchouteAMMorein-ZamirSRobbinsTWSerotonin modulates the effects of Pavlovian aversive predictions on response vigorNeuropsychopharmacology2012372244225210.1038/npp.2012.751:CAS:528:DC%2BC38Xht1ajsLbK226439303422489 NebeSKroemerNBSchadDJBernhardtNSeboldMMüllerDKSchollLKuitunen-PaulSHeinzARappMAHuysQJMSmolkaMNNo association of goal-directed and habitual control with alcohol consumption in young adultsAddict Biol20182337939310.1111/adb.1249028111829 NordCLLawsonRPHuysQJMPillingSRoiserJPDepression is associated with enhanced aversive Pavlovian control over instrumental behaviourSci Rep2018810.1038/s41598-018-30828-51:CAS:528:DC%2BC1MXjs1Grsg%3D%3D301354916105578 BoumanDStinsJFBeekPJArousal and exposure duration affect forward step initiationFront Psychol2015610.3389/fpsyg.2015.01667265790484630535 WorbeYPalminteriSSavulichGDawNDFernandez-EgeaERobbinsTWVoonVValence-dependent influence of serotonin depletion on model-based choice strategyMol Psychiatry20162162462910.1038/mp.2015.461:CAS:528:DC%2BC2MXms1Gksro%3D25869808 HuysQJMGuitart-MasipMDolanRJDayanPDecision-theoretic psychiatryClin Psychol Sci2015340042110.1177/2167702614562040 DayanPBerridgeKCModel-based and model-free Pavlovian reward learning: revaluation, revision, and revelationCogn Affect Behav Neurosci20141447349210.3758/s13415-014-0277-8246476594074442 GureckisTMLoveBCShort-term gains, long-term pains: how cues about state aid learning in dynamic environmentsCognition200911329331310.1016/j.cognition.2009.03.013194276352783717 CinottiFFresnoVAklilNCoutureauEGirardBMarchandARKhamassiMDopamine blockade impairs the exploration-exploitation trade-off in ratsSci Rep2019910.1038/s41598-019-43245-z1:CAS:528:DC%2BC1MXovVOjtr4%3D310436856494917 GarbusowMSchadDJSeboldMFriedelEBernhardtNKochSPSteinacherBKathmannNGeurtsDEMSommerCMüllerDKNebeSPaulSWittchenHUZimmermannUSWalterHSmolkaMNSterzerPRappMAHuysQJMSchlagenhaufFHeinzAPavlovian-to-instrumental transfer effects in the nucleus accumbens relate to relapse in alcohol dependenceAddict Biol20162171973110.1111/adb.122431:CAS:528:DC%2BC28XmtFSru7k%3D25828702 MATLAB (2014) Matlab version 8.3.0 (2014a). the MathWorks Inc., Natick, Massachusetts Guitart-MasipMFuentemillaLBachDRHuysQJDayanPDolanRJDuzelEAction dominates valence in anticipatory representations in the human striatum and dopaminergic midbrainJ Neurosci2011317867787510.1523/JNEUROSCI.6376-10.20111:CAS:528:DC%2BC3MXnt1Cns74%3D216135003109549 WittchenHUPfisterHDIA-X-Interviews: Manual für Screening-Verfahren und Interview; Interviewheft. In1997FrankfurtSwets & Zeitlinger GeurtsDEHuysQJden OudenHECoolsRAversive Pavlovian control of instrumental behavior in humansJ Cogn Neurosci2013251428144110.1162/jocn_a_0042523691985 LewisAHNiznikiewiczMADelamaterARDelgadoMRAvoidance-based human Pavlovian-to-instrumental transferEur J Neurosci2013383740374810.1111/ejn.1237724118624 CanliTOmuraKHaasBWFallgatterAConstableRTLeschKPBeyond affect: a role for genetic variation of the serotonin transporter in neural activation during a cognitive attention taskProc Natl Acad Sci U S A2005102122241222910.1073/pnas.05038801021:CAS:528:DC%2BD2MXps1yqsLw%3D160933151189322 CrockettMJClarkLRobbinsTWReconciling the role of serotonin in behavioral inhibition and aversion: acute tryptophan depletion abolishes punishment-induced inhibition in humansJ Neurosci200929119931199910.1523/JNEUROSCI.2513-09.20091:CAS:528:DC%2BD1MXht1ertb3F197762852775933 GeurtsDEHuysQJden OudenHECoolsRSerotonin and aversive Pavlovian control of instrumental behavior in humansJ Neurosci201333189321893910.1523/JNEUROSCI.2749-13.20131:CAS:528:DC%2BC3sXhvV2itrfL242858986618702 NishisatoSReaction time as a function of arousal and anxietyPsychon Sci1966615715810.3758/BF03328005 FingerECMarshAABuzasBKamelNRhodesRVythilinghamMPineDSGoldmanDBlairJRThe impact of tryptophan depletion and 5-HTTLPR genotype on passive avoidance and response reversal instrumental learning tasksNeuropsychopharmacology20073220621510.1038/sj.npp.13011821:CAS:528:DC%2BD28XhtlSqtbvL16900105 GillanCMOttoARPhelpsEADawNDModel-based learning protects against forming habitsCogn Affect Behav Neurosci20151552353610.3758/s13415-015-0347-6258019254526597 LallyNHuysQJMEshelNFaulknerPDayanPRoiserJPThe neural basis of aversive Pavlovian guidance during planningJ Neurosci201737102151022910.1523/JNEUROSCI.0085-17.20171:CAS:528:DC%2BC1cXhtl2ktbrI289240065647774 Lang P, Bradley M, Cuthbert BN (2008) International affective picture system (IAPS): affective ratings of pictures and instruction manual. WunderlichKSmittenaarPDolanRJDopamine enhances model-based over model-free choice behaviorNeuron20127541842410.1016/j.neuron.2012.03.0421:CAS:528:DC%2BC38XhtFKmsbfM228843263417237 LiuSSchadDJKuschpelMSRappMAHeinzAMusic and video gaming during breaks: influence on habitual versus goal-directed decision makingPLoS One20161110.1371/journal.pone.01501651:CAS:528:DC%2BC28XhsF2jsL7M269823264794202 WelfordATWhat is the basis of choice reaction-time?Ergonomics19711467969310.1080/001401371089312911:STN:280:DyaE387ovVeqtg%3D%3D5149050 BassiAWeather, mood, and voting: an experimental analysis of the effect of weather beyond turnout2013 GarofaloSRobbinsTWTriggering avoidance: dissociable influences of aversive Pavlovian conditioned stimuli on human instrumental behaviorFront Behav Neurosci20171110.3389/fnbeh.2017.00063284468685388761 Guitart-MasipMChowdhuryRSharotTDayanPDuzelEDolanRJAction controls dopaminergic enhancement of reward representationsProc Natl Acad Sci U S A20121097511751610.1073/pnas.1202229109225293633358848 HeinzABrausDFSmolkaMNWraseJPulsIHermannDKleinSGrüsserSMFlorHSchumannGMannKBüchelCAmygdala-prefrontal coupling depends on a genetic variation of the serotonin transporterNat Neurosci20058202110.1038/nn13661:CAS:528:DC%2BD2MXhtFWgug%3D%3D15592465 JinninROkamotoYTakagakiKNishiyamaYYamamuraTOkamotoYMiyakeYTakebayashiYTanakaKSugiuraYShimodaHKawakamiNA FurukawaTYamawakiSDetailed course of depressive symptoms and risk for developing depression in late adolescents with subthreshold depression: a cohort studyNeuropsychiatr Dis Treat201713253310.2147/NDT.S11784628053534 BlanchardDCGriebelGBlanchardRJMouse defensive behaviors: pharmacological and behavioral assays for anxiety and panicNeurosci Biobehav Rev20012520521810.1016/S0149-7634(01)00009-41:CAS:528:DC%2BD3MXjvV2ntb8%3D11378177 FrankMJSeebergerLCO’ReillyRCBy carrot or by stick: cognitive reinforcement learning in parkinsonismScience20043061940194310.1126/science.11029411:CAS:528:DC%2BD2cXhtVCqtbvK15528409 NeissRReconceptualizing arousal: psychobiological states in motor performancePsychol Bull198810334536610.1037/0033-2909.103.3.3451:STN:280:DyaL1c3kvVelsA%3D%3D3289072 CoolsRRobertsACRobbinsTWSerotoninergic regulation of emotional and behavioural control processesTrends Cogn Sci200812314010.1016/j.tics.2007.10.01118069045 DickinsonAPearceJMInhibitory interactions between appetitive and aversive stimuliPsychol Bull19778469071110.1037/0033-2909.84.4.690 KroemerNBLeeYPoosehSEppingerBGoschkeTSmolkaMNL-DOPA reduces model-free control of behavior by attenuating the transfer of value to actionNeuroimage201918611312510.1016/j.neuroimage.2018.10.0751:CAS:528:DC%2BC1cXitFKjtrvK30381245 FrankMJDynamic dopamine modulation in the basal ganglia: a neurocomputational account of cognitive deficits in medicated and nonmedicated parkinsonismJ Cogn Neurosci200517517210.1162/089892905288009315701239 LangPJBradleyMMCuthbertBNInternational affective picture system (IAPS) : affective ratings of pictures and instruction manual. NIMHCenter for the Study of Emotion & Attention2005FlaGainesville LyVHuysQJStinsJFRoelofsKCoolsRIndividual differences in bodily freezing predict emotional biases in decision makingFront Behav Neurosci2014810.3389/fnbeh.2014.00237250714914080288 GillanCMRobbinsTWSahakianBJvan den HeuvelOAvan WingenGThe role of habit in compulsivityEur Neuropsychopharmacol20162682884010.1016/j.euroneuro.2015.12.0331:CAS:528:DC%2BC28XhvFCmsQ%3D%3D267746614894125 HaririARDrabantEMMunozKEKolachanaBSMattayVSEganMFWeinbergerDRA susceptibility gene for affective disorders and the response of the human amygdalaArch Gen Psychiatry20056214615210.1001/archpsyc.62.2.1461:CAS:528:DC%2BD2MXhvFGmsLo%3D15699291 den OudenHESwartJCSchmidtKFekkesDGeurtsDECoolsRAcute serotonin depletion releases motivated inhibition of response vigourPsychopharmacology2015 CL Nord (5299_CR65) 2018; 8 MJ Frank (5299_CR23) 2009; 12 F Rigoli (5299_CR68) 2012; 6 K Wunderlich (5299_CR77) 2012; 75 T Canli (5299_CR8) 2005; 102 C Radenbach (5299_CR67) 2015; 53 JL Lee (5299_CR55) 2005; 159 S Nebe (5299_CR61) 2018; 23 MJ Crockett (5299_CR14) 2012; 17 A Dickinson (5299_CR19) 1977; 84 HU Wittchen (5299_CR74) 1997 M Guitart-Masip (5299_CR37) 2014; 18 5299_CR32 P Dayan (5299_CR16) 2014; 14 R Jinnin (5299_CR49) 2017; 13 N Eshel (5299_CR20) 2010; 68 MJ Crockett (5299_CR13) 2009; 29 MJ Frank (5299_CR24) 2004; 306 M Garbusow (5299_CR28) 2014; 70 MJ Frank (5299_CR22) 2005; 17 AR Otto (5299_CR66) 2013; 110 K Roelofs (5299_CR69) 2017; 372 AS Zigmond (5299_CR78) 1983; 67 P Dayan (5299_CR17) 2006; 19 TM Gureckis (5299_CR39) 2009; 113 BJ Nelson (5299_CR63) 2006; 59 S Nishisato (5299_CR64) 1966; 6 Y Worbe (5299_CR75) 2016; 21 E Friedel (5299_CR25) 2014; 8 DC Blanchard (5299_CR4) 2001; 25 DE Geurts (5299_CR30) 2013; 25 QJM Huys (5299_CR46) 2015; 3 5299_CR44 S Liu (5299_CR57) 2016; 11 FG Graeff (5299_CR35) 1996; 54 AR Hariri (5299_CR40) 2005; 62 AS Heller (5299_CR43) 2018; 111 P Winkielman (5299_CR73) 2005; 31 Y Worbe (5299_CR76) 2015; 18 ND Daw (5299_CR15) 2011; 69 VD Campese (5299_CR7) 2017; 11 M Guitart-Masip (5299_CR36) 2012; 109 AH Lewis (5299_CR56) 2013; 38 M Sebold (5299_CR71) 2014; 70 MN Hebart (5299_CR41) 2015; 232 5299_CR2 5299_CR53 DE Geurts (5299_CR31) 2013; 33 PJ Lang (5299_CR54) 2005 NB Kroemer (5299_CR51) 2019; 186 S Friedrich (5299_CR26) 2017; 153 PL Broadhurst (5299_CR6) 1957; 54 S Garofalo (5299_CR29) 2017; 11 F Jacobi (5299_CR47) 2013; 22 RH Belmaker (5299_CR3) 2008; 358 CM Gillan (5299_CR33) 2015; 15 QJ Huys (5299_CR45) 2015; 38 HE den Ouden (5299_CR18) 2015; 232 CM Gillan (5299_CR34) 2016; 26 R Cools (5299_CR11) 2008; 12 DJ Schad (5299_CR70) 2014; 5 R Cools (5299_CR10) 2001; 11 JJ Mann (5299_CR59) 1999; 21 5299_CR60 M Garbusow (5299_CR27) 2016; 21 M Jepma (5299_CR48) 2011; 23 F Cinotti (5299_CR9) 2019; 9 A Heinz (5299_CR42) 2005; 8 R Neiss (5299_CR62) 1988; 103 A Bassi (5299_CR1) 2013 EC Finger (5299_CR21) 2007; 32 AS Kayser (5299_CR50) 2015; 40 N Lally (5299_CR52) 2017; 37 M Guitart-Masip (5299_CR38) 2011; 31 D Bouman (5299_CR5) 2015; 6 MJ Crockett (5299_CR12) 2012; 37 V Ly (5299_CR58) 2014; 8 AT Welford (5299_CR72) 1971; 14 |
| References_xml | – reference: BoumanDStinsJFBeekPJArousal and exposure duration affect forward step initiationFront Psychol2015610.3389/fpsyg.2015.01667265790484630535 – reference: JepmaMNieuwenhuisSPupil diameter predicts changes in the exploration-exploitation trade-off: evidence for the adaptive gain theoryJ Cogn Neurosci2011231587159610.1162/jocn.2010.2154820666595 – reference: JinninROkamotoYTakagakiKNishiyamaYYamamuraTOkamotoYMiyakeYTakebayashiYTanakaKSugiuraYShimodaHKawakamiNA FurukawaTYamawakiSDetailed course of depressive symptoms and risk for developing depression in late adolescents with subthreshold depression: a cohort studyNeuropsychiatr Dis Treat201713253310.2147/NDT.S11784628053534 – reference: WelfordATWhat is the basis of choice reaction-time?Ergonomics19711467969310.1080/001401371089312911:STN:280:DyaE387ovVeqtg%3D%3D5149050 – reference: CrockettMJClarkLRoiserJPRobinsonOJCoolsRChaseHWden OudenHApergis-SchouteACampbell-MeikeljohnDSeymourBSahakianBJRogersRDRobbinsTWConverging evidence for central 5-HT effects in acute tryptophan depletionMol Psychiatry20121712112310.1038/mp.2011.1061:CAS:528:DC%2BC38XhsVWhsLk%3D21876544 – reference: HuysQJMGuitart-MasipMDolanRJDayanPDecision-theoretic psychiatryClin Psychol Sci2015340042110.1177/2167702614562040 – reference: LeeJLDickinsonAEverittBJConditioned suppression and freezing as measures of aversive Pavlovian conditioning: effects of discrete amygdala lesions and overtrainingBehav Brain Res200515922123310.1016/j.bbr.2004.11.00315817185 – reference: JacobiFMackSGerschlerASchollLHöflerMSiegertJBürknerAPreissSSpitzerKBuschMHapkeUGaebelWMaierWWagnerMZielasekJWittchenHUThe design and methods of the mental health module in the German Health Interview and Examination Survey for Adults (DEGS1-MH)Int J Methods Psychiatr Res201322839910.1002/mpr.138723788523 – reference: GarbusowMSchadDJSeboldMFriedelEBernhardtNKochSPSteinacherBKathmannNGeurtsDEMSommerCMüllerDKNebeSPaulSWittchenHUZimmermannUSWalterHSmolkaMNSterzerPRappMAHuysQJMSchlagenhaufFHeinzAPavlovian-to-instrumental transfer effects in the nucleus accumbens relate to relapse in alcohol dependenceAddict Biol20162171973110.1111/adb.122431:CAS:528:DC%2BC28XmtFSru7k%3D25828702 – reference: FrankMJSeebergerLCO’ReillyRCBy carrot or by stick: cognitive reinforcement learning in parkinsonismScience20043061940194310.1126/science.11029411:CAS:528:DC%2BD2cXhtVCqtbvK15528409 – reference: BroadhurstPLEmotionality and the Yerkes-Dodson lawJ Exp Psychol19575434535210.1037/h00491141:STN:280:DyaG1c%2Fitl2ktA%3D%3D13481281 – reference: FrankMJDynamic dopamine modulation in the basal ganglia: a neurocomputational account of cognitive deficits in medicated and nonmedicated parkinsonismJ Cogn Neurosci200517517210.1162/089892905288009315701239 – reference: WorbeYPalminteriSSavulichGDawNDFernandez-EgeaERobbinsTWVoonVValence-dependent influence of serotonin depletion on model-based choice strategyMol Psychiatry20162162462910.1038/mp.2015.461:CAS:528:DC%2BC2MXms1Gksro%3D25869808 – reference: Guitart-MasipMChowdhuryRSharotTDayanPDuzelEDolanRJAction controls dopaminergic enhancement of reward representationsProc Natl Acad Sci U S A20121097511751610.1073/pnas.1202229109225293633358848 – reference: GraeffFGGuimaraesFSDe AndradeTGDeakinJFRole of 5-HT in stress, anxiety, and depressionPharmacol Biochem Behav19965412914110.1016/0091-3057(95)02135-31:CAS:528:DyaK28XisVOisL4%3D8728550 – reference: LangPJBradleyMMCuthbertBNInternational affective picture system (IAPS) : affective ratings of pictures and instruction manual. NIMHCenter for the Study of Emotion & Attention2005FlaGainesville – reference: NelsonBJSanjuanMCA context-specific latent inhibition effect in a human conditioned suppression taskQ J Exp Psychol (Hove)2006591003102010.1080/17470210500417738 – reference: BassiAWeather, mood, and voting: an experimental analysis of the effect of weather beyond turnout2013 – reference: MannJJRole of the serotonergic system in the pathogenesis of major depression and suicidal behaviorNeuropsychopharmacology19992199S105S10.1016/S0893-133X(99)00040-81:CAS:528:DyaK1MXltVOntb4%3D10432495 – reference: DickinsonAPearceJMInhibitory interactions between appetitive and aversive stimuliPsychol Bull19778469071110.1037/0033-2909.84.4.690 – reference: FriedrichSBrunnerEPaulyMPermuting longitudinal data in spite of the dependenciesJ Multivar Anal201715325526510.1016/j.jmva.2016.10.004 – reference: Herrmann-Lingen C (2005) Hospital anxiety and depression scale : HADS-D ; deutsche Version ; ein Fragebogen zur Erfassung von Angst und Depressivität in der somatischen Medizin. Huber – reference: Lang P, Bradley M, Cuthbert BN (2008) International affective picture system (IAPS): affective ratings of pictures and instruction manual. – reference: GeurtsDEHuysQJden OudenHECoolsRSerotonin and aversive Pavlovian control of instrumental behavior in humansJ Neurosci201333189321893910.1523/JNEUROSCI.2749-13.20131:CAS:528:DC%2BC3sXhvV2itrfL242858986618702 – reference: Guitart-MasipMDuzelEDolanRDayanPAction versus valence in decision makingTrends Cogn Sci20141819420210.1016/j.tics.2014.01.003245815563989998 – reference: HeinzABrausDFSmolkaMNWraseJPulsIHermannDKleinSGrüsserSMFlorHSchumannGMannKBüchelCAmygdala-prefrontal coupling depends on a genetic variation of the serotonin transporterNat Neurosci20058202110.1038/nn13661:CAS:528:DC%2BD2MXhtFWgug%3D%3D15592465 – reference: NishisatoSReaction time as a function of arousal and anxietyPsychon Sci1966615715810.3758/BF03328005 – reference: WorbeYSavulichGde WitSFernandez-EgeaERobbinsTWTryptophan depletion promotes habitual over goal-directed control of appetitive responding in humansInt J Neuropsychopharmacol20151810.1093/ijnp/pyv0131:CAS:528:DC%2BC2sXhvFSjsr3I256630444648160 – reference: LewisAHNiznikiewiczMADelamaterARDelgadoMRAvoidance-based human Pavlovian-to-instrumental transferEur J Neurosci2013383740374810.1111/ejn.1237724118624 – reference: WinkielmanPBerridgeKCWilbargerJLUnconscious affective reactions to masked happy versus angry faces influence consumption behavior and judgments of valuePersonal Soc Psychol Bull20053112113510.1177/0146167204271309 – reference: NeissRReconceptualizing arousal: psychobiological states in motor performancePsychol Bull198810334536610.1037/0033-2909.103.3.3451:STN:280:DyaL1c3kvVelsA%3D%3D3289072 – reference: SchadDJJüngerESeboldMGarbusowMBernhardtNJavadiAHZimmermannUSSmolkaMNHeinzARappMAHuysQJMProcessing speed enhances model-based over model-free reinforcement learning in the presence of high working memory functioningFront Psychol2014510.3389/fpsyg.2014.01450255661314269125 – reference: RoelofsKFreeze for action: neurobiological mechanisms in animal and human freezingPhilos Trans R Soc Lond Ser B Biol Sci20173722016020610.1098/rstb.2016.02061:CAS:528:DC%2BC1cXjsVSntrg%3D – reference: DayanPBerridgeKCModel-based and model-free Pavlovian reward learning: revaluation, revision, and revelationCogn Affect Behav Neurosci20141447349210.3758/s13415-014-0277-8246476594074442 – reference: HellerASEzieCECOttoARTimpanoKRModel-based learning and individual differences in depression: the moderating role of stressBehav Res Ther2018111192610.1016/j.brat.2018.09.00730273768 – reference: EshelNRoiserJPReward and punishment processing in depressionBiol Psychiatry20106811812410.1016/j.biopsych.2010.01.02720303067 – reference: WunderlichKSmittenaarPDolanRJDopamine enhances model-based over model-free choice behaviorNeuron20127541842410.1016/j.neuron.2012.03.0421:CAS:528:DC%2BC38XhtFKmsbfM228843263417237 – reference: BlanchardDCGriebelGBlanchardRJMouse defensive behaviors: pharmacological and behavioral assays for anxiety and panicNeurosci Biobehav Rev20012520521810.1016/S0149-7634(01)00009-41:CAS:528:DC%2BD3MXjvV2ntb8%3D11378177 – reference: OttoARRaioCMChiangAPhelpsEADawNDWorking-memory capacity protects model-based learning from stressProc Natl Acad Sci U S A2013110209412094610.1073/pnas.13120111101:CAS:528:DC%2BC2cXnsF2jsg%3D%3D243241663876216 – reference: GillanCMRobbinsTWSahakianBJvan den HeuvelOAvan WingenGThe role of habit in compulsivityEur Neuropsychopharmacol20162682884010.1016/j.euroneuro.2015.12.0331:CAS:528:DC%2BC28XhvFCmsQ%3D%3D267746614894125 – reference: LallyNHuysQJMEshelNFaulknerPDayanPRoiserJPThe neural basis of aversive Pavlovian guidance during planningJ Neurosci201737102151022910.1523/JNEUROSCI.0085-17.20171:CAS:528:DC%2BC1cXhtl2ktbrI289240065647774 – reference: CrockettMJClarkLApergis-SchouteAMMorein-ZamirSRobbinsTWSerotonin modulates the effects of Pavlovian aversive predictions on response vigorNeuropsychopharmacology2012372244225210.1038/npp.2012.751:CAS:528:DC%2BC38Xht1ajsLbK226439303422489 – reference: GarofaloSRobbinsTWTriggering avoidance: dissociable influences of aversive Pavlovian conditioned stimuli on human instrumental behaviorFront Behav Neurosci20171110.3389/fnbeh.2017.00063284468685388761 – reference: GureckisTMLoveBCShort-term gains, long-term pains: how cues about state aid learning in dynamic environmentsCognition200911329331310.1016/j.cognition.2009.03.013194276352783717 – reference: WittchenHUPfisterHDIA-X-Interviews: Manual für Screening-Verfahren und Interview; Interviewheft. In1997FrankfurtSwets & Zeitlinger – reference: CanliTOmuraKHaasBWFallgatterAConstableRTLeschKPBeyond affect: a role for genetic variation of the serotonin transporter in neural activation during a cognitive attention taskProc Natl Acad Sci U S A2005102122241222910.1073/pnas.05038801021:CAS:528:DC%2BD2MXps1yqsLw%3D160933151189322 – reference: MATLAB (2014) Matlab version 8.3.0 (2014a). the MathWorks Inc., Natick, Massachusetts – reference: Gillan C et al. (2019) Experimentally-induced and real-world acute anxiety have no effect on goal-directed behaviour bioRxiv:606145 https://doi.org/10.1101/606145 – reference: LyVHuysQJStinsJFRoelofsKCoolsRIndividual differences in bodily freezing predict emotional biases in decision makingFront Behav Neurosci2014810.3389/fnbeh.2014.00237250714914080288 – reference: DawNDGershmanSJSeymourBDayanPDolanRJModel-based influences on humans’ choices and striatal prediction errorsNeuron2011691204121510.1016/j.neuron.2011.02.0271:CAS:528:DC%2BC3MXjvFejsLY%3D214355633077926 – reference: HaririARDrabantEMMunozKEKolachanaBSMattayVSEganMFWeinbergerDRA susceptibility gene for affective disorders and the response of the human amygdalaArch Gen Psychiatry20056214615210.1001/archpsyc.62.2.1461:CAS:528:DC%2BD2MXhvFGmsLo%3D15699291 – reference: RigoliFPavoneEFPezzuloGAversive pavlovian responses affect human instrumental motor performanceFront Neurosci2012610.3389/fnins.2012.00134230607383465813 – reference: CrockettMJClarkLRobbinsTWReconciling the role of serotonin in behavioral inhibition and aversion: acute tryptophan depletion abolishes punishment-induced inhibition in humansJ Neurosci200929119931199910.1523/JNEUROSCI.2513-09.20091:CAS:528:DC%2BD1MXht1ertb3F197762852775933 – reference: CoolsRBarkerRASahakianBJRobbinsTWEnhanced or impaired cognitive function in Parkinson’s disease as a function of dopaminergic medication and task demandsCereb Cortex2001111136114310.1093/cercor/11.12.11361:STN:280:DC%2BD3MnovFKmug%3D%3D11709484 – reference: CinottiFFresnoVAklilNCoutureauEGirardBMarchandARKhamassiMDopamine blockade impairs the exploration-exploitation trade-off in ratsSci Rep2019910.1038/s41598-019-43245-z1:CAS:528:DC%2BC1MXovVOjtr4%3D310436856494917 – reference: HebartMNGlascherJSerotonin and dopamine differentially affect appetitive and aversive general Pavlovian-to-instrumental transferPsychopharmacology201523243745110.1007/s00213-014-3682-31:CAS:528:DC%2BC2cXhtFyjs7zM25034118 – reference: NebeSKroemerNBSchadDJBernhardtNSeboldMMüllerDKSchollLKuitunen-PaulSHeinzARappMAHuysQJMSmolkaMNNo association of goal-directed and habitual control with alcohol consumption in young adultsAddict Biol20182337939310.1111/adb.1249028111829 – reference: HuysQJDawNDDayanPDepression: a decision-theoretic analysisAnnu Rev Neurosci20153812310.1146/annurev-neuro-071714-0339281:CAS:528:DC%2BC2MXhsVCjurbL25705929 – reference: FingerECMarshAABuzasBKamelNRhodesRVythilinghamMPineDSGoldmanDBlairJRThe impact of tryptophan depletion and 5-HTTLPR genotype on passive avoidance and response reversal instrumental learning tasksNeuropsychopharmacology20073220621510.1038/sj.npp.13011821:CAS:528:DC%2BD28XhtlSqtbvL16900105 – reference: GeurtsDEHuysQJden OudenHECoolsRAversive Pavlovian control of instrumental behavior in humansJ Cogn Neurosci2013251428144110.1162/jocn_a_0042523691985 – reference: CampeseVDKimITRojasGLeDouxJEPavlovian extinction and recovery effects in aversive Pavlovian to instrumental transferFront Behav Neurosci20171110.3389/fnbeh.2017.00179289937265622165 – reference: CoolsRRobertsACRobbinsTWSerotoninergic regulation of emotional and behavioural control processesTrends Cogn Sci200812314010.1016/j.tics.2007.10.01118069045 – reference: FrankMJDollBBOas-TerpstraJMorenoFPrefrontal and striatal dopaminergic genes predict individual differences in exploration and exploitationNat Neurosci2009121062106810.1038/nn.23421:CAS:528:DC%2BD1MXoslymtLY%3D196209783062477 – reference: GarbusowMSchadDJSommerCJüngerESeboldMFriedelEWendtJKathmannNSchlagenhaufFZimmermannUSHeinzAHuysQJMRappMAPavlovian-to-instrumental transfer in alcohol dependence: a pilot studyNeuropsychobiology20147011112110.1159/0003635071:CAS:528:DC%2BC2cXhvFehtbbP25359491 – reference: KroemerNBLeeYPoosehSEppingerBGoschkeTSmolkaMNL-DOPA reduces model-free control of behavior by attenuating the transfer of value to actionNeuroimage201918611312510.1016/j.neuroimage.2018.10.0751:CAS:528:DC%2BC1cXitFKjtrvK30381245 – reference: ZigmondASSnaithRPThe hospital anxiety and depression scaleActa Psychiatr Scand19836736137010.1111/j.1600-0447.1983.tb09716.x1:STN:280:DyaL3s3nvFWjug%3D%3D6880820 – reference: BelmakerRHAgamGMajor depressive disorderN Engl J Med2008358556810.1056/NEJMra0730961:CAS:528:DC%2BD1cXisFWjsQ%3D%3D18172175 – reference: KayserASMitchellJMWeinsteinDFrankMJDopamine, locus of control, and the exploration-exploitation tradeoffNeuropsychopharmacology20154045446210.1038/npp.2014.1931:CAS:528:DC%2BC2cXhsVWksrzJ25074639 – reference: DayanPNivYSeymourBDawNDThe misbehavior of value and the discipline of the willNeural Netw2006191153116010.1016/j.neunet.2006.03.00216938432 – reference: Bates D, Mächler M, Bolker B, Walker S (2015) Fitting linear mixed-effects models using lme4 2015 67:48 doi:https://doi.org/10.18637/jss.v067.i01 – reference: FriedelEKochSPWendtJHeinzADesernoLSchlagenhaufFDevaluation and sequential decisions: linking goal-directed and model-based behaviorFront Hum Neurosci2014810.3389/fnhum.2014.00587251363104120761 – reference: Guitart-MasipMFuentemillaLBachDRHuysQJDayanPDolanRJDuzelEAction dominates valence in anticipatory representations in the human striatum and dopaminergic midbrainJ Neurosci2011317867787510.1523/JNEUROSCI.6376-10.20111:CAS:528:DC%2BC3MXnt1Cns74%3D216135003109549 – reference: LiuSSchadDJKuschpelMSRappMAHeinzAMusic and video gaming during breaks: influence on habitual versus goal-directed decision makingPLoS One20161110.1371/journal.pone.01501651:CAS:528:DC%2BC28XhsF2jsL7M269823264794202 – reference: NordCLLawsonRPHuysQJMPillingSRoiserJPDepression is associated with enhanced aversive Pavlovian control over instrumental behaviourSci Rep2018810.1038/s41598-018-30828-51:CAS:528:DC%2BC1MXjs1Grsg%3D%3D301354916105578 – reference: GillanCMOttoARPhelpsEADawNDModel-based learning protects against forming habitsCogn Affect Behav Neurosci20151552353610.3758/s13415-015-0347-6258019254526597 – reference: RadenbachCReiterAMFEngertVSjoerdsZVillringerAHeinzeHJDesernoLSchlagenhaufFThe interaction of acute and chronic stress impairs model-based behavioral controlPsychoneuroendocrinology20155326828010.1016/j.psyneuen.2014.12.01725662093 – reference: SeboldMDesernoLNebeSSchadDJGarbusowMHägeleCKellerJJüngerEKathmannNSmolkaMRappMASchlagenhaufFHeinzAHuysQJMModel-based and model-free decisions in alcohol dependenceNeuropsychobiology20147012213110.1159/0003628401:CAS:528:DC%2BC2cXhvFehtbbI25359492 – reference: den OudenHESwartJCSchmidtKFekkesDGeurtsDECoolsRAcute serotonin depletion releases motivated inhibition of response vigourPsychopharmacology20152321303131210.1007/s00213-014-3762-41:CAS:528:DC%2BC2cXhsl2lsr3F – volume: 29 start-page: 11993 year: 2009 ident: 5299_CR13 publication-title: J Neurosci doi: 10.1523/JNEUROSCI.2513-09.2009 – volume-title: DIA-X-Interviews: Manual für Screening-Verfahren und Interview; Interviewheft. In year: 1997 ident: 5299_CR74 – volume: 40 start-page: 454 year: 2015 ident: 5299_CR50 publication-title: Neuropsychopharmacology doi: 10.1038/npp.2014.193 – volume: 25 start-page: 1428 year: 2013 ident: 5299_CR30 publication-title: J Cogn Neurosci doi: 10.1162/jocn_a_00425 – volume: 113 start-page: 293 year: 2009 ident: 5299_CR39 publication-title: Cognition doi: 10.1016/j.cognition.2009.03.013 – volume: 9 year: 2019 ident: 5299_CR9 publication-title: Sci Rep doi: 10.1038/s41598-019-43245-z – volume: 32 start-page: 206 year: 2007 ident: 5299_CR21 publication-title: Neuropsychopharmacology doi: 10.1038/sj.npp.1301182 – volume: 358 start-page: 55 year: 2008 ident: 5299_CR3 publication-title: N Engl J Med doi: 10.1056/NEJMra073096 – volume: 21 start-page: 719 year: 2016 ident: 5299_CR27 publication-title: Addict Biol doi: 10.1111/adb.12243 – volume-title: Weather, mood, and voting: an experimental analysis of the effect of weather beyond turnout year: 2013 ident: 5299_CR1 – volume: 59 start-page: 1003 year: 2006 ident: 5299_CR63 publication-title: Q J Exp Psychol (Hove) doi: 10.1080/17470210500417738 – volume: 75 start-page: 418 year: 2012 ident: 5299_CR77 publication-title: Neuron doi: 10.1016/j.neuron.2012.03.042 – volume: 153 start-page: 255 year: 2017 ident: 5299_CR26 publication-title: J Multivar Anal doi: 10.1016/j.jmva.2016.10.004 – volume: 232 start-page: 437 year: 2015 ident: 5299_CR41 publication-title: Psychopharmacology doi: 10.1007/s00213-014-3682-3 – volume: 3 start-page: 400 year: 2015 ident: 5299_CR46 publication-title: Clin Psychol Sci doi: 10.1177/2167702614562040 – volume: 37 start-page: 10215 year: 2017 ident: 5299_CR52 publication-title: J Neurosci doi: 10.1523/JNEUROSCI.0085-17.2017 – volume: 21 start-page: 99S year: 1999 ident: 5299_CR59 publication-title: Neuropsychopharmacology doi: 10.1016/S0893-133X(99)00040-8 – volume: 37 start-page: 2244 year: 2012 ident: 5299_CR12 publication-title: Neuropsychopharmacology doi: 10.1038/npp.2012.75 – volume: 372 start-page: 20160206 year: 2017 ident: 5299_CR69 publication-title: Philos Trans R Soc Lond Ser B Biol Sci doi: 10.1098/rstb.2016.0206 – volume: 17 start-page: 121 year: 2012 ident: 5299_CR14 publication-title: Mol Psychiatry doi: 10.1038/mp.2011.106 – volume: 38 start-page: 1 year: 2015 ident: 5299_CR45 publication-title: Annu Rev Neurosci doi: 10.1146/annurev-neuro-071714-033928 – volume: 54 start-page: 129 year: 1996 ident: 5299_CR35 publication-title: Pharmacol Biochem Behav doi: 10.1016/0091-3057(95)02135-3 – volume: 11 year: 2017 ident: 5299_CR7 publication-title: Front Behav Neurosci doi: 10.3389/fnbeh.2017.00179 – volume: 14 start-page: 473 year: 2014 ident: 5299_CR16 publication-title: Cogn Affect Behav Neurosci doi: 10.3758/s13415-014-0277-8 – volume: 38 start-page: 3740 year: 2013 ident: 5299_CR56 publication-title: Eur J Neurosci doi: 10.1111/ejn.12377 – volume: 23 start-page: 1587 year: 2011 ident: 5299_CR48 publication-title: J Cogn Neurosci doi: 10.1162/jocn.2010.21548 – volume: 12 start-page: 1062 year: 2009 ident: 5299_CR23 publication-title: Nat Neurosci doi: 10.1038/nn.2342 – volume: 11 year: 2016 ident: 5299_CR57 publication-title: PLoS One doi: 10.1371/journal.pone.0150165 – volume: 186 start-page: 113 year: 2019 ident: 5299_CR51 publication-title: Neuroimage doi: 10.1016/j.neuroimage.2018.10.075 – volume: 62 start-page: 146 year: 2005 ident: 5299_CR40 publication-title: Arch Gen Psychiatry doi: 10.1001/archpsyc.62.2.146 – volume: 18 year: 2015 ident: 5299_CR76 publication-title: Int J Neuropsychopharmacol doi: 10.1093/ijnp/pyv013 – volume: 6 year: 2015 ident: 5299_CR5 publication-title: Front Psychol doi: 10.3389/fpsyg.2015.01667 – volume: 54 start-page: 345 year: 1957 ident: 5299_CR6 publication-title: J Exp Psychol doi: 10.1037/h0049114 – volume: 70 start-page: 122 year: 2014 ident: 5299_CR71 publication-title: Neuropsychobiology doi: 10.1159/000362840 – volume: 19 start-page: 1153 year: 2006 ident: 5299_CR17 publication-title: Neural Netw doi: 10.1016/j.neunet.2006.03.002 – volume: 11 year: 2017 ident: 5299_CR29 publication-title: Front Behav Neurosci doi: 10.3389/fnbeh.2017.00063 – volume: 15 start-page: 523 year: 2015 ident: 5299_CR33 publication-title: Cogn Affect Behav Neurosci doi: 10.3758/s13415-015-0347-6 – volume: 8 year: 2014 ident: 5299_CR58 publication-title: Front Behav Neurosci doi: 10.3389/fnbeh.2014.00237 – volume: 21 start-page: 624 year: 2016 ident: 5299_CR75 publication-title: Mol Psychiatry doi: 10.1038/mp.2015.46 – volume: 8 year: 2018 ident: 5299_CR65 publication-title: Sci Rep doi: 10.1038/s41598-018-30828-5 – volume: 26 start-page: 828 year: 2016 ident: 5299_CR34 publication-title: Eur Neuropsychopharmacol doi: 10.1016/j.euroneuro.2015.12.033 – volume: 53 start-page: 268 year: 2015 ident: 5299_CR67 publication-title: Psychoneuroendocrinology doi: 10.1016/j.psyneuen.2014.12.017 – volume: 13 start-page: 25 year: 2017 ident: 5299_CR49 publication-title: Neuropsychiatr Dis Treat doi: 10.2147/NDT.S117846 – volume: 110 start-page: 20941 year: 2013 ident: 5299_CR66 publication-title: Proc Natl Acad Sci U S A doi: 10.1073/pnas.1312011110 – volume: 33 start-page: 18932 year: 2013 ident: 5299_CR31 publication-title: J Neurosci doi: 10.1523/JNEUROSCI.2749-13.2013 – ident: 5299_CR32 doi: 10.1101/606145 – volume: 6 year: 2012 ident: 5299_CR68 publication-title: Front Neurosci doi: 10.3389/fnins.2012.00134 – volume: 70 start-page: 111 year: 2014 ident: 5299_CR28 publication-title: Neuropsychobiology doi: 10.1159/000363507 – volume: 109 start-page: 7511 year: 2012 ident: 5299_CR36 publication-title: Proc Natl Acad Sci U S A doi: 10.1073/pnas.1202229109 – volume: 68 start-page: 118 year: 2010 ident: 5299_CR20 publication-title: Biol Psychiatry doi: 10.1016/j.biopsych.2010.01.027 – volume: 306 start-page: 1940 year: 2004 ident: 5299_CR24 publication-title: Science doi: 10.1126/science.1102941 – volume: 5 year: 2014 ident: 5299_CR70 publication-title: Front Psychol doi: 10.3389/fpsyg.2014.01450 – volume: 31 start-page: 121 year: 2005 ident: 5299_CR73 publication-title: Personal Soc Psychol Bull doi: 10.1177/0146167204271309 – volume: 31 start-page: 7867 year: 2011 ident: 5299_CR38 publication-title: J Neurosci doi: 10.1523/JNEUROSCI.6376-10.2011 – volume: 14 start-page: 679 year: 1971 ident: 5299_CR72 publication-title: Ergonomics doi: 10.1080/00140137108931291 – volume: 12 start-page: 31 year: 2008 ident: 5299_CR11 publication-title: Trends Cogn Sci doi: 10.1016/j.tics.2007.10.011 – volume: 11 start-page: 1136 year: 2001 ident: 5299_CR10 publication-title: Cereb Cortex doi: 10.1093/cercor/11.12.1136 – volume: 6 start-page: 157 year: 1966 ident: 5299_CR64 publication-title: Psychon Sci doi: 10.3758/BF03328005 – volume: 17 start-page: 51 year: 2005 ident: 5299_CR22 publication-title: J Cogn Neurosci doi: 10.1162/0898929052880093 – volume: 111 start-page: 19 year: 2018 ident: 5299_CR43 publication-title: Behav Res Ther doi: 10.1016/j.brat.2018.09.007 – volume: 18 start-page: 194 year: 2014 ident: 5299_CR37 publication-title: Trends Cogn Sci doi: 10.1016/j.tics.2014.01.003 – ident: 5299_CR44 – volume: 25 start-page: 205 year: 2001 ident: 5299_CR4 publication-title: Neurosci Biobehav Rev doi: 10.1016/S0149-7634(01)00009-4 – volume-title: Center for the Study of Emotion & Attention year: 2005 ident: 5299_CR54 – volume: 69 start-page: 1204 year: 2011 ident: 5299_CR15 publication-title: Neuron doi: 10.1016/j.neuron.2011.02.027 – volume: 102 start-page: 12224 year: 2005 ident: 5299_CR8 publication-title: Proc Natl Acad Sci U S A doi: 10.1073/pnas.0503880102 – volume: 8 year: 2014 ident: 5299_CR25 publication-title: Front Hum Neurosci doi: 10.3389/fnhum.2014.00587 – volume: 84 start-page: 690 year: 1977 ident: 5299_CR19 publication-title: Psychol Bull doi: 10.1037/0033-2909.84.4.690 – volume: 22 start-page: 83 year: 2013 ident: 5299_CR47 publication-title: Int J Methods Psychiatr Res doi: 10.1002/mpr.1387 – ident: 5299_CR60 – volume: 159 start-page: 221 year: 2005 ident: 5299_CR55 publication-title: Behav Brain Res doi: 10.1016/j.bbr.2004.11.003 – ident: 5299_CR2 doi: 10.18637/jss.v067.i01 – volume: 67 start-page: 361 year: 1983 ident: 5299_CR78 publication-title: Acta Psychiatr Scand doi: 10.1111/j.1600-0447.1983.tb09716.x – volume: 232 start-page: 1303 year: 2015 ident: 5299_CR18 publication-title: Psychopharmacology doi: 10.1007/s00213-014-3762-4 – ident: 5299_CR53 doi: 10.1093/oso/9780195169157.003.0003 – volume: 8 start-page: 20 year: 2005 ident: 5299_CR42 publication-title: Nat Neurosci doi: 10.1038/nn1366 – volume: 23 start-page: 379 year: 2018 ident: 5299_CR61 publication-title: Addict Biol doi: 10.1111/adb.12490 – volume: 103 start-page: 345 year: 1988 ident: 5299_CR62 publication-title: Psychol Bull doi: 10.1037/0033-2909.103.3.345 |
| SSID | ssj0000484 ssj0068394 |
| Score | 2.3562396 |
| Snippet | Background
Aversive stimuli in the environment influence human actions. This includes valence-dependent influences on action selection, e.g., increased... Aversive stimuli in the environment influence human actions. This includes valence-dependent influences on action selection, e.g., increased avoidance but... Background Aversive stimuli in the environment influence human actions. This includes valence-dependent influences on action selection, e.g., increased... BackgroundAversive stimuli in the environment influence human actions. This includes valence-dependent influences on action selection, e.g., increased... |
| SourceID | pubmedcentral proquest gale pubmed crossref springer |
| SourceType | Open Access Repository Aggregation Database Index Database Enrichment Source Publisher |
| StartPage | 2437 |
| SubjectTerms | Analysis Approach behavior Aversive stimuli Avoidance behavior Avoidance learning Biomedical and Life Sciences Biomedicine Computational neuroscience Computer simulation Computer-generated environments Decision making Depression, Mental Dopamine Environmental effects Learning Mental task performance Methods Mood Neuromodulation Neurosciences Original Investigation Pharmacology/Toxicology Psychiatry Punishment Reinforcement Serotonin |
| SummonAdditionalLinks | – databaseName: Health & Medical Collection dbid: 7X7 link: http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwfV3da9swEBdbB2MvY-u-vHVDg9E9LGJ2LFnW0yhjpQw6ymghb8b68Bpo7WxOO_Lf706W7TiwPgSSSDJK7nT3k-7uJ0I-ZDYuHZcpqyqRMp4YwXSVJazibm6l5kb4CrnTH9nJBf--EItw4NaGtMreJnpDbRuDZ-SfwdXkUiEg_rL6zfDWKIyuhis07pMHSF2GKV1yIUdLzLEIs_uQARLoKJlTLCgTeaig8XV06OkwrUgxDHwppiZeatdWbzmr3UTKnWiqd1LHT8jjgC7pUacOT8k9V--Th6chfr5PDs86purNjJ6PhVftjB7Ss5HDevOM_P3pMJ2WljW8bpulReWg4YqJX3RZUwCOFPPcwbjTpoJOePB26-h25Zwfvmpw2V05utxKXqeAlWmfhQuj2s31at1ct8_JxfG3868nLNzRwIzgyZoBfKkkoBiTAliLba5T55SdZ3Zukagm1bGyWsKXiS2TXGsurTKJkDoR1gG2SF-Qvbqp3StCE63iqsQdmza8jI2WXMkyzyzso-FtGZGkl0lhAoE53qNxVQzUy16OBcix8HIsVEQ-DWNWHX3Hnb0_oqgLXNvwZFOGEgWYH7JkFUcCuUyRsSciB5OesCbNtLlXliLYhLYYNTgi74dmHIl5brVrbrCPQICVJ2lEXna6Ncw7BSwKu3EYLSdaN3RApvBpS7289IzhWYZRehGRWa-f47T-_3e8vvtXvCGP5n7JYDbkAdlb_7lxbwGhrfU7vwz_AT1XNpY priority: 102 providerName: ProQuest |
| Title | Reward and avoidance learning in the context of aversive environments and possible implications for depressive symptoms |
| URI | https://link.springer.com/article/10.1007/s00213-019-05299-9 https://www.ncbi.nlm.nih.gov/pubmed/31254091 https://www.proquest.com/docview/2248792511 https://www.proquest.com/docview/2250613813 https://pubmed.ncbi.nlm.nih.gov/PMC6695365 |
| Volume | 236 |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3da9swED_WFsZextZ9eeuCBqN7WAzxhyzrMQnJykZDKA1kT8ay5C7Q2mFOO_Lf785ficM22ENwYt0Z4buTforufgL4GOhBbHzh2WnKPdt3Em6rNHDs1DeuFspPeFkhdzkLLhb-1yVf1kVhRZPt3mxJliN1W-xG0xHl_kibdqekLY_ghNPaHb144Q53469PpZfVjwDn_4qI2aMyMh7WdTN_fmBnbjocofemqMP0yYM91HJqmj6DpzWmZMPKCZ7DI5OdwuPLetf8FM7nFT_1ts-ud-VWRZ-ds_mOuXr7An5dGUqiZXGGn4d8pcklWH2wxA1bZQzhIqPsdhzSWZ6iEP3d9mDYfr1cqb7OKdhuDVvtpawzRMisyb1FrWJ7t97kd8VLWEwn1-MLuz6ZwU6472xsBC2pQOySeAjRBjpUnjFSu4F2NdHTeGogtRJ409GxEyrlCy0ThwvlcG0QUXiv4DjLM_MGmKPkII1pnaYSPx4kSvhSxGGgcfWMX2MLnMYmUVLTltPpGbdRS7hc2jFCO0alHSNpwedWZ12RdvxT-hOZOqKIxicncV2YgP0jbqxoyInBlHh6LDjrSGIkJt3mxlmieiQoIoRIoZC0kLPgQ9tMmpTdlpn8nmQ4warQ8Sx4XflW228PESiuwVFbdLyuFSB-8G5LtvpR8oQHAe3Ncwv6jX_uuvX31_H2_8TfwRO3DCHKiTyD483Pe_MecdpG9eBILEUPTobT0WhG1y_fv03wOprM5lfYOg7GvTJ0fwOmxTn3 |
| linkProvider | Springer Nature |
| linkToHtml | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwtV1Zb9NAEB6VVAJeEJTLUGCRoDwQCx-7Ph4QKtAqpU0UVanUN9d7GCK1diBpq_wpfiMzPuIkEn3rQyQnO2ttPLNzeGe-AXgXaCc1PPTtLBO-zV0lbJkFrp1x4-lQciXKCrn-IOid8B-n4nQD_ja1MJRW2ejEUlHrQtE78k9oaqIwJof4y-S3TV2j6HS1aaFRicWhmV9jyDb9fPAd-fve8_b3Rt96dt1VwFaCuzMbDW4Wot1VProXjo6kb0ysvUB7mqBVfOnEWob4o6tTN5KShzpWrgilK7RBa-jjfe_AJvcxlOnA5te9wfC41f2cyj6rLwH6HhUItE8lbCKqa3bKyj2yrZTIFNt01Bbb8YpdXLcOS-ZxPXVz7fy2NIv7D-FB7c-y3UoAH8GGybfgbr8-sd-CnWGFjT3vslFb6jXtsh02bFGz54_h-thQAi9Lc_xcFWNN4sjqphY_2Thn6KoyyqxHc8KKDInoVd-VYcu1euX0SUEb_dyw8VK6PEPvnDV5vzhrOr-YzIqL6RM4uRX-PYVOXuTmOTBXxk6WUowoFU8dJUMeh2kUaIzc8TK1wG14kqgaMp06d5wnC7Dnko8J8jEp-ZjEFnxczJlUgCE3Un8gViekTfDOKq2LInB9hMuV7ApCTyWMIAu2VyhRC6jV4UZYkloLTZN2z1jwdjFMMymzLjfFJdEIcuki17fgWSVbi3X76P1i_I-zwxWpWxAQNvnqSD7-VWKUBwHlBQgLuo18tsv6_-N4cfO_eAP3eqP-UXJ0MDh8Cfe9cvtQLuY2dGZ_Ls0r9A9n8nW9KRmc3bYe-AeoSnQ_ |
| linkToPdf | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwtV1bb9MwFD4aQ5p4QTBuGQOMBOOBRqsTO04eEJoY1cbYVKFN6luIL2GVtqTQblP_Gr-Oc3LpTWJve6iU1nbk5lwdf-czwLvIdjMnVOjnuQx9wY30dR5xPxcusEoLI6sKueOT6OBMfBvIwRr8bWthCFbZ-sTKUdvS0DvyXQw1sUooId7NG1hEf7_3efTbpxOkaKe1PU6jVpEjN73B5dv40-E-yvp9EPS-nn458JsTBnwjBZ_4GHxzhTHYhJhqdG2sQ-cSG0Q2sESzEupuYrXCH7nNeKy1UDYxXCrNpXUYGUO87z24r0LJycbUQM2jgKAC0PpLhFlITQcdUjGbjJvqnaqGj6IsQZoSnzbdEj9ZipCrcWIhUK6COFd2cqsA2XsED5vMlu3VqvgY1lyxCRvHzd79Juz0a5bsaYedzou-xh22w_pz_uzpE7j54QjKy7ICP9fl0JJisuZ4i19sWDBMWhlh7FE6rMyxE730u3ZssWqvGj4qyeQvHBsuAOcZ5umsRQDjqPH0cjQpL8dP4exOpPcM1ouycC-AcZ1084xWi9qIrGu0EonK4sjiGh4vMw94K5PUNOTpdIbHRTqjfa7kmKIc00qOaeLBx9mYUU0dcmvvDyTqlPwK3tlkTXkEzo8YutI9STyqxBbkwfZST_QHZrm5VZa08UfjdG49HrydNdNIwtgVrryiPpKSu5iHHjyvdWs27xDzYIGppQdqSetmHYilfLmlGJ5XbOVRRAgB6UGn1c_5tP7_OLZu_xdvYAOtP_1-eHL0Eh4ElfUQKHMb1id_rtwrTBQn-nVlkQx-3rUL-Af3d3cP |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Reward+and+avoidance+learning+in+the+context+of+aversive+environments+and+possible+implications+for+depressive+symptoms&rft.jtitle=Psychopharmacology+%28Berlin%2C+Germany%29&rft.au=Sebold%2C+Miriam&rft.au=Garbusow%2C+M&rft.au=Jetzschmann%2C+P&rft.au=Schad%2C+D+J&rft.date=2019-08-01&rft.eissn=1432-2072&rft.volume=236&rft.issue=8&rft.spage=2437&rft_id=info:doi/10.1007%2Fs00213-019-05299-9&rft_id=info%3Apmid%2F31254091&rft.externalDocID=31254091 |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0033-3158&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0033-3158&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0033-3158&client=summon |