Modeling the interaction of learning systems in a reward-based virtual navigation task

Existence of allocentric and egocentric systems for human navigation, mediating spatial, and response learning, respectively, has so far been discussed. It is controversial whether navigational strategies and their underlying learning systems and, accordingly, the activation of their associated brai...

Full description

Saved in:
Bibliographic Details
Published inJournal of integrative neuroscience Vol. 17; no. 1; pp. 27 - 42
Main Author Raiesdana, Somayeh
Format Journal Article
LanguageEnglish
Published IMR Press 01.02.2018
Subjects
Online AccessGet full text
ISSN0219-6352
1757-448X
1757-448X
DOI10.31083/JIN-170036

Cover

Loading…
Abstract Existence of allocentric and egocentric systems for human navigation, mediating spatial, and response learning, respectively, has so far been discussed. It is controversial whether navigational strategies and their underlying learning systems and, accordingly, the activation of their associated brain areas are independent/parallel or whether they functionally/causally interact in a competitive or in a cooperative manner to solve navigational tasks. The insights provided by neural networks involved in reward-based navigation attributed to individual involvement or interactions of learning systems have been surveyed. This paper characterizes the interactions of neural networks by constructing generative neural models and investigating their functional and effective connectivity patterns. A single-subject computer-based virtual reality environment was constructed to simulate a navigation task within a naturalistic large-scale space wherein participants were rewarded for using either a place, response, or mixed strategy at different navigational stages. First, functional analyses were undertaken to evaluate neural activities via mapping brain activation and making statistical inference. Effects of interest, spatial and response learning/retrieval, and their competition and cooperation were investigated. The optimal generative model was then estimated using dynamic casual modeling to quantify effective connectivities within the network. This analysis revealed how experimental conditions supported competition and cooperation strategies and how they modulated the underlying network. Results suggest that when navigational strategies cooperated, there were statistically significant, functional, and effective connectivities between hippocampus and striatum. However, when the strategies competed, effective connections were not established among these regions. Instead, connections between hippocampus/striatum and prefrontal cortex were strengthened. It can be inferred that a type of dynamical reconfiguration occurs within a network responsible for navigation when strategies interact either cooperatively or competitively. This supports adaptive causal organization of the brain when it is engaged with goal directed behavior.
AbstractList Existence of allocentric and egocentric systems for human navigation, mediating spatial, and response learning, respectively, has so far been discussed. It is controversial whether navigational strategies and their underlying learning systems and, accordingly, the activation of their associated brain areas are independent/parallel or whether they functionally/causally interact in a competitive or in a cooperative manner to solve navigational tasks. The insights provided by neural networks involved in reward-based navigation attributed to individual involvement or interactions of learning systems have been surveyed. This paper characterizes the interactions of neural networks by constructing generative neural models and investigating their functional and effective connectivity patterns. A single-subject computer-based virtual reality environment was constructed to simulate a navigation task within a naturalistic large-scale space wherein participants were rewarded for using either a place, response, or mixed strategy at different navigational stages. First, functional analyses were undertaken to evaluate neural activities via mapping brain activation and making statistical inference. Effects of interest, spatial and response learning/retrieval, and their competition and cooperation were investigated. The optimal generative model was then estimated using dynamic casual modeling to quantify effective connectivities within the network. This analysis revealed how experimental conditions supported competition and cooperation strategies and how they modulated the underlying network. Results suggest that when navigational strategies cooperated, there were statistically significant, functional, and effective connectivities between hippocampus and striatum. However, when the strategies competed, effective connections were not established among these regions. Instead, connections between hippocampus/striatum and prefrontal cortex were strengthened. It can be inferred that a type of dynamical reconfiguration occurs within a network responsible for navigation when strategies interact either cooperatively or competitively. This supports adaptive causal organization of the brain when it is engaged with goal directed behavior.
Author Raiesdana, Somayeh
Author_xml – sequence: 1
  givenname: Somayeh
  surname: Raiesdana
  fullname: Raiesdana, Somayeh
BookMark eNo9kE1PwzAMhiM0JLbBiT-QOyokTZs0RzQBGxpwAcQtcr5GRtegpAzt31M2xMmyX_mR_UzQqIudQ-ickktGScOu7hePBRWEMH6ExlTUoqiq5m2ExqSksuCsLk_QJOc1GXomyRi9PkTr2tCtcP_ucOh6l8D0IXY4etw6SN1vlne5d5s85Bhwct-QbKEhO4u3IfVf0OIOtmEF-8Ue8scpOvbQZnf2V6fo5fbmeTYvlk93i9n1sjAlkbzgxHjZDLdQYNprUxkjTF1Zw-zwgwetNZTGMuM8WGu4bCxYamrPtZB1WbMpWhy4NsJafaawgbRTEYLaD2JaKUh9MK1TVAJpauqd9KJimoMnQEVDJeXa0EYMrIsDy6SYc3L-n0eJ2utVg1510Mt-ALWjcJo
Cites_doi 10.1007/BF01544230
10.1523/JNEUROSCI.23-13-05945.2003
10.1016/j.neuropsychologia.2010.05.033
10.3389/fnagi.2012.00029
10.1006/lmot.1997.0977
10.1016/j.neuron.2004.07.009
10.1101/lm.028753.112
10.1016/j.nlm.2014.07.002
10.1016/j.neuroimage.2009.11.015
10.1038/35107080
10.1016/j.neuroimage.2012.01.046
10.1016/j.nlm.2004.05.009
10.1006/jevp.1996.0011
10.3389/fnagi.2013.00001
10.1523/JNEUROSCI.1763-07.2007
10.3389/fnhum.2015.00125
10.1006/nimg.2001.0988
10.1016/j.neuroimage.2009.10.021
10.1016/j.neuroimage.2015.11.015
10.1016/j.neures.2006.04.009
10.3791/3443
10.1002/hbm.20873
10.1097/00001756-200401190-00026
10.1016/j.nlm.2009.08.003
10.1523/JNEUROSCI.5298-08.2009
10.1016/j.neuroimage.2013.07.008
10.1002/hipo.22181
10.1126/science.280.5365.921
10.1073/pnas.0801489105
10.1016/j.neuroimage.2004.03.026
10.1016/j.neuroimage.2008.04.262
10.1523/JNEUROSCI.0271-06.2006
10.1523/JNEUROSCI.1615-08.2008
10.1016/j.nicl.2012.10.004
ContentType Journal Article
DBID AAYXX
CITATION
DOA
DOI 10.31083/JIN-170036
DatabaseName CrossRef
DOAJ Directory of Open Access Journals
DatabaseTitle CrossRef
DatabaseTitleList CrossRef

Database_xml – sequence: 1
  dbid: DOA
  name: DOAJ Directory of Open Access Journals
  url: https://www.doaj.org/
  sourceTypes: Open Website
DeliveryMethod fulltext_linktorsrc
Discipline Anatomy & Physiology
EISSN 1757-448X
EndPage 42
ExternalDocumentID oai_doaj_org_article_19a0851fe9f743b6af0a1781916bc187
10_31083_JIN_170036
GroupedDBID ---
0R~
36B
4.4
53G
5GY
AAFWJ
AAYXX
ACIWK
ACPQW
ACPRK
ADZMO
AENEX
AFKRA
AFPKN
AFRAH
AFRHK
AJNRN
ALMA_UNASSIGNED_HOLDINGS
BBNVY
BENPR
BHPHI
CAG
CCPQU
CITATION
COF
CS3
DU5
EBS
EJD
EMOBN
F5P
GROUPED_DOAJ
H13
HCIFZ
HZ~
IL9
IOS
J8X
M7P
O9-
P2P
P71
PHGZM
PHGZT
PIMPY
PQGLB
RWJ
SAUOL
SCNPE
SFC
SJN
W2D
ID FETCH-LOGICAL-c2096-60cf980211a3bfbc4cc7c54dc3d003fabbba2cd3cefaddc698dad1c5f6b795253
IEDL.DBID DOA
ISSN 0219-6352
1757-448X
IngestDate Wed Aug 27 01:29:03 EDT 2025
Tue Aug 12 04:01:14 EDT 2025
IsDoiOpenAccess true
IsOpenAccess true
IsPeerReviewed true
IsScholarly true
Issue 1
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c2096-60cf980211a3bfbc4cc7c54dc3d003fabbba2cd3cefaddc698dad1c5f6b795253
OpenAccessLink https://doaj.org/article/19a0851fe9f743b6af0a1781916bc187
PageCount 16
ParticipantIDs doaj_primary_oai_doaj_org_article_19a0851fe9f743b6af0a1781916bc187
crossref_primary_10_31083_JIN_170036
PublicationCentury 2000
PublicationDate 2018-02-01
PublicationDateYYYYMMDD 2018-02-01
PublicationDate_xml – month: 02
  year: 2018
  text: 2018-02-01
  day: 01
PublicationDecade 2010
PublicationTitle Journal of integrative neuroscience
PublicationYear 2018
Publisher IMR Press
Publisher_xml – name: IMR Press
References ref13
ref35
ref12
ref34
ref15
ref14
ref36
ref31
ref30
ref11
ref33
ref10
ref32
ref2
ref1
ref17
ref16
ref19
ref18
ref24
ref23
ref26
ref25
ref20
ref22
ref21
ref28
ref27
ref29
ref8
ref7
ref9
ref4
ref3
ref6
ref5
References_xml – ident: ref17
  doi: 10.1007/BF01544230
– ident: ref1
  doi: 10.1523/JNEUROSCI.23-13-05945.2003
– ident: ref15
  doi: 10.1016/j.neuropsychologia.2010.05.033
– ident: ref12
  doi: 10.3389/fnagi.2012.00029
– ident: ref25
  doi: 10.1006/lmot.1997.0977
– ident: ref36
  doi: 10.1016/j.neuron.2004.07.009
– ident: ref16
  doi: 10.1101/lm.028753.112
– ident: ref3
  doi: 10.1016/j.nlm.2014.07.002
– ident: ref27
  doi: 10.1016/j.neuroimage.2009.11.015
– ident: ref20
  doi: 10.1038/35107080
– ident: ref21
  doi: 10.1016/j.neuroimage.2012.01.046
– ident: ref9
  doi: 10.1016/j.nlm.2004.05.009
– ident: ref18
  doi: 10.1006/jevp.1996.0011
– ident: ref2
  doi: 10.3389/fnagi.2013.00001
– ident: ref10
  doi: 10.1523/JNEUROSCI.1763-07.2007
– ident: ref11
– ident: ref23
  doi: 10.3389/fnhum.2015.00125
– ident: ref13
  doi: 10.1006/nimg.2001.0988
– ident: ref34
  doi: 10.1016/j.neuroimage.2009.10.021
– ident: ref29
  doi: 10.1016/j.neuroimage.2015.11.015
– ident: ref19
  doi: 10.1016/j.neures.2006.04.009
– ident: ref24
  doi: 10.3791/3443
– ident: ref33
  doi: 10.1002/hbm.20873
– ident: ref31
  doi: 10.1097/00001756-200401190-00026
– ident: ref4
  doi: 10.1016/j.nlm.2009.08.003
– ident: ref6
  doi: 10.1523/JNEUROSCI.5298-08.2009
– ident: ref28
  doi: 10.1016/j.neuroimage.2013.07.008
– ident: ref22
  doi: 10.1002/hipo.22181
– ident: ref32
  doi: 10.1126/science.280.5365.921
– ident: ref35
  doi: 10.1073/pnas.0801489105
– ident: ref8
– ident: ref30
  doi: 10.1016/j.neuroimage.2004.03.026
– ident: ref26
  doi: 10.1016/j.neuroimage.2008.04.262
– ident: ref7
  doi: 10.1523/JNEUROSCI.0271-06.2006
– ident: ref5
  doi: 10.1523/JNEUROSCI.1615-08.2008
– ident: ref14
  doi: 10.1016/j.nicl.2012.10.004
SSID ssj0021390
Score 2.0880845
Snippet Existence of allocentric and egocentric systems for human navigation, mediating spatial, and response learning, respectively, has so far been discussed. It is...
SourceID doaj
crossref
SourceType Open Website
Index Database
StartPage 27
SubjectTerms navigational strategies|spatial and response learning|radial maze|functional interactions|effective connectivities|dynamic causal modeling
Title Modeling the interaction of learning systems in a reward-based virtual navigation task
URI https://doaj.org/article/19a0851fe9f743b6af0a1781916bc187
Volume 17
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrV09T8MwELVQJxYEFET5koeKLWrcOI49FkRVKtGJom6Rz7ERQqQoLZX495ztFLqxoGx2EvnOSe696O4dIX2lc-B4JIBwIuHIIPCdsywx2ihbSMARXyj8OBOTOZ8u8sVOqy-fExblgaPjBkxpjwqcVQ6DHQjtUs0KTzMEGCZDHXmq0i2ZaqkW4ppYCpkXuAC5iJV5CGVkNpg-zBKvShdUmX9j0Y5kf4gt40Ny0IJCOoqLOSJ7tj4m3VGNhPj9i97QkKYZ_n93ybPvXuZryClCN-rVHppYm0CXjrY9IF5oFGhe4TzVtLEhNdYHrIpuXhtfMkJrvQnqGnjhWq_eTsh8fP90N0na5giJQXtFIlLjlERLmc7AgeHGFCbnlckqNM1pANBDU2XGOvyEGaFkpStmciegUPkwz05Jp17W9ozQQijHGXKTSmUcgCNmsNZLyRU4Yxj0SH_rpvIjamCUyB2CN0v0Zhm92SO33oU_p3jh6jCA21m221n-tZ3n_3GTC7KPuEbG5OpL0lk3n_YKscMarsNj8g1M8cCZ
linkProvider Directory of Open Access Journals
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Modeling+the+interaction+of+learning+systems+in+a+reward-based+virtual+navigation+task&rft.jtitle=Journal+of+integrative+neuroscience&rft.au=Raiesdana%2C+Somayeh&rft.date=2018-02-01&rft.issn=0219-6352&rft.eissn=1757-448X&rft.volume=17&rft.issue=1&rft_id=info:doi/10.31083%2FJIN-170036&rft.externalDBID=n%2Fa&rft.externalDocID=10_31083_JIN_170036
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0219-6352&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0219-6352&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0219-6352&client=summon