How to build a cognitive map

Scoville, W. B. & Milner, B. Loss of recent memory after bilateral hippocampal lesions. J. Neurol. Neurosurg. Psychiatry 20, 11–21 (1957).

CAS  PubMed  PubMed Central  Article  Google Scholar 

Cohen, N. J. & Squire, L. R. Preserved learning and retention of pattern-analyzing skill in amnesia: dissociation of knowing how and knowing that. Science 210, 207–210 (1980).

CAS  PubMed  Article  Google Scholar 

O’Keefe, J. & Nadel, L. The Hippocampus as a Cognitive Map (Oxford Univ. Press, 1978).

Hafting, T., Fyhn, M., Molden, S., Moser, M. B. & Moser, E. I. Microstructure of a spatial map in the entorhinal cortex. Nature 436, 801–806 (2005).

CAS  PubMed  Article  Google Scholar 

Hassabis, D., Kumaran, D., Vann, S. D. & Maguire, E. A. Patients with hippocampal amnesia cannot imagine new experiences. Proc. Natl Acad. Sci. USA 104, 1726–1731 (2007).

CAS  PubMed  PubMed Central  Article  Google Scholar 

Tolman, E. C. Cognitive maps in rats and men. Psychol. Rev. 55, 189–208 (1948).

CAS  PubMed  Article  Google Scholar 

Turner, C. H. The homing of ants: an experimental study of ant behavior. J. Comp. Neurol. Psychol. 17, 367–434 (1907).

Zanforlin, M. & Poli, G. The burrowing rat: a new technique to study place learning and orientation. Acti. Memorie 82, 653–670 (1970).

Google Scholar 

Behrens, T. E. J. et al. What is a cognitive map? Organizing knowledge for flexible behavior. Neuron 100, 490–509 (2018).

CAS  PubMed  Article  Google Scholar 

Tenenbaum, J. B., Kemp, C., Griffiths, T. L. & Goodman, N. D. How to grow a mind: statistics, structure and abstraction. Science 331, 1279–1285 (2011).

CAS  PubMed  Article  Google Scholar 

Bartlett, F. C. & Burt, C. Remembering: a study in experimental and social psychology. Br. J. Educ. Psychol. 3, 187–192 (1932).

Article  Google Scholar 

Harlow, H. F. The formation of learning sets. Psychological Rev. 56, 51–65 (1949).

CAS  Article  Google Scholar 

Moser, E. I., Moser, M.-B. & McNaughton, B. L. Spatial representation in the hippocampal formation: a history. Nat. Neurosci. 20, 1448–1464 (2017).

CAS  PubMed  Article  Google Scholar 

Aronov, D., Nevers, R. & Tank, D. W. Mapping of a non-spatial dimension by the hippocampal–entorhinal circuit. Nature 543, 719–722 (2017).

CAS  PubMed  PubMed Central  Article  Google Scholar 

Knudsen, E. B. & Wallis, J. D. Hippocampal neurons construct a map of an abstract value space. Cell 184, 4640–4650 (2021).

CAS  PubMed  PubMed Central  Article  Google Scholar 

Nieh, E. H. et al. Geometry of abstract learned knowledge in the hippocampus. Nature https://doi.org/10.1038/s41586-021-03652-7 (2021).

Doeller, C. F., Barry, C. & Burgess, N. Evidence for grid cells in a human memory network. Nature 463, 657–661 (2010).

CAS  PubMed  PubMed Central  Article  Google Scholar 

Constantinescu, A. O. et al. Organizing conceptual knowledge in humans with a gridlike code. Science 352, 1464–1468 (2016).

CAS  PubMed  PubMed Central  Article  Google Scholar 

Bao, X. et al. Grid-like neural representations support olfactory navigation of a two-dimensional odor space. Neuron 102, 1066–1075 (2019).

CAS  PubMed  PubMed Central  Article  Google Scholar 

Park, S. A., Miller, D. S., Nili, H., Ranganath, C. & Boorman, E. D. Map making: constructing, combining and inferring on abstract cognitive maps. Neuron 107, 1226–1238 (2020).

CAS  PubMed  PubMed Central  Article  Google Scholar 

Bongioanni, A. et al. Activation and disruption of a neural mechanism for novel choice in monkeys. Nature 591, 270–274 (2021).

CAS  PubMed  PubMed Central  Article  Google Scholar 

Rueckemann, J. W., Sosa, M., Giocomo, L. M. & Buffalo, E. A. The grid code for ordered experience. Nat. Rev. Neurosci. 22, 637–649 (2021).

CAS  PubMed  PubMed Central  Article  Google Scholar 

Radulescu, A., Shin, Y. S. & Niv, Y. Human representation learning. Annu. Rev. Neurosci. 44, 253–273 (2021).

CAS  PubMed  Article  Google Scholar 

Sanders, H., Wilson, M. A. & Gershman, S. J. Hippocampal remapping as hidden state inference. eLife 9, e51140 (2020).

PubMed  PubMed Central  Article  Google Scholar 

Stoianov, I., Maisto, D. & Pezzulo, G. The hippocampal formation as a hierarchical generative model supporting generative replay and continual learning. Prog. Neurobiol. 217, 102329 (2022).

PubMed  Article  Google Scholar 

Niv, Y. Learning task-state representations. Nat. Neurosci. 22, 1544–1553 (2019).

CAS  PubMed  PubMed Central  Article  Google Scholar 

Sutton, R. S. & Barto, A. G. Reinforcement learning: an introduction. in IEEE Transactions on Neural Networks https://doi.org/10.1109/TNN.1998.712192 (2017).

Bellman, R. A Markovian decision process. J. Math. Mech. 6, 679–684 (1957).

Gershman, S. J. & Niv, Y. Learning latent structure: carving nature at its joints. Curr. Opin. Neurobiol. 20, 251–256 (2010).

CAS  PubMed  PubMed Central  Article  Google Scholar 

Wilson, R. C., Takahashi, Y. K., Schoenbaum, G. & Niv, Y. Orbitofrontal cortex as a cognitive map of task space. Neuron 81, 267–278 (2014).

CAS  PubMed  PubMed Central  Article  Google Scholar 

Watkins, C. J. C. H. & Dayan, P. Technical note: Q-learning. Mach. Learn. 8, 279–292 (1992).

Google Scholar 

Tolman, E. C., Ritchie, B. F. & Kalish, D. Studies in spatial learning. I. Orientation and the short-cut. J. Exp. Psychol. 36, 13–24 (1946).

CAS  PubMed  Article  Google Scholar 

Bush, D., Barry, C., Manson, D. & Burgess, N. Using grid cells for navigation. Neuron 87, 507–520 (2015).

CAS  PubMed  PubMed Central  Article  Google Scholar 

Stemmler, M., Mathis, A. & Herz, A. V. M. Connecting multiple spatial scales to decode the population activity of grid cells. Sci. Adv. 1, e1500816 (2015).

PubMed  PubMed Central  Article  Google Scholar 

Foster, D. J., Morris, R. G. M. & Dayan, P. A model of hippocampally dependent navigation, using the temporal difference learning rule. Hippocampus 10, 1–16 (2000).

CAS  PubMed  Article  Google Scholar 

Gustafson, N. J. & Daw, N. D. Grid cells, place cells and geodesic generalization for spatial reinforcement learning. PLoS Comput. Biol. 7, e1002235 (2011).

CAS  PubMed  PubMed Central  Article  Google Scholar 

Stachenfeld, K. L., Botvinick, M. M. & Gershman, S. J. The hippocampus as a predictive map. Nat. Neurosci. 20, 1643–1653 (2017).

CAS  PubMed  Article  Google Scholar 

Piray, P. & Daw, N. D. A model for learning based on the joint estimation of stochasticity and volatility. Nat. Commun. 12, 6587 (2021).

CAS  PubMed  PubMed Central  Article  Google Scholar 

Dusek, J. A. & Eichenbaum, H. The hippocampus and memory for orderly stimulus relations. Proc. Natl Acad. Sci. USA 94, 7109–7114 (1997).

CAS  PubMed  PubMed Central  Article  Google Scholar 

Wood, E. R., Dudchenko, P. A., Robitsek, R. J. & Eichenbaum, H. Hippocampal neurons encode information about different types of memory episodes occurring in the same location. Neuron 27, 623–633 (2000).

CAS  PubMed  Article  Google Scholar 

Frank, L. M., Brown, E. N. & Wilson, M. Trajectory encoding in the hippocampus and entorhinal cortex. Neuron 27, 169–178 (2000).

CAS  PubMed  Article  Google Scholar 

Komorowski, R. W., Manns, J. R. & Eichenbaum, H. Robust conjunctive item-place coding by hippocampal neurons parallels learning what happens where. J. Neurosci. 29, 9918–9929 (2009).

CAS  PubMed  PubMed Central  Article  Google Scholar 

Carpenter, F., Manson, D., Jeffery, K., Burgess, N. & Barry, C. Grid cells form a global representation of connected environments. Curr. Biol. 25, 1176–1182 (2015).

CAS  PubMed  PubMed Central  Article 

留言 (0)

沒有登入
gif