The Limiting Dynamics of SGD: Modified Loss, Phase-Space Oscillations, and Anomalous Diffusion
Kunin, Daniel, Sagastuy-Brena, Javier, Gillespie, Lauren, Margalit, Eshed, Tanaka, Hidenori, Ganguli, Surya, Yamins, Daniel L K
Published in Neural computation (12.12.2023)
Published in Neural computation (12.12.2023)
Get more information
Journal Article
Recurrent Connections in the Primate Ventral Visual Stream Mediate a Trade-Off Between Task Performance and Network Size During Core Object Recognition
Nayebi, Aran, Sagastuy-Brena, Javier, Bear, Daniel M., Kar, Kohitij, Kubilius, Jonas, Ganguli, Surya, Sussillo, David, DiCarlo, James J., Yamins, Daniel L. K.
Published in Neural computation (14.07.2022)
Published in Neural computation (14.07.2022)
Get full text
Journal Article
The Limiting Dynamics of SGD: Modified Loss, Phase Space Oscillations, and Anomalous Diffusion
Kunin, Daniel, Sagastuy-Brena, Javier, Gillespie, Lauren, Eshed Margalit, Tanaka, Hidenori, Ganguli, Surya, Yamins, Daniel L K
Published in arXiv.org (28.12.2023)
Published in arXiv.org (28.12.2023)
Get full text
Paper
Journal Article
Neural Mechanics: Symmetry and Broken Conservation Laws in Deep Learning Dynamics
Kunin, Daniel, Sagastuy-Brena, Javier, Ganguli, Surya, Yamins, Daniel L. K, Tanaka, Hidenori
Year of Publication 08.12.2020
Year of Publication 08.12.2020
Get full text
Journal Article
Two Routes to Scalable Credit Assignment without Weight Symmetry
Kunin, Daniel, Nayebi, Aran, Sagastuy-Brena, Javier, Ganguli, Surya, Bloom, Jonathan M, Yamins, Daniel L. K
Year of Publication 28.02.2020
Year of Publication 28.02.2020
Get full text
Journal Article
Recurrent Connections in the Primate Ventral Visual Stream Mediate a Tradeoff Between Task Performance and Network Size During Core Object Recognition
Nayebi, Aran, Sagastuy-Brena, Javier, Bear, Daniel M, Kar, Kohitij, Kubilius, Jonas, Ganguli, Surya, Sussillo, David, Dicarlo, James J, Yamins, Daniel L K
Published in bioRxiv (18.02.2022)
Published in bioRxiv (18.02.2022)
Get full text
Paper