Contextual Counting: A Mechanistic Study of Transformers on a Quantitative Task
Golkar, Siavash, Bietti, Alberto, Pettee, Mariel, Eickenberg, Michael, Cranmer, Miles, Hirashima, Keiya, Krawezik, Geraud, Lourie, Nicholas, McCabe, Michael, Morel, Rudy, Ohana, Ruben, Parker, Liam Holden, Blancard, Bruno Régaldo-Saint, Cho, Kyunghyun, Ho, Shirley
Year of Publication 30.05.2024
Year of Publication 30.05.2024
Get full text
Journal Article
Multiple Physics Pretraining for Physical Surrogate Models
McCabe, Michael, Blancard, Bruno Régaldo-Saint, Parker, Liam Holden, Ohana, Ruben, Cranmer, Miles, Bietti, Alberto, Eickenberg, Michael, Golkar, Siavash, Krawezik, Geraud, Lanusse, Francois, Pettee, Mariel, Tesileanu, Tiberiu, Cho, Kyunghyun, Ho, Shirley
Year of Publication 04.10.2023
Year of Publication 04.10.2023
Get full text
Journal Article
Contextual Counting: A Mechanistic Study of Transformers on a Quantitative Task
Golkar, Siavash, Bietti, Alberto, Pettee, Mariel, Eickenberg, Michael, Cranmer, Miles, Hirashima, Keiya, Geraud Krawezik, Lourie, Nicholas, McCabe, Michael, Morel, Rudy, Ohana, Ruben, Liam Holden Parker, Bruno Régaldo-Saint Blancard, Cho, Kyunghyun, Ho, Shirley
Published in arXiv.org (30.05.2024)
Get full text
Published in arXiv.org (30.05.2024)
Paper
Multiple Physics Pretraining for Physical Surrogate Models
McCabe, Michael, Bruno Régaldo-Saint Blancard, Liam Holden Parker, Ohana, Ruben, Cranmer, Miles, Bietti, Alberto, Eickenberg, Michael, Golkar, Siavash, Geraud Krawezik, Lanusse, Francois, Pettee, Mariel, Tesileanu, Tiberiu, Cho, Kyunghyun, Ho, Shirley
Published in arXiv.org (04.10.2023)
Get full text
Published in arXiv.org (04.10.2023)
Paper