Enabling Transformers to Understand Low-Level Programs
Guo, Zifan Carl, Moses, William S.
Published in 2022 IEEE High Performance Extreme Computing Conference (HPEC) (19.09.2022)
Published in 2022 IEEE High Performance Extreme Computing Conference (HPEC) (19.09.2022)
Get full text
Conference Proceeding
Survival of the Fittest Representation: A Case Study with Modular Addition
Ding, Xiaoman Delores, Guo, Zifan Carl, Michaud, Eric J, Liu, Ziming, Tegmark, Max
Year of Publication 27.05.2024
Year of Publication 27.05.2024
Get full text
Journal Article
Algorithmic progress in language models
Ho, Anson, Besiroglu, Tamay, Erdil, Ege, Owen, David, Rahman, Robi, Guo, Zifan Carl, Atkinson, David, Thompson, Neil, Sevilla, Jaime
Year of Publication 09.03.2024
Year of Publication 09.03.2024
Get full text
Journal Article
Universal Neurons in GPT2 Language Models
Gurnee, Wes, Horsley, Theo, Guo, Zifan Carl, Kheirkhah, Tara Rezaei, Sun, Qinyi, Hathaway, Will, Nanda, Neel, Bertsimas, Dimitris
Year of Publication 22.01.2024
Year of Publication 22.01.2024
Get full text
Journal Article
Opening the AI black box: program synthesis via mechanistic interpretability
Michaud, Eric J, Liao, Isaac, Lad, Vedang, Liu, Ziming, Mudide, Anish, Loughridge, Chloe, Guo, Zifan Carl, Kheirkhah, Tara Rezaei, Vukelić, Mateja, Tegmark, Max
Year of Publication 07.02.2024
Year of Publication 07.02.2024
Get full text
Journal Article
Algorithmic progress in language models
Ho, Anson, Besiroglu, Tamay, Erdil, Ege, Owen, David, Rahman, Robi, Guo, Zifan Carl, Atkinson, David, Thompson, Neil, Sevilla, Jaime
Published in arXiv.org (09.03.2024)
Get full text
Published in arXiv.org (09.03.2024)
Paper
Universal Neurons in GPT2 Language Models
Gurnee, Wes, Horsley, Theo, Guo, Zifan Carl, Tara Rezaei Kheirkhah, Sun, Qinyi, Hathaway, Will, Nanda, Neel, Bertsimas, Dimitris
Published in arXiv.org (22.01.2024)
Get full text
Published in arXiv.org (22.01.2024)
Paper