HINT: Hypernetwork Instruction Tuning for Efficient Zero- & Few-Shot Generalisation
Ivison, Hamish, Bhagia, Akshita, Wang, Yizhong, Hajishirzi, Hannaneh, Peters, Matthew
Year of Publication 20.12.2022
Year of Publication 20.12.2022
Get full text
Journal Article
Catwalk: A Unified Language Model Evaluation Framework for Many Datasets
Groeneveld, Dirk, Awadalla, Anas, Beltagy, Iz, Bhagia, Akshita, Magnusson, Ian, Peng, Hao, Tafjord, Oyvind, Walsh, Pete, Richardson, Kyle, Dodge, Jesse
Year of Publication 15.12.2023
Year of Publication 15.12.2023
Get full text
Journal Article
Continued Pretraining for Better Zero- and Few-Shot Promptability
Wu, Zhaofeng, LoganIV, Robert L, Walsh, Pete, Bhagia, Akshita, Groeneveld, Dirk, Singh, Sameer, Beltagy, Iz
Year of Publication 18.10.2022
Year of Publication 18.10.2022
Get full text
Journal Article
On Advances in Text Generation from Images Beyond Captioning: A Case Study in Self-Rationalization
Palaskar, Shruti, Bhagia, Akshita, Bisk, Yonatan, Metze, Florian, Black, Alan W, Marasović, Ana
Year of Publication 23.05.2022
Year of Publication 23.05.2022
Get full text
Journal Article
What's In My Big Data?
Elazar, Yanai, Bhagia, Akshita, Magnusson, Ian, Ravichander, Abhilasha, Schwenk, Dustin, Suhr, Alane, Walsh, Pete, Groeneveld, Dirk, Soldaini, Luca, Singh, Sameer, Hajishirzi, Hanna, Smith, Noah A, Dodge, Jesse
Year of Publication 31.10.2023
Year of Publication 31.10.2023
Get full text
Journal Article
Paloma: A Benchmark for Evaluating Language Model Fit
Magnusson, Ian, Bhagia, Akshita, Hofmann, Valentin, Soldaini, Luca, Jha, Ananya Harsh, Tafjord, Oyvind, Schwenk, Dustin, Walsh, Evan Pete, Elazar, Yanai, Lo, Kyle, Groeneveld, Dirk, Beltagy, Iz, Hajishirzi, Hannaneh, Smith, Noah A, Richardson, Kyle, Dodge, Jesse
Year of Publication 16.12.2023
Year of Publication 16.12.2023
Get full text
Journal Article
OLMoE: Open Mixture-of-Experts Language Models
Muennighoff, Niklas, Soldaini, Luca, Groeneveld, Dirk, Lo, Kyle, Morrison, Jacob, Min, Sewon, Shi, Weijia, Walsh, Pete, Tafjord, Oyvind, Lambert, Nathan, Gu, Yuling, Arora, Shane, Bhagia, Akshita, Schwenk, Dustin, Wadden, David, Wettig, Alexander, Hui, Binyuan, Dettmers, Tim, Kiela, Douwe, Farhadi, Ali, Smith, Noah A, Koh, Pang Wei, Singh, Amanpreet, Hajishirzi, Hannaneh
Year of Publication 03.09.2024
Year of Publication 03.09.2024
Get full text
Journal Article
Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research
Soldaini, Luca, Kinney, Rodney, Bhagia, Akshita, Schwenk, Dustin, Atkinson, David, Authur, Russell, Bogin, Ben, Chandu, Khyathi, Dumas, Jennifer, Elazar, Yanai, Hofmann, Valentin, Jha, Ananya Harsh, Kumar, Sachin, Lucy, Li, Lyu, Xinxi, Lambert, Nathan, Magnusson, Ian, Morrison, Jacob, Muennighoff, Niklas, Naik, Aakanksha, Nam, Crystal, Peters, Matthew E, Ravichander, Abhilasha, Richardson, Kyle, Shen, Zejiang, Strubell, Emma, Subramani, Nishant, Tafjord, Oyvind, Walsh, Pete, Zettlemoyer, Luke, Smith, Noah A, Hajishirzi, Hannaneh, Beltagy, Iz, Groeneveld, Dirk, Dodge, Jesse, Lo, Kyle
Year of Publication 31.01.2024
Year of Publication 31.01.2024
Get full text
Journal Article
OLMo: Accelerating the Science of Language Models
Groeneveld, Dirk, Beltagy, Iz, Walsh, Pete, Bhagia, Akshita, Kinney, Rodney, Tafjord, Oyvind, Jha, Ananya Harsh, Ivison, Hamish, Magnusson, Ian, Wang, Yizhong, Arora, Shane, Atkinson, David, Authur, Russell, Chandu, Khyathi Raghavi, Cohan, Arman, Dumas, Jennifer, Elazar, Yanai, Gu, Yuling, Hessel, Jack, Khot, Tushar, Merrill, William, Morrison, Jacob, Muennighoff, Niklas, Naik, Aakanksha, Nam, Crystal, Peters, Matthew E, Pyatkin, Valentina, Ravichander, Abhilasha, Schwenk, Dustin, Shah, Saurabh, Smith, Will, Strubell, Emma, Subramani, Nishant, Wortsman, Mitchell, Dasigi, Pradeep, Lambert, Nathan, Richardson, Kyle, Zettlemoyer, Luke, Dodge, Jesse, Lo, Kyle, Soldaini, Luca, Smith, Noah A, Hajishirzi, Hannaneh
Year of Publication 01.02.2024
Year of Publication 01.02.2024
Get full text
Journal Article
Continued Pretraining for Better Zero- and Few-Shot Promptability
Wu, Zhaofeng, Logan, Robert L, Walsh, Pete, Bhagia, Akshita, Groeneveld, Dirk, Singh, Sameer, Beltagy, Iz
Published in arXiv.org (21.10.2022)
Get full text
Published in arXiv.org (21.10.2022)
Paper
What's In My Big Data?
Yanai Elazar, Bhagia, Akshita, Magnusson, Ian, Ravichander, Abhilasha, Schwenk, Dustin, Suhr, Alane, Walsh, Pete, Groeneveld, Dirk, Soldaini, Luca, Singh, Sameer, Hajishirzi, Hanna, Smith, Noah A, Dodge, Jesse
Published in arXiv.org (05.03.2024)
Get full text
Published in arXiv.org (05.03.2024)
Paper
Paloma: A Benchmark for Evaluating Language Model Fit
Magnusson, Ian, Bhagia, Akshita, Hofmann, Valentin, Soldaini, Luca, Ananya Harsh Jha, Tafjord, Oyvind, Schwenk, Dustin, Walsh, Evan Pete, Yanai Elazar, Lo, Kyle, Groeneveld, Dirk, Beltagy, Iz, Hannaneh Hajishirzi, Smith, Noah A, Richardson, Kyle, Dodge, Jesse
Published in arXiv.org (16.12.2023)
Get full text
Published in arXiv.org (16.12.2023)
Paper
Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research
Soldaini, Luca, Kinney, Rodney, Bhagia, Akshita, Schwenk, Dustin, Atkinson, David, Russell Authur, Bogin, Ben, Khyathi Chandu, Dumas, Jennifer, Yanai Elazar, Hofmann, Valentin, Ananya Harsh Jha, Kumar, Sachin, Li, Lucy, Lyu, Xinxi, Lambert, Nathan, Magnusson, Ian, Morrison, Jacob, Muennighoff, Niklas, Naik, Aakanksha, Nam, Crystal, Peters, Matthew E, Ravichander, Abhilasha, Richardson, Kyle, Shen, Zejiang, Strubell, Emma, Subramani, Nishant, Tafjord, Oyvind, Walsh, Pete, Zettlemoyer, Luke, Smith, Noah A, Hannaneh Hajishirzi, Beltagy, Iz, Groeneveld, Dirk, Dodge, Jesse, Lo, Kyle
Published in arXiv.org (06.06.2024)
Get full text
Published in arXiv.org (06.06.2024)
Paper
OLMo: Accelerating the Science of Language Models
Groeneveld, Dirk, Beltagy, Iz, Walsh, Pete, Bhagia, Akshita, Kinney, Rodney, Tafjord, Oyvind, Ananya Harsh Jha, Ivison, Hamish, Magnusson, Ian, Wang, Yizhong, Arora, Shane, Atkinson, David, Russell Authur, Khyathi, Raghavi Chandu, Cohan, Arman, Dumas, Jennifer, Yanai Elazar, Gu, Yuling, Hessel, Jack, Khot, Tushar, Merrill, William, Morrison, Jacob, Muennighoff, Niklas, Naik, Aakanksha, Nam, Crystal, Peters, Matthew E, Pyatkin, Valentina, Ravichander, Abhilasha, Schwenk, Dustin, Shah, Saurabh, Smith, Will, Strubell, Emma, Subramani, Nishant, Wortsman, Mitchell, Dasigi, Pradeep, Lambert, Nathan, Richardson, Kyle, Zettlemoyer, Luke, Dodge, Jesse, Lo, Kyle, Soldaini, Luca, Smith, Noah A, Hannaneh Hajishirzi
Published in arXiv.org (07.06.2024)
Get full text
Published in arXiv.org (07.06.2024)
Paper