Image Classification at Supercomputer Scale
Ying, Chris, Kumar, Sameer, Chen, Dehao, Wang, Tao, Cheng, Youlong
Published in arXiv.org (02.12.2018)
Get full text
Published in arXiv.org (02.12.2018)
Paper
Automatic Cross-Replica Sharding of Weight Update in Data-Parallel Training
Xu, Yuanzhong, Lee, HyoukJoong, Chen, Dehao, Choi, Hongjun, Hechtman, Blake, Wang, Shibo
Published in arXiv.org (28.04.2020)
Get full text
Published in arXiv.org (28.04.2020)
Paper
GSPMD: General and Scalable Parallelization for ML Computation Graphs
Xu, Yuanzhong, Lee, HyoukJoong, Chen, Dehao, Hechtman, Blake, Huang, Yanping, Joshi, Rahul, Krikun, Maxim, Lepikhin, Dmitry, Ly, Andy, Maggioni, Marcello, Pang, Ruoming, Shazeer, Noam, Wang, Shibo, Wang, Tao, Wu, Yonghui, Chen, Zhifeng
Published in arXiv.org (23.12.2021)
Get full text
Published in arXiv.org (23.12.2021)
Paper
Exploring the limits of Concurrency in ML Training on Google TPUs
Kumar, Sameer, Bradbury, James, Young, Cliff, Wang, Yu Emma, Levskaya, Anselm, Hechtman, Blake, Chen, Dehao, Lee, HyoukJoong, Deveci, Mehmet, Kumar, Naveen, Kanwar, Pankaj, Wang, Shibo, Wanderman-Milne, Skye, Lacy, Steve, Wang, Tao, Oguntebi, Tayo, Zu, Yazhou, Xu, Yuanzhong, Swing, Andy
Published in arXiv.org (15.03.2021)
Get full text
Published in arXiv.org (15.03.2021)
Paper
Scale MLPerf-0.6 models on Google TPU-v3 Pods
Kumar, Sameer, Bitorff, Victor, Chen, Dehao, Chou, Chiachen, Hechtman, Blake, Lee, HyoukJoong, Kumar, Naveen, Mattson, Peter, Wang, Shibo, Wang, Tao, Xu, Yuanzhong, Zhou, Zongwei
Published in arXiv.org (02.10.2019)
Get full text
Published in arXiv.org (02.10.2019)
Paper
Hardware Counted Profile-Guided Optimization
Wicht, Baptiste, Vitillo, Roberto A, Chen, Dehao, Levinthal, David
Published in arXiv.org (24.11.2014)
Get full text
Published in arXiv.org (24.11.2014)
Paper
LaMDA: Language Models for Dialog Applications
Thoppilan, Romal, De Freitas, Daniel, Hall, Jamie, Shazeer, Noam, Kulshreshtha, Apoorv, Heng-Tze Cheng, Jin, Alicia, Bos, Taylor, Baker, Leslie, Du, Yu, Li, YaGuang, Lee, Hongrae, Zheng, Huaixiu Steven, Ghafouri, Amin, Menegali, Marcelo, Huang, Yanping, Krikun, Maxim, Lepikhin, Dmitry, Qin, James, Chen, Dehao, Xu, Yuanzhong, Chen, Zhifeng, Roberts, Adam, Bosma, Maarten, Zhao, Vincent, Zhou, Yanqi, Chung-Ching, Chang, Krivokon, Igor, Rusch, Will, Pickett, Marc, Srinivasan, Pranesh, Laichee Man, Meier-Hellstern, Kathleen, Meredith Ringel Morris, Doshi, Tulsee, Renelito Delos Santos, Duke, Toju, Soraker, Johnny, Zevenbergen, Ben, Prabhakaran, Vinodkumar, Diaz, Mark, Hutchinson, Ben, Olson, Kristen, Molina, Alejandra, Hoffman-John, Erin, Lee, Josh, Aroyo, Lora, Rajakumar, Ravi, Butryna, Alena, Lamm, Matthew, Kuzmina, Viktoriya, Fenton, Joe, Cohen, Aaron, Bernstein, Rachel, Kurzweil, Ray, Aguera-Arcas, Blaise, Cui, Claire, Croak, Marian, Chi, Ed, Le, Quoc
Published in arXiv.org (10.02.2022)
Get full text
Published in arXiv.org (10.02.2022)
Paper
MLPerf Training Benchmark
Mattson, Peter, Cheng, Christine, Coleman, Cody, Diamos, Greg, Micikevicius, Paulius, Patterson, David, Tang, Hanlin, Gu-Yeon, Wei, Bailis, Peter, Bittorf, Victor, Brooks, David, Chen, Dehao, Dutta, Debojyoti, Gupta, Udit, Hazelwood, Kim, Hock, Andrew, Huang, Xinyuan, Ike, Atsushi, Jia, Bill, Kang, Daniel, Kanter, David, Kumar, Naveen, Liao, Jeffery, Ma, Guokai, Narayanan, Deepak, Oguntebi, Tayo, Pekhimenko, Gennady, Pentecost, Lillian, Reddi, Vijay Janapa, Taylor, Robie, Tom St John, Tabaru, Tsuguchika, Carole-Jean Wu, Xu, Lingjie, Yamazaki, Masafumi, Young, Cliff, Zaharia, Matei
Published in arXiv.org (02.03.2020)
Get full text
Published in arXiv.org (02.03.2020)
Paper
Lingvo: a Modular and Scalable Framework for Sequence-to-Sequence Modeling
Shen, Jonathan, Nguyen, Patrick, Wu, Yonghui, Chen, Zhifeng, Chen, Mia X, Ye Jia, Kannan, Anjuli, Sainath, Tara, Cao, Yuan, Chung-Cheng, Chiu, He, Yanzhang, Chorowski, Jan, Smit Hinsu, Laurenzo, Stella, Qin, James, Firat, Orhan, Macherey, Wolfgang, Gupta, Suyog, Bapna, Ankur, Zhang, Shuyuan, Pang, Ruoming, Weiss, Ron J, Prabhavalkar, Rohit, Qiao Liang, Benoit, Jacob, Bowen, Liang, Lee, HyoukJoong, Chelba, Ciprian, Jean, Sébastien, Li, Bo, Johnson, Melvin, Rohan, Anil, Tibrewal, Rajat, Liu, Xiaobing, Eriguchi, Akiko, Jaitly, Navdeep, Naveen Ari, Cherry, Colin, Haghani, Parisa, Good, Otavio, Cheng, Youlong, Alvarez, Raziel, Caswell, Isaac, Wei-Ning, Hsu, Yang, Zongheng, Wang, Kuan-Chieh, Gonina, Ekaterina, Tomanek, Katrin, Vanik, Ben, Wu, Zelin, Jones, Llion, Schuster, Mike, Huang, Yanping, Chen, Dehao, Irie, Kazuki, Foster, George, Richardson, John, Macherey, Klaus, Bruguier, Antoine, Zen, Heiga, Raffel, Colin, Kumar, Shankar, Rao, Kanishka, Rybach, David, Murray, Matthew, Peddinti, Vijayaditya, Krikun, Maxim, Bacchiani, Michiel A U, Jablin, Thomas B, Suderman, Rob, Williams, Ian, Lee, Benjamin, Bhatia, Deepti, Carlson, Justin, Yavuz, Semih, Zhang, Yu, McGraw, Ian, Galkin, Max, Ge, Qi, Golan Pundak, Whipkey, Chad, Wang, Todd, Alon, Uri, Lepikhin, Dmitry, Tian, Ye, Sabour, Sara, Chan, William, Toshniwal, Shubham, Liao, Baohua, Nirschl, Michael, Rondon, Pat
Published in arXiv.org (21.02.2019)
Get full text
Published in arXiv.org (21.02.2019)
Paper