Eagle and Finch: RWKV with Matrix-Valued States and Dynamic Recurrence
Peng, Bo, Goldstein, Daniel, Anthony, Quentin, Albalak, Alon, Alcaide, Eric, Biderman, Stella, Cheah, Eugene, Du, Xingjian, Ferdinan, Teddy, Hou, Haowen, Kazienko, Przemysław, GV, Kranthi Kiran, Kocoń, Jan, Koptyra, Bartłomiej, Satyapriya Krishna, McClelland, Ronald, Lin, Jiaju, Muennighoff, Niklas, Obeid, Fares, Saito, Atsushi, Song, Guangyu, Tu, Haoqin, Wirawan, Cahya, Woźniak, Stanisław, Zhang, Ruichong, Zhao, Bingchen, Zhao, Qihang, Zhou, Peng, Zhu, Jian, Rui-Jie Zhu
Published in arXiv.org (26.09.2024)
Get full text
Published in arXiv.org (26.09.2024)
Paper
DE2510658
SUSTARSIC, JOHN DAVID, MCKEES ROCKS, PA., US, EDGAR, WILLIAM DUNLAP, ALLISON PARK, PA., US, MCCLELLAND, RONALD ORLANDO, PITTSBURGH, PA., US
Year of Publication 10.03.1983
Get full text
Year of Publication 10.03.1983
Patent