Jamba: A Hybrid Transformer-Mamba Language Model
Lieber, Opher, Lenz, Barak, Bata, Hofit, Cohen, Gal, Osin, Jhonathan, Dalmedigos, Itay, Safahi, Erez, Meirom, Shaked, Belinkov, Yonatan, Shalev-Shwartz, Shai, Abend, Omri, Alon, Raz, Asida, Tomer, Bergman, Amir, Glozman, Roman, Gokhman, Michael, Manevich, Avashalom, Ratner, Nir, Rozen, Noam, Shwartz, Erez, Zusman, Mor, Shoham, Yoav
Year of Publication 28.03.2024
Year of Publication 28.03.2024
Get full text
Journal Article
Jamba-1.5: Hybrid Transformer-Mamba Models at Scale
Jamba Team, Lenz, Barak, Arazi, Alan, Bergman, Amir, Manevich, Avshalom, Peleg, Barak, Aviram, Ben, Almagor, Chen, Fridman, Clara, Padnos, Dan, Gissin, Daniel, Jannai, Daniel, Muhlgay, Dor, Zimberg, Dor, Gerber, Edden M, Dolev, Elad, Krakovsky, Eran, Safahi, Erez, Schwartz, Erez, Cohen, Gal, Shachaf, Gal, Rozenblum, Haim, Bata, Hofit, Blass, Ido, Magar, Inbal, Dalmedigos, Itay, Osin, Jhonathan, Fadlon, Julie, Rozman, Maria, Danos, Matan, Gokhman, Michael, Zusman, Mor, Gidron, Naama, Ratner, Nir, Gat, Noam, Rozen, Noam, Fried, Oded, Leshno, Ohad, Antverg, Omer, Abend, Omri, Lieber, Opher, Dagan, Or, Cohavi, Orit, Alon, Raz, Belson, Ro'i, Cohen, Roi, Gilad, Rom, Glozman, Roman, Lev, Shahar, Meirom, Shaked, Delbari, Tal, Ness, Tal, Asida, Tomer, Gal, Tom Ben, Braude, Tom, Pumerantz, Uriya, Cohen, Yehoshua, Belinkov, Yonatan, Globerson, Yuval, Levy, Yuval Peleg, Shoham, Yoav
Year of Publication 22.08.2024
Year of Publication 22.08.2024
Get full text
Journal Article
Jamba: A Hybrid Transformer-Mamba Language Model
Lieber, Opher, Lenz, Barak, Bata, Hofit, Cohen, Gal, Osin, Jhonathan, Dalmedigos, Itay, Safahi, Erez, Shaked Meirom, Belinkov, Yonatan, Shalev-Shwartz, Shai, Abend, Omri, Raz Alon, Asida, Tomer, Bergman, Amir, Glozman, Roman, Gokhman, Michael, Manevich, Avashalom, Ratner, Nir, Rozen, Noam, Shwartz, Erez, Zusman, Mor, Shoham, Yoav
Published in arXiv.org (03.07.2024)
Get full text
Published in arXiv.org (03.07.2024)
Paper
Jamba-1.5: Hybrid Transformer-Mamba Models at Scale
Jamba Team, Lenz, Barak, Arazi, Alan, Bergman, Amir, Manevich, Avshalom, Peleg, Barak, Aviram, Ben, Chen, Almagor, Fridman, Clara, Padnos, Dan, Gissin, Daniel, Jannai, Daniel, Dor Muhlgay, Dor Zimberg, Gerber, Edden M, Dolev, Elad, Krakovsky, Eran, Safahi, Erez, Schwartz, Erez, Cohen, Gal, Shachaf, Gal, Rozenblum, Haim, Bata, Hofit, Blass, Ido, Magar, Inbal, Dalmedigos, Itay, Osin, Jhonathan, Fadlon, Julie, Rozman, Maria, Danos, Matan, Gokhman, Michael, Zusman, Mor, Gidron, Naama, Ratner, Nir, Gat, Noam, Rozen, Noam, Fried, Oded, Leshno, Ohad, Antverg, Omer, Abend, Omri, Lieber, Opher, Dagan, Or, Cohavi, Orit, Raz Alon, Belson, Ro'i, Cohen, Roi, Rom Gilad, Glozman, Roman, Shahar Lev, Shaked Meirom, Delbari, Tal, Ness, Tal, Asida, Tomer, Tom Ben Gal, Braude, Tom, Pumerantz, Uriya, Cohen, Yehoshua, Belinkov, Yonatan, Globerson, Yuval, Yuval Peleg Levy, Shoham, Yoav
Published in arXiv.org (22.08.2024)
Get full text
Published in arXiv.org (22.08.2024)
Paper