Jamba: A Hybrid Transformer-Mamba Language Model
Lieber, Opher, Lenz, Barak, Bata, Hofit, Cohen, Gal, Osin, Jhonathan, Dalmedigos, Itay, Safahi, Erez, Meirom, Shaked, Belinkov, Yonatan, Shalev-Shwartz, Shai, Abend, Omri, Alon, Raz, Asida, Tomer, Bergman, Amir, Glozman, Roman, Gokhman, Michael, Manevich, Avashalom, Ratner, Nir, Rozen, Noam, Shwartz, Erez, Zusman, Mor, Shoham, Yoav
Year of Publication 28.03.2024
Year of Publication 28.03.2024
Get full text
Journal Article
MRKL Systems: A modular, neuro-symbolic architecture that combines large language models, external knowledge sources and discrete reasoning
Karpas, Ehud, Abend, Omri, Belinkov, Yonatan, Lenz, Barak, Lieber, Opher, Ratner, Nir, Shoham, Yoav, Bata, Hofit, Levine, Yoav, Leyton-Brown, Kevin, Muhlgay, Dor, Rozen, Noam, Schwartz, Erez, Shachaf, Gal, Shalev-Shwartz, Shai, Shashua, Amnon, Tenenholtz, Moshe
Year of Publication 01.05.2022
Year of Publication 01.05.2022
Get full text
Journal Article
Jamba-1.5: Hybrid Transformer-Mamba Models at Scale
Jamba Team, Lenz, Barak, Arazi, Alan, Bergman, Amir, Manevich, Avshalom, Peleg, Barak, Aviram, Ben, Almagor, Chen, Fridman, Clara, Padnos, Dan, Gissin, Daniel, Jannai, Daniel, Muhlgay, Dor, Zimberg, Dor, Gerber, Edden M, Dolev, Elad, Krakovsky, Eran, Safahi, Erez, Schwartz, Erez, Cohen, Gal, Shachaf, Gal, Rozenblum, Haim, Bata, Hofit, Blass, Ido, Magar, Inbal, Dalmedigos, Itay, Osin, Jhonathan, Fadlon, Julie, Rozman, Maria, Danos, Matan, Gokhman, Michael, Zusman, Mor, Gidron, Naama, Ratner, Nir, Gat, Noam, Rozen, Noam, Fried, Oded, Leshno, Ohad, Antverg, Omer, Abend, Omri, Lieber, Opher, Dagan, Or, Cohavi, Orit, Alon, Raz, Belson, Ro'i, Cohen, Roi, Gilad, Rom, Glozman, Roman, Lev, Shahar, Meirom, Shaked, Delbari, Tal, Ness, Tal, Asida, Tomer, Gal, Tom Ben, Braude, Tom, Pumerantz, Uriya, Cohen, Yehoshua, Belinkov, Yonatan, Globerson, Yuval, Levy, Yuval Peleg, Shoham, Yoav
Year of Publication 22.08.2024
Year of Publication 22.08.2024
Get full text
Journal Article
MODULAR REASONING, KNOWLEDGE, AND LANGUAGE SYSTEMS
SHOHAM, Yoav, SHASHUA, Amnon, ZELDES, Yoel, LEYTON-BROWN, Kevin, DALMEDIGOS, Itay, LENZ, Barak, LIEBER, Opher, JANNAI-EPSTEIN, Daniel, SHACHAF, Gal, ROZEN, Noam, SCHWARTZ, Erez, RAM, Ori, LEVINE, Yoav, MUHLGAY, Dor, KARPAS, Ehud, RATNER, Nir, SHALEV-SHWARTZ, Shai, BATA, Hofit
Year of Publication 19.10.2023
Get full text
Year of Publication 19.10.2023
Patent
Jamba: A Hybrid Transformer-Mamba Language Model
Lieber, Opher, Lenz, Barak, Bata, Hofit, Cohen, Gal, Osin, Jhonathan, Dalmedigos, Itay, Safahi, Erez, Shaked Meirom, Belinkov, Yonatan, Shalev-Shwartz, Shai, Abend, Omri, Raz Alon, Asida, Tomer, Bergman, Amir, Glozman, Roman, Gokhman, Michael, Manevich, Avashalom, Ratner, Nir, Rozen, Noam, Shwartz, Erez, Zusman, Mor, Shoham, Yoav
Published in arXiv.org (03.07.2024)
Get full text
Published in arXiv.org (03.07.2024)
Paper
MRKL Systems: A modular, neuro-symbolic architecture that combines large language models, external knowledge sources and discrete reasoning
Karpas, Ehud, Abend, Omri, Belinkov, Yonatan, Lenz, Barak, Lieber, Opher, Ratner, Nir, Shoham, Yoav, Bata, Hofit, Levine, Yoav, Leyton-Brown, Kevin, Dor Muhlgay, Rozen, Noam, Schwartz, Erez, Shachaf, Gal, Shalev-Shwartz, Shai, Shashua, Amnon, Tenenholtz, Moshe
Published in arXiv.org (01.05.2022)
Get full text
Published in arXiv.org (01.05.2022)
Paper
Jamba-1.5: Hybrid Transformer-Mamba Models at Scale
Jamba Team, Lenz, Barak, Arazi, Alan, Bergman, Amir, Manevich, Avshalom, Peleg, Barak, Aviram, Ben, Chen, Almagor, Fridman, Clara, Padnos, Dan, Gissin, Daniel, Jannai, Daniel, Dor Muhlgay, Dor Zimberg, Gerber, Edden M, Dolev, Elad, Krakovsky, Eran, Safahi, Erez, Schwartz, Erez, Cohen, Gal, Shachaf, Gal, Rozenblum, Haim, Bata, Hofit, Blass, Ido, Magar, Inbal, Dalmedigos, Itay, Osin, Jhonathan, Fadlon, Julie, Rozman, Maria, Danos, Matan, Gokhman, Michael, Zusman, Mor, Gidron, Naama, Ratner, Nir, Gat, Noam, Rozen, Noam, Fried, Oded, Leshno, Ohad, Antverg, Omer, Abend, Omri, Lieber, Opher, Dagan, Or, Cohavi, Orit, Raz Alon, Belson, Ro'i, Cohen, Roi, Rom Gilad, Glozman, Roman, Shahar Lev, Shaked Meirom, Delbari, Tal, Ness, Tal, Asida, Tomer, Tom Ben Gal, Braude, Tom, Pumerantz, Uriya, Cohen, Yehoshua, Belinkov, Yonatan, Globerson, Yuval, Yuval Peleg Levy, Shoham, Yoav
Published in arXiv.org (22.08.2024)
Get full text
Published in arXiv.org (22.08.2024)
Paper