Implementation and Evaluation of LLM on a CGLA

• Published in: International Symposium on Computing and Networking (Online) pp. 252 - 258
• Main Authors: Uetani, Hitoaki, Nakashima, Yasuhiko
• Format: Conference Proceeding
• Language: English
• Published: IEEE 26.11.2024
• Subjects: CGLA; CGRA; Chatbots; Field programmable gate arrays; FPGA; Generative AI; GGML; IMAX; Large language models; Libraries; LLM; Logic gates; Measurement; Power demand; Prototypes; Reconfigurable architectures

Currently, generative AI services such as ChatGPT are attracting global attention. At the same time, the shortage of processing resources like GPUs and the increase in power demand have become significant issues, making the balance between processing performance and power efficiency a critical chall...