Multimedia content management for large language model(s) and/or other generative model(s)

• Main Authors: Singh, Komal, Petrovski, Igor, Weisz, Ágoston, Ghiasi, Golnaz, Gupta, Khyatti, Akerlund, Oscar, Ghafouri, Amin, Goodman, Michael Andrew, Jain, Sanil, Shivanna, Rakesh, Yu, Wei, Peswani, Vikas, Avram, Diana, Sluzhaev, Evgeny, Lu, Yifeng, Luong, Thang
• Format: Patent
• Language: English
• Published: 02.04.2024
• Subjects: CALCULATING; COMPUTING; COUNTING; ELECTRIC DIGITAL DATA PROCESSING; PHYSICS

Implementations relate to managing multimedia content that is obtained by large language model(s) (LLM(s)) and/or generated by other generative model(s). Processor(s) of a system can: receive natural language (NL) based input that requests multimedia content, generate a response that is responsive to the NL based input, and cause the response to be rendered. In some implementations, and in generating the response, the processor(s) can process, using a LLM, LLM input to generate LLM output, and determine, based on the LLM output, at least multimedia content to be included in the response. Further, the processor(s) can evaluate the multimedia content to determine whether it should be included in the response. In response to determining that the multimedia content should not be included in the response, the processor(s) can cause the response, including alternative multimedia content or other textual content, to be rendered.