POP-VQA - Privacy preserving, On-device, Personalized Visual Question Answering

• Published in: 2024 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) pp. 8455 - 8464
• Main Authors: Sahu, Pragya Paramita, Raut, Abhishek, Samant, Jagdish Singh, Gorijala, Mahesh, Lakshminarayanan, Vignesh, Bhaskar, Pinaki
• Format: Conference Proceeding
• Language: English
• Published: IEEE 03.01.2024
• Subjects: Algorithms; Applications; Biological system modeling; Computational modeling; etc; Generative models for image; Optical character recognition; Privacy; Smartphones / end user devices; System performance; Training; video; Vision + language and/or other modalities; Visualization

The next generation of device smartness needs to go beyond being able to understand basic user commands. As our systems become more efficient, they need to be taught to understand user interactions and intents from all possible input modalities. This is where the recent advent of large scale multi-m...