GeoLocator: A Location-Integrated Large Multimodal Model (LMM) for Inferring Geo-Privacy

• Published in: Applied sciences Vol. 14; no. 16; p. 7091
• Main Authors: Yang, Yifan, Wang, Siqin, Li, Daoyang, Sun, Shuju, Wu, Qingyang
• Format: Journal Article
• Language: English
• Published: Basel MDPI AG 01.08.2024
• Subjects: Accuracy; Artificial intelligence; Cognition & reasoning; Computational linguistics; Earth science; Ethical aspects; Generative artificial intelligence; geo-privacy; Geography; Geospatial data; GPT-4; image comprehension; Language; Language processing; Large language models; large multimodal model (LMM); Natural language; Natural language interfaces; open-source intelligence (OSINT); Privacy; Social media; Social networks
• ISSN: 2076-3417; 2076-3417
• DOI: 10.3390/app14167091

To ensure the sustainable development of artificial intelligence (AI) application in urban and geospatial science, it is important to protect the geographic privacy, or geo-privacy, which refers to an individual’s geographic location details. As a crucial aspect of personal security, geo-privacy plays a key role not only in individual protection but also in maintaining ethical standards in geoscientific practices. Despite its importance, geo-privacy is often not sufficiently addressed in daily activities. With the increasing use of large multimodal models (LMMs) such as GPT-4 for open-source intelligence (OSINT), the risks related to geo-privacy breaches have significantly escalated. This study introduces a novel GPT-4-based model, GeoLocator, integrated with location capabilities, and conducts four experiments to evaluate its ability to accurately infer location information from images and social media content. The results demonstrate that GeoLocator can generate specific geographic details with high precision, thereby increasing the potential for inadvertent exposure of sensitive geospatial information. This highlights the dual challenges posed by online data-sharing and information-gathering technologies in the context of geo-privacy. We conclude with a discussion on the broader impacts of GeoLocator and our findings on individuals and communities, emphasizing the urgent need for increased awareness and protective measures against geo-privacy breaches in the era of advancing AI and widespread social media usage. This contribution thus advocates for sustainable and responsible geoscientific practices.