PhotoPrev： Unifying Context and Content Cues to Enhance Personal Photo Revisitation

Personal photo revisitation on smart phones is a common yet uneasy task for users due to the large volume of photos taken in daily life. Inspired by the human memory and its natural recall characteristics, we build a personal photo revisitation tool, PhotoPrev, to facilitate users to revisit previou...

Full description

Saved in:
Bibliographic Details
Published inJournal of computer science and technology Vol. 30; no. 3; pp. 453 - 466
Main Author 金力 刘钢利 赵靓 冯铃
Format Journal Article
LanguageEnglish
Published New York Springer US 01.05.2015
Springer Nature B.V
Tsinghua National Laboratory for Information Science and Technology, Department of Computer Science and Technology Tsinghua University, Beijing 100084, China
Subjects
Algorithms
Analysis
Artificial Intelligence
Computer Science
Context
Cues
Data Structures and Information Theory
Feasibility studies
Feedback
Image retrieval
Information Systems Applications (incl.Internet)
Keywords
Lattices
Life cycle engineering
Lists
Metadata
Recall
Regular Paper
Searching
Semantics
Smartphones
Social networks
Software Engineering
Studies
Synthetic data
Theory of Computation
User feedback
上下文
关键字搜索
存储器管理
智能手机
照片
用户反馈
自动生成
自然特性
memory cue
personal photo revisitation
user feedback
Online AccessGet full text

Cover

More Information
Summary:Personal photo revisitation on smart phones is a common yet uneasy task for users due to the large volume of photos taken in daily life. Inspired by the human memory and its natural recall characteristics, we build a personal photo revisitation tool, PhotoPrev, to facilitate users to revisit previous photos through associated memory cues. To mimic users＇ episodic memory recall, we present a way to automatically generate an abundance of related contextual metadata （e.g., weather, temperature） and organize them as context lattices for each photo in a life cycle. Meanwhile, photo content （e.g., object, text） is extracted and managed in a weighted term list, which corresponds to semantic memory. A threshold algorithm based photo revisitation framework for context- and content-based keyword search on a personal photo collection, together with a user feedback mechanism, is also given. We evaluate the scalability on a large synthetic dataset by crawling users＇ photos from Flickr, and a 12-week user study demonstrates the feasibility and effectiveness of our photo revisitation strategies.
Bibliography:personal photo revisitation, memory cue, user feedback
11-2296/TP
Li Jin , Gang-Li Liu, Liang Zhao , Ling Feng （ Senior Member, IEEE Tsinghua National Laboratory for Information Science and Technology, Department of Computer Science and Technology Tsinghua University, Beijing 100084, China）
Personal photo revisitation on smart phones is a common yet uneasy task for users due to the large volume of photos taken in daily life. Inspired by the human memory and its natural recall characteristics, we build a personal photo revisitation tool, PhotoPrev, to facilitate users to revisit previous photos through associated memory cues. To mimic users＇ episodic memory recall, we present a way to automatically generate an abundance of related contextual metadata （e.g., weather, temperature） and organize them as context lattices for each photo in a life cycle. Meanwhile, photo content （e.g., object, text） is extracted and managed in a weighted term list, which corresponds to semantic memory. A threshold algorithm based photo revisitation framework for context- and content-based keyword search on a personal photo collection, together with a user feedback mechanism, is also given. We evaluate the scalability on a large synthetic dataset by crawling users＇ photos from Flickr, and a 12-week user study demonstrates the feasibility and effectiveness of our photo revisitation strategies.
ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 23
ISSN:1000-9000
1860-4749
DOI:10.1007/s11390-015-1536-z