Building Reliable Activity Models Using Hierarchical Shrinkage and Mined Ontology

• Published in: Lecture notes in computer science pp. 17 - 32
• Main Authors: Tapia, Emmanuel Munguia, Choudhury, Tanzeem, Philipose, Matthai
• Format: Book Chapter Conference Proceeding
• Language: English
• Published: Berlin, Heidelberg Springer Berlin Heidelberg 2006; Springer
• Series: Lecture Notes in Computer Science
• Subjects: Activity Model; Activity Recognition; Applied sciences; Artificial intelligence; Computer science; control theory; systems; Computer systems and distributed systems. User interface; Exact sciences and technology; Information systems. Data bases; Leaf Node; Memory organisation. Data processing; Observation Matrix; Pattern recognition. Digital image processing. Computational geometry; Software; Word Sense; Pervasive computing; Computer vision; Statistical analysis; Probabilistic approach; Ontology; Similarity; Inference; Pattern recognition; Distributed system; Object recognition; Modeling; Remote teaching; Information use; Reference system; Smoothing; Classification; Object oriented; World wide web; Probability learning; Internet; Hierarchical system
• ISBN: 9783540338949; 3540338942
• ISSN: 0302-9743; 1611-3349
• DOI: 10.1007/11748625_2

Activity inference based on object use has received considerable recent attention. Such inference requires statistical models that map activities to the objects used in performing them. Proposed techniques for constructing these models (hand definition, learning from data, and web extraction) all share the problem of model incompleteness: it is difficult to either manually or automatically identify all the possible objects that may be used to perform an activity, or to accurately calculate the probability with which they will be used. In this paper, we show how to use auxiliary information, called an ontology, about the functional similarities between objects to mitigate the problem of model incompleteness. We show how to extract a large, relevant ontology automatically from WordNet, an online lexical reference system for the English language. We adapt a statistical smoothing technique, called shrinkage, to apply this similarity information to counter the incompleteness of our models. Our results highlight two advantages of performing shrinkage. First, overall activity recognition accuracy improves by 15.11% by including the ontology to re-estimate the parameters of models that are automatically mined from the web. Shrinkage can therefore serve as a technique for making web-mined activity models more attractive. Second, smoothing yields an increased recognition accuracy when objects not present in the incomplete models are used while performing an activity. When we replace 100% of the objects with other objects that are functionally similar, we get an accuracy drop of only 33% when using shrinkage as opposed to 91.66% (equivalent to random guessing) without shrinkage. If training data is available, shrinkage further improves classification accuracy.