A comparative analysis of retrieval features used in the TREC 2006 Genomics Track passage retrieval task

• Published in: AMIA ... Annual Symposium proceedings Vol. 2007; pp. 620 - 624
• Main Authors: Rekapalli, Hari Krishna, Cohen, Aaron M, Hersh, William R
• Format: Journal Article
• Language: English
• Published: United States American Medical Informatics Association 11.10.2007
• Subjects: Abstracting and Indexing as Topic; Algorithms; Databases as Topic; Genomics; Information Storage and Retrieval; Multivariate Analysis; Regression Analysis; Subject Headings; Vocabulary, Controlled
• ISSN: 1942-597X; 1559-4076

Identify the set of features that best explained the variation in the performance measure of TREC 2006 Genomics information extraction task, Mean Average Passage Precision (MAPP). A multivariate regression model was built using a backward-elimination approach as a function of certain generalized features that were common to all the algorithms used by TREC 2006 Genomics track participants. Our regression analysis found that the following four factors were collectively associated with variation in MAPP: (1) Normalization of keywords in the query (2) Use of Entrez gene thesaurus for synonymous terms look-up (3) Unit of text retrieved using respective IR algorithms and (4) The way a passage was defined. These reasonably likely hypotheses, generated by an exploratory data analysis, are informative in understanding results of the TREC 2006 Genomics passage extraction task. This approach has general value for analyzing the results of similar common challenge tasks.