P2LSA and P2LSA+: Two Paralleled Probabilistic Latent Semantic Analysis Algorithms Based on the MapReduce Model

• Published in: Intelligent Data Engineering and Automated Learning - IDEA 2011 Vol. 6936; pp. 385 - 393
• Main Authors: Jin, Yan, Gao, Yang, Shi, Yinghuan, Shang, Lin, Wang, Ruili, Yang, Yubin
• Format: Book Chapter
• Language: English
• Published: Germany Springer Berlin / Heidelberg 2011; Springer Berlin Heidelberg
• Series: Lecture Notes in Computer Science
• Subjects: Artificial intelligence; Information retrieval; MapReduce; Paralleled PLSA; PLSA

Two novel paralleled Probabilistic Latent Semantic Analysis (PLSA) algorithms based on the MapReduce model are proposed, which are P2LSA and P2LSA+, respectively. When dealing with a large-scale data set, P2LSA and P2LSA+ can improve the computing speed with the Hadoop platform. The Expectation-Maxi...