Machine Learning with PySpark - With Natural Language Processing and Recommender Systems (2nd Edition)

• Main Author: Singh, Pramod
• Format: eBook
• Language: English
• Published: Berkeley, CA Apress, an imprint of Springer Nature 2021; Apress; Apress L. P
• Edition: 2
• Subjects: Application software; Artificial Intelligence; Computer Science; General References; Machine Learning; MATHEMATICS; Open Source; Professional and Applied Computing; Python; Python (Computer program language); Software Engineering; SPARK (Computer program language)
• ISBN: 9781484277768; 1484277767; 9781484277775; 1484277775
• DOI: 10.1007/978-1-4842-7777-5

Master the new features in PySpark 3.1 to develop data-driven, intelligent applications. This updated edition covers topics ranging from building scalable machine learning models, to natural language processing, to recommender systems. This book begins with the fundamentals of Apache Spark, including the latest updates to the framework. Next, you will learn the full spectrum of traditional machine learning algorithm implementations, along with natural language processing and recommender systems. You'll gain familiarity with the critical process of selecting machine learning algorithms, data ingestion, and data processing to solve business problems. You'll see a demonstration of how to build supervised machine learning models such as linear regression, logistic regression, decision trees, and random forests. You'll also learn how to automate the steps using Spark pipelines, followed by unsupervised models such as K-means and hierarchical clustering. A section on Natural Language Processing (NLP) covers text processing, text mining, and embeddings for classification. This new edition also introduces Koalas in Spark and how to automate data workflow using Airflow and PySpark's latest ML library.