https://blog.sksoumik.com/tags/spark/ Recent content in spark on Sadman Kabir Soumik Hugo -- gohugo.io en Copyright © 2022, Sadman Kabir Soumik Tue, 24 May 2022 00:00:00 +0000 https://blog.sksoumik.com/artificial-intelligence/multi-class-text-classification-apache-spark-mllib/ Tue, 24 May 2022 00:00:00 +0000 https://blog.sksoumik.com/artificial-intelligence/multi-class-text-classification-apache-spark-mllib/ Spark MLlib MLlib is a library for machine learning in Spark that aims to make it easy to use and scalable for practical applications. It includes tools for common ML tasks, such as classification, regression, clustering, and collaborative filtering, as well as featurization methods for feature extraction, transformation, dimensionality reduction, and selection. MLlib also provides tools for building, evaluating, and tuning ML pipelines, as well as utilities for linear algebra, statistics, and data handling.