MLlib

MLlib overview

It is Spark’s machine learning (ML) library. It is designed to make practical machine learning scalable and easy. At a high level, it provides common learning algorithms such as classification, regression, clustering etc, some featurization for visualization, pipelines algos and some utility algos for data handling, algebra etc.