Using Lord of the rigns wars and weapon data, learnt how to create a hadoop cluster and how to use spark for working on distributed data.
See one of the spark usages in machine learning area called user-based collaborative filtering on recommender systems. We used pyspark.ml library and more specifically ALS model to recommend new games to each user