All videos
All videos
Collaborative Filtering Microservices on Spark
The Alternating Least Squares (ALS) algorithm is still deemed the industry standard in collaborative filtering. In this talk we will focus on Apache Spark’s ALS implementation and discuss the steps we took to build a distributed recommendation engine, focusing on continuous model training and model management. We show that, by splitting the recommendation engine into microservices, we were able to reduce the system’s complexity and produce a robust collaborative filtering platform with support for continuous model training. At the end of this talk, you should be equipped with enough tools and ideas to implement your own collaborative algorithm and avoid some common pitfalls.
Tags
About the speakers

Rui Vieira
Software Engineer at Red Hat
Rui is a Software Engineer at Red Hat working on Data Science, Apache Spark and Spark Streaming applications.
Read more

Sophie Watson
Software Engineer at Red Hat
Sophie is a Software Engineer at Red Hat, and has recently finished a PhD in Bayesian Statistics.
Read more
Other videos that you might like

What we’ve learned from creating Edward.ai
Tomasz Wesołowski

Explaining neural networks predictions
Matthew Opala

Stream processing in telco – case study based on Apache Flink & TouK Nussknacker
Maciek Próchniak

The algo magic: from big to small data
Grzegorz Gawron