YouTube

Got a YouTube account?

New: enable viewer-created translations and captions on your YouTube channel!

Build Your Spark ML Job Online, Like Lego

Contribute

Add a new language!

Already have subtitles for this video?
Upload them directly.

Speaker: Hu Dawei (David)

In this presentation, we will learn how to design and assemble a complete Spark application and submit / run / modify the job on the fly.

We will see a demo of how various node can just be dragged and dropped through the web interface, with an explanation along the way about the overall design and Apache Livy as one of the key tools that makes this possible.

Presenter(s): Hu Dawei, System Engineer @ Qubida Analytics
Dawei is a System Engineer at Qubida, responsible for the back-end services that supports the Qubida web platform, such as Big Data ingestion, Spark job execution / scheduling, ML workflow visualization, etc.

Sponsor(s): Thanks to RedMart for sponsoring our venue and refreshments.

Event Page: https://www.meetup.com/Singapore-Scala-Programmers/events/246818263/

Produced by Engineers.SG