YouTube

Got a YouTube account?

New: enable viewer-created translations and captions on your YouTube channel!

cron is so yesterday: scheduling Python tasks with Airflow - PyData SG Meetup

Contribute

Add a new language!

Already have subtitles for this video?
Upload them directly.

Speaker: Daniel Poon, Wego

cron has been the go-to solution for scheduling tasks on remote Linux systems. In this session we will be speaking on the motivation for moving task scheduling to Airflow, as well as deep diving into the infrastructure designed for reliable task deployment and scheduling. We'll be demonstrating an end-to-end deployment and running of a sample ML task on this infrastructure.

Daniel is a Lead Engineer at Wego with the Content, Tools and Services team. He focuses on designing sane, user-friendly workflows to enhance the capabilities of internal stakeholders.

Event Page: https://www.meetup.com/PyData-SG/events/252822354

Produced by Engineers.SG