Prefect Dataflow Scheduler with Jeremiah Lowin
Software Engineering Daily
A data workflow scheduler is a tool used for connecting multiple systems together in order to build pipelines for processing data. A data pipeline might include a Hadoop task for ETL, a Spark task for stream processing, and a TensorFlow task to train a machine learning model. The workflow scheduler manages the tasks in that
The post Prefect Dataflow Scheduler with Jeremiah Lowin appeared first on Software Engineering Daily.
Next Episodes
CockroachDB with Peter Mattis @ Software Engineering Daily
📆 2020-04-28 11:00 / ⌛ 00:56:55
Dask: Scalable Python with Matthew Rocklin @ Software Engineering Daily
📆 2020-04-27 11:00 / ⌛ 01:01:07
Rasa: Conversational AI with Tom Bocklisch @ Software Engineering Daily
📆 2020-04-24 11:00 / ⌛ 00:59:57
Cloudburst: Stateful Functions-as-a-Service with Vikram Sreekanti @ Software Engineering Daily
📆 2020-04-23 11:00 / ⌛ 00:59:35
NGINX API Management with Kevin Jones @ Software Engineering Daily
📆 2020-04-22 11:00 / ⌛ 00:53:11