Growing Dask To Make Scaling Python Data Science Easier At Coiled

The Python Podcast.__init__

• Episode: Growing Dask To Make Scaling Python Data Science Easier At Coiled
• Website: The Python Podcast.__init__
• Feed URL: https://www.podcastinit.com/feed/mp3/
• Duration: 00:52:07
• Published: 2020-08-10 23:50

Python is a leading choice for data science due to the immense number of libraries and frameworks readily available to support it, but it is still difficult to scale. Dask is a framework designed to transparently run your data analysis across multiple CPU cores and multiple servers. Using Dask lifts a limitation for scaling your analytical workloads, but brings with it the complexity of server administration, deployment, and security. In this episode Matthew Rocklin and Hugo Bowne-Anderson discuss their recently formed company Coiled and how they are working to make use and maintenance of Dask in production. The share the goals for the business, their approach to building a profitable company based on open source, and the difficulties they face while growing a new team during a global pandemic.