#519: Data Science Cloud Lessons at Scale
MP3•Episode home
Manage episode 507193448 series 3501439
Content provided by Michael Kennedy. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Michael Kennedy or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://podcastplayer.com/legal.
Today on Talk Python: What really happens when your data work outgrows your laptop. Matthew Rocklin, creator of Dask and cofounder of Coiled, and Nat Tabris a staff software engineer at Coiled join me to unpack the messy truth of cloud-scale Python. During the episode we actually spin up a 1,000 core cluster from a notebook, twice! We also discuss picking between pandas and Polars, when GPUs help, and how to avoid surprise bills. Real lessons, real tradeoffs, shared by people who have built this stuff. Stick around.
Episode sponsors
Seer: AI Debugging, Code TALKPYTHON
Talk Python Courses
…
continue reading
Episode sponsors
Seer: AI Debugging, Code TALKPYTHON
Talk Python Courses
Links from the show
Matthew Rocklin: @mrocklin
Nat Tabris: tabris.us
Dask: dask.org
Coiled: coiled.io
Watch this episode on YouTube: youtube.com
Episode #519 deep-dive: talkpython.fm/519
Episode transcripts: talkpython.fm
Theme Song: Developer Rap
π₯ Served in a Flask πΈ: talkpython.fm/flasksong
---== Don't be a stranger ==---
YouTube: youtube.com/@talkpython
Bluesky: @talkpython.fm
Mastodon: @[email protected]
X.com: @talkpython
Michael on Bluesky: @mkennedy.codes
Michael on Mastodon: @[email protected]
Michael on X.com: @mkennedy
Nat Tabris: tabris.us
Dask: dask.org
Coiled: coiled.io
Watch this episode on YouTube: youtube.com
Episode #519 deep-dive: talkpython.fm/519
Episode transcripts: talkpython.fm
Theme Song: Developer Rap
π₯ Served in a Flask πΈ: talkpython.fm/flasksong
---== Don't be a stranger ==---
YouTube: youtube.com/@talkpython
Bluesky: @talkpython.fm
Mastodon: @[email protected]
X.com: @talkpython
Michael on Bluesky: @mkennedy.codes
Michael on Mastodon: @[email protected]
Michael on X.com: @mkennedy
521 episodes