Dask natively scales Python
Dask provides advanced parallelism for analytics, enabling performance at scale for the tools you lovedask.orgJoined July 2017
Reminder its the Dask Community Meeting on Thursday November 6th 2025 at 10am US Central time (4pm UTC)
Come along and hear about what's going on in the Dask community and to share what you're building with Dask.
Ad-hoc demos very welcome!
github.com/dask/community…
The monthly Dask Community Meeting is on Thursday, October 2nd at 10:00 US/Central.
Come along and share what you've been doing with Dask.
github.com/dask/community…
Our February community meeting is today at 10am US Central time. We will be chatting about ongoing development of Dask and showing community demos of cools things folks have built.
Come along!
docs.dask.org/en/stable/supp…
New blog post: Scale AI-based Data Processing EASY
The FineWeb-Edu dataset comes from processing 45TB (🤯) of FineWeb
And it uses a Language Model to classify the educational level of the text 😭😭
Still, we reproduced it in a few lines of code !
The key ? HF + Dask 😎
Demos from the September community meeting are now up on YouTube. See how Dask is being used for scalable computing in Astronomy and the latest updates from dask-jobqueue.
youtu.be/afmus2EvccU
Unfortunately we've had some spam on the Dask Community Forum recently.
To combat this we've limited logins to GitHub OAuth. If you previously signed up with email/password please login with a GitHub account with the same email.
More info here dask.discourse.group/t/switch-to-gi…
Today at 10am US central time we have our monthly Dask community meeting.
Come along if you want to hear about what's going on in the Dask community!
docs.dask.org/en/latest/supp…
Quick note that we are skipping the Dask Community Meeting this month because it falls on July 4th which is a holiday for many attendees. See you all in August!
Introducing a new Python package called dask-ee! It can turn an #EarthEngine Feature Collection into a #dask DataFrame with one line of code. Accelerate your geospatial workflow with parallel computing
github.com/alxmrs/dask-ee
Dask DataFrame is now 20x faster. Some of most prominent changes include:
- Apache Arrow support in @pandas_dev
- Better shuffling algorithm for faster joins
- Automatic query optimization
Learn more: docs.coiled.io/blog/dask-data…
Don't forget, our next community meeting is this Thursday on June 6th.
Come and hear about the latest in Dask, see what others are building with Dask and learn about how you can get involved.
Meeting info here 👉 docs.dask.org/en/stable/supp…
Are you using Dask in your projects? The rest of the community would love to hear about it!
Come and give an informal demo at our next community meeting on June 6th.
Demo sign up issue is here github.com/dask/community…
Next month we are trying a new consolidated Community Meeting format.
All Dask users/developers are welcome!
Topics will include:
• Development updates
• Dask Demos
• Maintenance coordination
📅 Add it to your calendar now
docs.dask.org/en/stable/supp…
I'm updating the Dask.org homepage and could use quotes from happy Dask users that don't mind having their name and face on the site.
Any kind words you can share about why you like Dask, find it easy, or how helped you solve a problem?
Short answers preferred!
Query planning for Dask Dataframe released
github.com/dask/dask/issu…
Dask dataframe is pretty fast now, even when folks write less-than-perfect code.
$ pip/conda/uv/mamba install dask
Join us for Dask Demo Day to see how to deploy @databricks on Dask, run @PrefectIO workflows in the cloud, and scale embedding pipelines.
🗓️February 15 (today!)
⏰11am ET
github.com/dask/community…
48K Followers 2K FollowingChief AI & Co-founder @AnacondaInc; invented @pyscript_dev, @PyData @Bokeh @Datashader. Former physicist. A student of the human condition. bsky: @wang.social
8K Followers 88 FollowingOpen source maintainer. @dask_dev author. CEO at @CoiledHQ
Additionally I try to be a decent human and help the world from melting.
7K Followers 2K FollowingScientist and Startup Founder
Co-founder and CEO @EarthmoverHQ
@pangeo_data steering council member
ex-Professor @columbia @lamontEarth
2K Followers 629 FollowingBuilding @rapidsai and @dask_dev at @NVIDIA. Tinker with kr8s in my spare time. Views are my own. he/him.
🦋 https://t.co/oxaQdmUkxo
35K Followers 822 FollowingCreator of SciPy, NumPy, and Numba; founder of Anaconda, Inc and NumFOCUS. CEO of Quansight, OpenTeams, and OpenTeams Global, Head of Product at Zyphra
3K Followers 663 FollowingCreating the next generation of geospatial data tools for Python & the browser with GeoArrow, GeoParquet & GeoRust @developmentseed | he/him 🌈
13K Followers 166 FollowingEnd to end CUDA accelerated #datascience libraries built on @apachearrow, scaled with @dask_dev & Dask-SQL for ETL, ML, graph analytics, and DL preprocessing
17 Followers 180 FollowingNaše realitní kancelář poskytuje nadstandardní služby v oblasti zprostředkování prodejů a pronájmů rezidenčních i komerčních nemovitostí.
370 Followers 6K FollowingStatistics student. Interested in Math, Python, R, Machine Learning, History, and Economics. Lover of all things stochastic ❤️. RTs not necessarily endorsements
559 Followers 8K FollowingI've been a Web Developer for many years in Brazil. I'm learning #English, #jQuery, #JavaScript, #NodeJS, #ExpressJS, #PHP, #Python, and more.
872 Followers 680 FollowingCUDO delivers the full AI infrastructure stack for enterprise-scale AI, built on a power-first strategy and validated against NVIDIA reference architectures.
262 Followers 6K FollowingSQL, Python,R, Tableau,Looker,Power BI,Excel,RPA,Power Automate,UiPath,Zapier
For your data analysis and process automation needs.
70 Followers 277 FollowingSoftware Engineer/PO @CanonMedicalHIT, all views and expression my own | personal interests in global health, informatics, and patient empowerment