I had just finished doing an Armed Forces Day broadcast, you know, Voice of America and all that bullshit. I had just walked this pretty white girl named Judy out to get a cab. She got in the cab, and I’m standing there in front of Birdland wringing wet because it’s a hot, steaming, muggy night in August.
“For since the fabric of the universe is most perfect, and is the work of a most wise Creator, nothing whatsoever takes place in the universe in which some relation of maximum and minimum does not appear.” ― Leonhard Euler
Dask enables parallel and out-of-core computation. We couple blocked algorithms with dynamic and memory aware task scheduling to achieve a parallel and out-of-core NumPy clone. We show how this extends the effective scale of modern hardware to larger datasets and discuss how these ideas can be more broadly applied to other parallel collections. ― Matthew Rocklin