Updated article on Blosc2: Compute with TB-sized datasets on your own hardware, within human timeframes!
Highlights:
Outperforms NumPy by 10x ~ 100x for large computations
Maintains performance with datasets far exceeding physical memory
Integrates seamlessly with the Python data science ecosystem
Works both in-memory and on-disk with minimal performance differences
Read more: https://ironarray.io/blog/compute-bigger