ES

Enigma Team

Ezzy Sriram

Engineering — Enigma

Ezzy Sriram is an engineer at Enigma focused on data infrastructure and engineering systems.

Writing

1 post published

May 8, 2019

Scaling a Pandas ETL Job to 600GB

Cut a 120-hour Pandas ETL runtime to under 24 hours without rewriting to Spark. A practical guide to parallelization, partitioning, and bulk inserts.