Ram is a Spark Data Engineer at Mactores. He works across Spark, Airflow and the AWS and Google Cloud data stacks, mostly on pipelines that were already running before he arrived.
Almost nobody starts a data platform from nothing. His writing is about the version of the job that actually happens: a pipeline you inherited, a warehouse someone sized three years ago, a migration that has to land without the nightly load failing. He is precise about the order things need to happen in, which is usually what separates a migration that finishes from one that stalls.
