ETL vs ELT, Batch vs Streaming
“We need a pipeline” hides several decisions. See when to copy data or call its owner, where to transform, how fresh to be, and who pays and owns each part.
-
-
Python ETL Engineering for Production
Run IDs, batch IDs, ledger commits, structured events, failure classes, retries with jitter, and signal handling, demonstrated with code that ran.
-
ETL, ELT, and Data-Pipeline Design Patterns
ETL and ELT differ in where the transformation runs. The patterns underneath them decide whether a pipeline can be rerun without breaking anything.