ETL vs ELT, Batch vs Streaming
“We need a pipeline” hides several decisions. See when to copy data or call its owner, where to transform, how fresh to be, and who pays and owns each part.
“We need a pipeline” hides several decisions. See when to copy data or call its owner, where to transform, how fresh to be, and who pays and owns each part.
ETL and ELT differ in where the transformation runs. The patterns underneath them decide whether a pipeline can be rerun without breaking anything.