Asset-Oriented Orchestration: Dagster and Prefect
Declare data assets instead of tasks, record what each production run created, map partitions to find what a correction affects, and gate publication with checks.
-
-
Asset Partition Mapping
Map a downstream asset partition to the upstream partitions it needs, including windows, and keep logical dependencies separate from storage layout.
-
Asset Materialization
Connect an asset’s production event to its physical output, version, and partition, without confusing execution history with durable or complete data.
-
Asset Check
Attach a named test to a data asset, configure whether failure blocks downstream work, and distinguish blocking from rollback or source completeness.