Data Model Change and Compatibility
The dangerous model change is the one that passes every check. See what breaks consumers, why meaning changes are invisible, and how to publish one safely.
-
-
Type Promotion
Type promotion widens a column’s type — int to long, float to double — without rewriting old files. See which widenings are allowed and why narrowing never is.
-
Field ID
A field ID gives each column a permanent number, so a renamed or reordered column still lines up with old data files, and a new column never inherits old data.
-
Separating Storage, Compute, and Metadata
Splitting a warehouse replaces one product with five choices. See what object storage cannot do, how a table format fills the gap, and what copies cost.
-
Managed Ingestion: Fivetran, Airbyte, and dlt
Decide when to buy, operate, or write a connector, and verify its cursor, nested tables, schema changes, failure handling, and total cost.
-
Designing Topics and Event Contracts
When one team quietly makes a change that breaks the contract it sends under, every team that depends on the changed part can break at once. A contract makes the change visible before it ships.