OneLake
Every Fabric tenant has exactly one OneLake. Workloads store and read Delta or Iceberg tables in it, so one copy of data can serve Spark, SQL, and Power BI.
-
-
Schema-on-Read
Schema-on-read stores data as it arrives and decides its structure at query time. See what that flexibility buys, what it pushes downstream, and when to use it.
-
Warehouse, Lake, and Lakehouse
Three architectures, three different assumptions about schema, cost, and who the user is. See what each solved, what it deferred, and why the names now mislead.
-
Partition Projection
See how Athena computes partition locations from rules, why registration is ignored, and how an incorrect range can silently hide existing data.
-
Partition Pruning
Use partition values to exclude locations, distinguish pruning from row filtering, and avoid changing the answer just to reduce scanning.
-
External Table
Understand how an external table maps SQL to stored data, what registration controls, and why visibility alone is not a committed snapshot.
-
External Tables and the Lake/Warehouse Boundary
An external table exposes files to SQL. Learn when to load a managed copy and how registration, updates, and snapshots affect correctness.
-
File Compaction
Combine small files while preserving records, publish replacements safely, and evaluate request savings alongside rewrite and retention costs.
-
Dataset Publication Manifest
Publish an exact immutable file set through a manifest, reject duplicate or foreign references, and retain files needed by pinned readers.
-
Conditional Object Write
Use create-only and compare-and-swap preconditions for object writes, handle conflicts, and keep publication order separate from source freshness.
-
Designing an Object-Storage Data Lake
Build a data lake with discoverable datasets, immutable runs, conditional publication, safe cleanup, and layouts matched to queries.
-
Designing End-to-End Data Architecture
How consumer requirements determine data contracts, logical layers, physical deployment, consistency boundaries, and recovery decisions.
-
Data Lake
Understand what a data lake stores, how readers interpret it, and why metadata and governance remain necessary.