Writing
Plank has four write layers, ordered from the highest-level orchestration to the lowest-level file mechanics.
- Dataset writer layer: builds on row writing to distribute rows across multiple parquet files.
- Row write layer: strongly typed writer for application-shaped rows.
- Logical write layer: schema-bound writer that encodes typed column values.
- Physical write layer: low-level writer for assembling serialized columns into row groups and parquet files.