Data Pipelines

Moving and shaping data for analysis: ETL, warehouses, batch and streaming, and keeping data trustworthy.

  1. 01

    ETL or ELT?

    • easy
  2. 02

    Warehouse, Lake or Lakehouse?

    • easy
    • Pro
  3. 03

    Batch or Streaming?

    • easy
    • Pro
  4. 04

    Orchestrate a Pipeline

    • medium
    • Pro
  5. 05

    Make a Pipeline Re-runnable

    • medium
    • Pro
  6. 06

    Data Quality Checks

    • medium
    • Pro
  7. 07

    Late-Arriving Data

    • hard
    • Pro
  8. 08

    Track History in a Dimension

    • hard
    • Pro