Back to Courses
Course

Lakeflow and Structured Streaming Pipelines

Build incremental ingestion pipelines with Auto Loader concepts, streaming tables, expectations, and operational handoffs.

Lakeflow and Structured Streaming Pipelines thumbnail

About this course

4 lessons
2 modules
2 hours
Elena Ross
Tags
LakeflowStructured StreamingAuto Loader
Lakehouse Engineering
Spark Performance
Start course

1.Ingestion patterns

Pick ingestion patterns that match arrival rate, replay needs, and consumer expectations.

  • Incremental ingestion patternsarticle - 12 min
  • Ingestion pattern checkquiz - 6 min

2.Streaming operations

Monitor streaming pipelines by connecting lag, expectations, and downstream impact.

  • Streaming operations playbookarticle - 13 min
  • Streaming operations checkquiz - 6 min