Build a small data pipeline you can run on every new round of a survey.
You work in marimo notebooks. Round after round of a survey arrives, and your pipeline has to take each one through four stages: Get it without losing anything, Check it against rules, Store it in a database, and Share it.
Before it, you need Python Essentials, and Arrays & DataFrames is highly recommended: this course reads, joins and summarizes tables with pandas from its first module.
The modules
Section titled “The modules”Each module is one topic, taught in sections; a training groups them into its own days or sessions.
- Module 1, Start here
- Module 2, Get: Round 1 arrives
- Stretch exercises S1, Stretch: Get
- Module 3, Check: Round 2 and the contract
- Debugging drill D1, Debugging drill: five broken functions
- Module 4, Store: rules that hold in the database
- Stretch exercises S2, Stretch: Check and Store
- Module 5, A new edition: Round 3 arrives
- Module 6, Share: the release and a data portal
- Stretch exercises S3, Stretch: A new edition and Share
- Capstone
For any time
When you are stuck
Section titled “When you are stuck”Every exercise has a check that names the input that went wrong, and a note of common causes. If you are still stuck after ten minutes, or your check is green and you want to compare, the companion has the solution to each exercise and why it works.