Hi Xinran, great article! You might want to take a look at Ploomber, a framework that allows you to structure data pipelines organized in several steps. Each step can be anywhere from a Python function, a notebook or even a SQL script. I ‘d love to know what you think. https://github.com/ploomber/ploomber

Here’s a code example: https://ploomber.readthedocs.io/en/stable/auto_examples/reporting.html#sphx-glr-auto-examples-reporting-py