Eduardo Blancas
1 min readAug 9, 2020

--

Hi Geoffrey! Great article! I used to develop my pipelines in a very similar way. Then I realized I was repeating a lot of my code between projects (managing db connections, writing scripts to orchestrate pipeline execution) so I decided to develop a library for that. Given your experience developing data pipelines, I'd like to request your feedback: https://github.com/ploomber/ploomber

Here's a non-trivial example pipeline: https://github.com/ploomber/projects/tree/master/etl

Let me know any comments/questions you might have!

--

--

Eduardo Blancas
Eduardo Blancas

Written by Eduardo Blancas

Data scientist turned startup founder. M.S. in Data Science from Columbia University. Currently building Ploomber: https://ploomber.io/

Responses (1)