Kedro

Kedro is an open-source Python framework designed for building production-ready data pipelines in data engineering and data science. Developed by QuantumBlack, McKinsey’s advanced analytics firm, Kedro applies software engineering best practices to create reproducible, maintainable, and modular data and machine-learning pipelines. It was first released in June 2019 and is now hosted by the Linux Foundation for vendor-neutral governance.

Kedro offers a range of features, including a command-line interface for project scaffolding, a data catalog for configuration-driven access, and a pipeline API for defining workflows. It also includes Kedro-Viz, an interactive tool for visualizing pipelines, and automated documentation generation based on code structure. The framework is supported by an active open-source community and is used by organizations such as McKinsey, NASA, and Rolls-Royce, making it a valuable resource for data scientists, data engineers, and machine-learning engineers transitioning from experimentation to production in analytics or AI projects.