Creating a Data Pipeline from Scratch

A Basic Data Engineering Project end-to-end.

Photo by Mike Benna on Unsplash

Introduction

Data Engineering was always an area of interest to me, but I never really had time to create a project because I need to split my time among many things like work, family, and everything else that need my time and attention. So, I have given myself a strong challenge: creating a data pipeline from scratch in…