Data Engineering Lead
Core
Lead and manage execution of data engineering projects to build operational data platforms, ETL pipelines, data lakes, and streaming hubs for digital marketing, eCommerce, and BI clients.
Role type
Senior IC data engineering lead (management & hands-on)
Builds
Operational data platforms, ETL pipelines, data lakes, near real-time streaming data hubs, web services, and ML training/scoring models
Domain
Enterprise data warehousing, business intelligence, and ETL principles
Deliverable
production ML models
Required skills
Python, SQL, Distributed programming (Spark), Cloud (Azure), Data workflows, ETL, Apache Airflow, Unix/Linux, Bash, Git, Docker, Web services/APIs, Object-oriented programming, Data processing architecture, Security practices
Preferred skills
Azure, Apache Airflow, Containers/Docker
Technologies
Spark, Azure, Airflow, Docker, Git, Linux, Bash
Responsibilities
Lead and manage execution of data engineering projects; Engineer complete technical solutions for business challenges; Collect functional and non-functional requirements; Troubleshoot and quality check team work; Collaborate with partners, strategy consultants, and data scientists; Share knowledge via technical trainings; Communicate with clients at the executive level; Guide and mentor team members
Seniority
Senior, hands-on IC with management responsibilities