Senior Software Engineer-ETL
Core
Design, develop, and maintain ETL pipelines and data warehousing solutions on Microsoft Azure to ingest data from multiple sources and create reportable datamarts.
Role type
Senior ETL Data Engineer
Builds
Data pipelines, datamarts, and monitoring utilities for a global open data ecosystem
Domain
Retail consumer intelligence / Data Engineering
Deliverable
production ML models
Required skills
Python, Complex SQL, Data warehousing concepts, ETL design, Fast API, Airflow, Microsoft Azure
Preferred skills
Kubernetes, Docker, GitHub Actions, DevOps pipelines, Microservices architecture, RESTful APIs
Technologies
Python, Snowflake, Postgres, Azure, Airflow, Kubernetes, Docker, GitHub, Fast API
Responsibilities
Analyze, design, develop, and troubleshoot ETL applications; Deploy components using CI/CD pipelines; Ingest data from multiple sources; Perform complex business transformations; Build monitoring and automation utilities
Seniority
Senior, hands-on IC