10607 - Software Engineer III
Core
Design, develop, and maintain scalable Python-based data pipelines and workflows using Apache Airflow and Medallion Architecture (Bronze, Silver, Gold) to support analytics, reporting, and data-driven initiatives.
Role type
Senior Data Engineer
Builds
Production data pipelines, ETL/ELT solutions, and data models for enterprise data platforms
Domain
Automotive industry data engineering
Deliverable
production ML models
Required skills
Python, SQL, Apache Airflow, ETL/ELT, Medallion Architecture, data quality checks, CI/CD, data modeling
Preferred skills
Cloud platforms (Azure, AWS, GCP), Spark/PySpark, Git, DevOps, master data management
Technologies
Apache Airflow, Python, SQL, Azure Data Lake, AWS, GCP, Spark, PySpark
Responsibilities
Design and maintain scalable data pipelines; Build and manage data workflows with Apache Airflow; Implement Medallion Architecture data layers; Develop robust ETL/ELT solutions; Create reusable Python frameworks; Apply data quality checks and validation; Optimize pipelines for performance and cost; Manage production data workloads; Design data models for analytics and ML; Implement CI/CD best practices; Create monitoring dashboards and alerts.
Seniority
Senior, hands-on IC