Data engineer @ SW Factory
Core
Build and maintain scalable data platforms and ETL/ELT pipelines to support data-driven development and turn engineering data into actionable KPIs.
Role type
Senior Data Engineer
Builds
Data platforms, ingestion frameworks, lakehouse storage, and governed data products
Domain
Automotive software engineering and data infrastructure
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Python, SQL, data pipeline orchestration (Dagster/Airflow), Snowflake, Apache Iceberg, data modeling, dbt, data cataloguing/governance, cloud platforms (Azure), Kubernetes, Helm, Docker, CI/CD, monitoring/observability
Preferred skills
Experience with Unity Catalog, Polaris, GitHub Actions, Scrum/Kanban/SAFe
Technologies
Snowflake, Apache Iceberg, Dagster, Kubernetes, Helm, Docker, Azure, Grafana, GitHub Actions
Responsibilities
Design and maintain end-to-end data platform including ingestion and warehousing; Build reusable ingestion frameworks for new data sources; Evolve lakehouse table formats, schemas, and governance; Define and enforce data contracts and quality standards; Monitor pipelines, data quality, and infrastructure health; Deploy and operate data infrastructure using Kubernetes and GitOps; Document architecture and governance to support self-service data use
Seniority
Senior, hands-on IC