Software Engineer – Data Platform
Core
Design, implement, and maintain secure, scalable, fault-tolerant data ingestion pipelines, metadata-driven components, and data quality frameworks for a global data platform.
Role type
Senior IC data platform engineer
Builds
Production-grade data ingestion pipelines, APIs, data interfaces, and data quality monitoring systems
Domain
Automotive/Industrial technology, data engineering, distributed systems
Deliverable
production ML models | product features | infrastructure
Required skills
Software engineering (Java, Scala, Python), advanced SQL, CI/CD, API design, data pipeline architecture, data quality framework design, distributed systems, Git
Preferred skills
Azure, Databricks, hyperscaler resource management, data lake/warehouse concepts, Unity Catalog, Theobald Extract Universal, Debezium, CDC patterns
Technologies
Python, Scala, Java, SQL, Git, Azure, Databricks, Unity Catalog, Debezium, rclone, Kerberos, HTTP
Responsibilities
Design and implement fault-tolerant, observable data pipelines with logging and alerting; Build and maintain extraction services and custom APIs; Establish and operate data quality monitoring with automated validation rules; Integrate with source systems (SAP, Salesforce, SharePoint) and manage audit/traceability; Collaborate with cybersecurity and business stakeholders to define technical patterns; Serve as technical escalation point for complex source integration.
Seniority
Senior, hands-on IC
