Senior Data Engineer
Core
Design, develop, and maintain scalable batch and stream data pipelines to ingest, cleanse, transform, and deliver data for reporting and analytics.
Role type
Senior IC data engineer
Builds
Scalable data pipelines, data models, and BI dashboards
Domain
Automotive industry data analytics
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Big data technologies (Apache Spark, Flink, Kafka), Data warehousing, ETL processes, SQL, Python, AWS (Redshift, EMR, S3), Azure (Data Factory, Power BI), Databricks, Snowflake, Infrastructure as Code (IaC)
Preferred skills
Automotive industry data connectivity experience
Technologies
Apache Spark, Flink, Kafka, AWS Redshift, AWS EMR, AWS S3, Azure Data Factory, Power BI, Databricks, Snowflake
Responsibilities
Design and maintain data pipelines for data ingestion; Develop data processing workflows for cleansing and transformation; Operate and maintain the data platform; Perform platform upgrades and testing; Monitor pipeline performance and data quality; Diagnose and resolve pipeline and storage issues; Design data models for reporting; Develop dashboards in Power BI
Seniority
Senior, hands-on IC
