Senior/Lead Software Data Engineer
Core
Designing and scaling data processing pipelines for global road networks, visual maps, and navigation features.
Role type
Senior Software Data Engineer
Builds
Data processing pipelines for high-definition maps and navigation
Domain
Mapping, navigation, and automotive data infrastructure
Deliverable
production ML models | infrastructure
Required skills
Data pipeline design and scaling, SQL, distributed computing principles, workflow management (Airflow/Oozie/Luigi), cloud platform expertise (AWS S3/EC2/EMR/Glue/Athena/Kinesis), C++/Python/Scala/Java
Preferred skills
Spark, mapping/navigation/automotive industry experience
Technologies
AWS (S3, EC2, IAM, EMR, Glue, Athena, Kinesis), Airflow, Oozie, Luigi, Spark, C++, Python, Scala, Java
Responsibilities
Take ownership, improve, scale, and iterate on existing data processing pipelines; Design and implement new data processing pipelines; Collect and monitor performance metrics; Discuss and implement security best practices
Seniority
Senior, hands-on IC