Software Engineer I (Data Eng infra)
Core
Design, build, and maintain robust and scalable data pipelines and infrastructure to ingest, transform, and load data for Aurora's self-driving technology platform.
Role type
Software Engineer I (Data Engineering Infrastructure)
Builds
Scalable data lake and data warehouse ecosystem infrastructure, data pipelines, and tools for massive-scale data processing.
Domain
Autonomous driving / Self-driving technology / Cloud Data Engineering
Deliverable
production ML models | infrastructure
Required skills
Python, Go, or C++ programming; SQL; Apache Spark, Flink, or Kinesis; AWS cloud services (S3, Redshift, Glue); Apache Airflow; Terraform; DBT; relational and NoSQL databases
Preferred skills
Snowflake; modern data stack tools; elegant system design
Technologies
AWS, Terraform, Apache Spark, Flink, Kinesis, Airflow, DBT, Snowflake, S3, Redshift, BigQuery, Glue
Responsibilities
Design and maintain ETL/ELT processes; develop data infrastructure components using AWS and IaC; collaborate with data scientists and autonomy teams; optimize data processing for performance and cost; implement monitoring and alerting; champion data governance and security
Seniority
Junior, hands-on IC