Data Platform Engineer
Core
Design and build scalable batch and streaming pipelines at TB-scale, ensuring data reliability, performance, and cost-effectiveness for the Data Analytics Group.
Role type
Senior IC Data Platform Engineer
Builds
Scalable ETL/ELT and streaming pipelines, platform infrastructure, and self-service capabilities for analytics engineers, analysts, and data scientists.
Domain
Digital commerce marketing technology / Big Data Engineering
Required skills
Distributed systems engineering, Python, Scala, Spark (batch/streaming), Kafka, Pub/Sub, Advanced SQL, Workflow orchestration (Airflow), Cloud platform expertise (GCP), Infrastructure as code, Security and governance, CI/CD, Mentoring
Preferred skills
Terraform, Legacy platform migration, dbt/Astronomer, JVM tuning, Observability tooling (Grafana/Datadog), Dataflow/BigTable
Technologies
Scala, Spark, Kafka, Pub/Sub, Airflow, Astronomer, BigQuery, Dataproc, Cloud Storage, Terraform, dbt, Grafana, Datadog
Responsibilities
Design and build scalable ETL/ELT and streaming pipelines; Configure and maintain core platform infrastructure; Own and track SLOs and implement monitoring/alerting; Implement security, governance, and self-service capabilities; Mentor Associate Data Platform Engineers.
Seniority
Senior, hands-on IC