Senior Data Infra Engineer - Big Data
Core
Design, build, and maintain robust and scalable data pipelines and infrastructure to power insights and analytics for an omnichannel advertising platform.
Role type
Senior Data Infra Engineer
Builds
Data pipelines, data warehouse, and data lake solutions for ad tech analytics
Domain
Ad Tech / Big Data
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Apache Spark, distributed data processing frameworks (Flink, Hive, Trino), GCP or AWS cloud services, Kafka/streaming platforms, data warehouse and data lake concepts
Preferred skills
Lakehouse table formats (Apache Iceberg, Delta Lake)
Technologies
Apache Spark, Google Cloud Platform, Amazon Web Services, BigQuery, S3, GCS, EMR, AirFlow, Kafka
Responsibilities
Develop and optimize ETL/ELT pipelines; Manage cloud infrastructure; Enhance data storage solutions; Collaborate with cross-functional teams; Ensure data integrity through monitoring and alerting
Seniority
Senior, hands-on IC
