SDE II - Data Engineer
Core
Build, maintain, and optimise scalable batch and streaming data pipelines for programmatic advertising, campaign analytics, audience targeting, and attribution.
Role type
Senior IC Data Engineer
Builds
Data pipelines, ingestion workflows, analytical data stores, and data quality monitoring for DSP operations
Domain
Ad-tech / Programmatic Advertising / Big Data
Deliverable
production ML models
Required skills
Python, SQL, Apache Spark/PySpark, ETL/ELT, batch processing, streaming data, workflow orchestration (Airflow/Prefect/Dagster), data modelling, data quality practices
Preferred skills
Kafka, AWS/GCP/Azure, data lakehouse (Iceberg/Delta Lake/Hudi), StarRocks/ClickHouse, Java/Scala, Docker/Kubernetes, CI/CD, ML feature engineering
Technologies
Apache Spark, PySpark, Apache Kafka, Apache Airflow, StarRocks, ClickHouse, Apache Iceberg, Delta Lake, Apache Hudi, AWS, GCP, Azure
Responsibilities
Develop end-to-end batch and streaming pipelines for bid requests, impressions, clicks, and conversions; Build data ingestion and transformation workflows; Implement data quality checks, schema validation, and monitoring; Troubleshoot production pipeline failures and performance bottlenecks; Collaborate with backend and ML teams on data solutions; Contribute to pipeline performance improvements and cost efficiency
Seniority
Mid-level (2–5 years), hands-on IC
