Data Engineer
Core
Design, build, and operate robust ETL/ELT pipelines moving millions of daily data points for an advertising and market research data delivery platform.
Role type
Senior hands-on Data Engineer
Builds
Production data pipelines and workflows
Domain
Advertising and Market Research
Deliverable
production ML models
Required skills
Python, SQL, dbt, ClickHouse, Airflow/Dagster, AWS, Git, CI/CD, observability
Preferred skills
Snowflake/BigQuery/Redshift, Kafka, Docker/Kubernetes, Terraform
Technologies
dbt, ClickHouse, Airflow, Dagster, SQL Server, Postgres, AWS, GitHub Copilot, Claude, ChatGPT
Responsibilities
Design and optimize ETL/ELT pipelines; Engineer and tune SQL databases; Migrate from Azure Databricks to AWS; Prototype and evaluate new tools; Implement data quality testing and monitoring; Integrate systems upstream and downstream; Collaborate with distributed teams.
Seniority
Senior, hands-on IC