Data Engineer II
Core
Design, build, and maintain scalable batch and real-time data pipelines and cloud-native data platforms to power analytics, product insights, and data-driven decision-making.
Role type
Data Engineer II
Builds
Reliable, scalable, and high-performance data systems including data lakes, warehouses, and marts for Product, Analytics, and Business teams.
Domain
Technology / Data Engineering
Deliverable
production ML models | product features | dashboards & analysis | infrastructure
Required skills
Apache Spark (Scala, Python), SQL, Kafka, Maxwell, dbt, dimensional modeling, data quality, observability, CI/CD, Git
Preferred skills
Medallion Architecture, Trino, BigQuery, S3, event-driven architectures, performance tuning, automation
Technologies
Kafka, Maxwell, Spark, S3, Trino, BigQuery, dbt, Metabase
Responsibilities
Design and build scalable batch and real-time data pipelines; Develop and optimize data models following Medallion Architecture; Build and maintain cloud-native data platforms; Design robust data ingestion frameworks; Create and optimize data warehouses and data marts; Partner with stakeholders to translate requirements into data solutions; Develop reusable dbt models and testing frameworks; Optimize Spark jobs and queries for performance; Own end-to-end lifecycle of critical data pipelines; Build core data platform frameworks and automation; Ensure data quality through validation and monitoring; Enable analytics teams with trusted datasets and dashboards.
Seniority
Mid-level, hands-on IC