Data Engineer
Core
Architect and lead the development of large-scale data pipelines and data lakes handling billions of daily events, ensuring data availability, security, and scalability for real-time and batch processing.
Role type
Senior IC data engineer (large-scale systems)
Builds
Large-scale data pipelines, data lakes, and tools powering analytics and data-driven workflows
Domain
Technology / Data Infrastructure
Deliverable
production ML models | product features | infrastructure
Required skills
Large-scale distributed computing systems, data modeling, SQL, Apache Spark, Apache Kafka, Terraform, Python/Scala/Java, ETL/ELT design patterns, data orchestration (Airflow/dbt/Dagster), data quality frameworks, modern data storage (Delta Lake/Snowflake/BigQuery/Redshift), data governance and privacy regulations
Preferred skills
Strategic thinking (build vs buy), mentoring engineers, cross-functional collaboration
Technologies
Spark, Kafka, Terraform, Airflow, dbt, Dagster, Delta Lake, Snowflake, BigQuery, Redshift
Responsibilities
Architect and lead development of large-scale data pipelines and data lakes; Design and implement solutions for real-time and batch processing; Make high-level architectural decisions on system design and technology choices; Collaborate with stakeholders to build tools and frameworks for analytics and data products; Work with leadership to devise technical roadmaps; Mentor engineers across back-end infrastructure and data engineering disciplines
Seniority
Senior, hands-on IC
