Senior Data Engineer
Core
Design, build, and maintain enterprise-grade data platforms, modern Lakehouse architectures, and high-performance data pipelines for analytics and AI workloads.
Role type
Senior IC data engineer (cloud-native)
Builds
Scalable batch and streaming data pipelines, Lakehouse solutions, and robust data services
Domain
Enterprise data engineering on Microsoft Azure
Deliverable
production ML models | product features | infrastructure
Required skills
Python, Apache Spark, Azure Databricks, ETL/ELT design, REST APIs, Infrastructure as Code (Terraform/Terragrunt), data modeling, CI/CD
Preferred skills
Spark performance optimization, streaming architectures, Lakehouse technologies (Delta Lake, Iceberg, Hudi), observability, security best practices, mentoring
Technologies
Python, Apache Spark, Azure Databricks, Delta Lake, Terraform, Terragrunt, Azure Storage, Azure Event Hubs, Azure Functions
Responsibilities
Design and implement scalable batch and streaming data pipelines; Develop modern ETL/ELT architectures; Build robust APIs and data services; Optimize Spark applications; Implement dimensional data models and data quality controls; Collaborate on end-to-end Azure-based data platforms; Ensure observability and apply security best practices; Participate in customer workshops and technical consulting.
Seniority
Senior, hands-on IC with technical leadership
