Senior Data Engineer
Core
Design and build scalable data platform capabilities and high-performance pipelines to support data and machine learning workloads.
Role type
Senior IC data engineer (cloud platform)
Builds
Data platforms, processing frameworks, and reusable tooling for data product teams
Domain
Cloud data engineering (Azure, Databricks)
Deliverable
production ML models | infrastructure
Required skills
Python, Scala, Apache Spark, Databricks, Azure, CI/CD, Infrastructure as Code, distributed systems architecture, observability, code review
Preferred skills
Technical leadership, mentoring, architectural decision-making
Technologies
Python, Scala, Spark, Databricks, Azure
Responsibilities
Design and build data platform capabilities for data and ML workloads; Develop high-performance data pipelines and processing frameworks; Own and evolve platform components for data product lifecycle; Improve platform reliability, observability, and data quality; Create reusable libraries and engineering patterns; Partner with Data Scientists and ML Engineers to enable ML use cases; Mentor engineers through technical guidance and code reviews
Seniority
Senior, hands-on IC with mentorship responsibilities