Senior Data Engineer
Core
Designing, building, and operating scalable, secure, and high-performance data platforms including batch and streaming architectures.
Role type
Senior IC data engineer (cloud data platform)
Builds
Scalable data pipelines, data architectures, and platforms powering analytics, reporting, and machine learning.
Domain
Cloud data engineering (Azure ecosystem)
Deliverable
production ML models | product features | infrastructure
Required skills
Azure Data Lake Gen2, Synapse, Databricks, PySpark, Spark SQL, complex SQL, Azure DevOps, GitHub Actions, mentoring, architecture design
Preferred skills
Streaming & real-time data processing, data governance, metadata management, advanced Python engineering, analytics & BI awareness, cloud cost optimization
Technologies
Azure Data Lake Gen2, Synapse, Databricks, PySpark, Spark SQL, Azure DevOps, GitHub Actions
Responsibilities
Design batch and streaming data architectures; Develop and maintain ETL/ELT pipelines at scale; Review code, data models, and designs; Communicate trade-offs to stakeholders and leadership
Seniority
Senior, hands-on IC with technical leadership
