Sr. Data Engineer
Core
Design and implement data integration frameworks and backend services for batch and streaming workloads on Microsoft Fabric and Synapse Analytics.
Role type
Senior IC data engineer (Spark/Scala)
Builds
Distributed computing applications, REST-based microservices, and data integration pipelines
Domain
Big data engineering on Azure (Microsoft Fabric, Synapse)
Deliverable
production ML models
Required skills
Scala, Apache Spark, Microsoft Fabric, Synapse Analytics, REST APIs, JVM, CI/CD, Git, Maven, SBT
Preferred skills
Functional programming, SOLID principles, Hadoop, Delta Lake, Azure Data Factory, ARM Templates
Technologies
Apache Spark, Scala, Microsoft Fabric, Synapse Analytics, GitHub Actions, Maven, SBT, Azure Functions, Delta Lake
Responsibilities
Design and develop data integration pipelines using Apache Spark with Scala; Build and optimize distributed computing applications for batch and streaming; Perform advanced Spark performance tuning; Develop REST-based microservices and APIs on the JVM; Engineer modular, testable code applying functional programming principles; Architect and maintain CI/CD pipelines using GitHub Actions, Maven, and SBT.
Seniority
Senior, hands-on IC