Sr. Data Engineer
Core
Design and implement data integration frameworks and backend services for batch and streaming workloads on Microsoft Fabric and Synapse Analytics.
Role type
Senior IC data engineer (Spark/Scala)
Builds
Distributed computing applications, REST-based microservices, and data integration pipelines for enterprise analytics.
Domain
Big data engineering on Azure (Microsoft Fabric, Synapse)
Deliverable
production ML models | product features
Required skills
Scala (functional programming), Apache Spark (batch/streaming), Azure Data Services (Synapse, ADF), REST API development, CI/CD automation, Hadoop/Delta Lake
Preferred skills
JVM-based engineering, microservices architecture, cloud platform experience (AWS/GCP)
Technologies
Apache Spark, Scala, Microsoft Fabric, Synapse Analytics, Azure Data Factory, GitHub Actions, Maven, SBT, Delta Lake
Responsibilities
Design and develop data integration pipelines using Apache Spark with Scala; Build and optimize distributed computing applications for scalable batch and streaming workloads; Perform advanced Spark performance tuning (partitioning, memory, query optimization); Develop REST-based microservices and APIs on the JVM; Engineer modular, testable code applying functional programming principles; Architect and maintain CI/CD pipelines using GitHub Actions, Maven, and SBT.
Seniority
Senior, hands-on IC
