ROP - SE2/SSE - Azure Data
Core
Design, build, and maintain data engineering components (Fabric Materialized Lake View, HDInsight) on Azure, focusing on code quality, system reliability, and customer requirement definition.
Role type
Senior IC Data Engineer / Site Reliability Engineer
Builds
Fabric data engineering components, HDInsight services, and Materialized Lake View pipelines
Domain
Cloud Data Engineering (Azure)
Deliverable
production ML models | product features | infrastructure
Required skills
C#, Java, Scala, Python, C++, JavaScript, Azure stack (Storage, Compute, Networking, Fabric, Purview, Synapse, AKS, DevOps, Data Factory, Power BI), big data technologies (Spark, Kafka, Hadoop, HBase), container-based architectures (Docker, Kubernetes), distributed systems debugging, incident management, telemetry integration, dashboard creation, customer requirement definition
Preferred skills
AI tools usage, architectural design ownership, code review leadership, troubleshooting guide improvement
Technologies
Azure, Fabric, HDInsight, Spark, Kafka, Hadoop, HBase, Docker, Kubernetes, C#, Java, Scala, Python, C++, JavaScript
Responsibilities
Write extensible, maintainable code for data services; Design data refresh, scheduling, and query optimisation features; Review code for correctness, test coverage, and security; Coach junior engineers through code reviews; Debug complex issues in distributed systems; Run live site operations on an on-call basis; Integrate logging and instrumentation for system health; Classify metrics and create alerts; Work with product managers to define customer requirements
Seniority
Senior, hands-on IC