Software Engineer II
Core
Design, build, and maintain extensible data engineering components (Fabric Materialized Lake View, HDInsight) using C#, Java, Scala, or Python, focusing on data refresh, scheduling, and query optimization.
Role type
Senior IC Data Engineer (Azure/Fabric)
Builds
Fabric data engineering components, HDInsight services, and Materialized Lake View pipelines
Domain
Cloud Data Engineering / Big Data
Deliverable
production ML models | product features
Required skills
C#, Java, Scala, Python, Apache Spark, Kafka, Spark SQL, PySpark, Azure Stack, Big Data technologies, Container-based architectures, Distributed systems debugging
Preferred skills
Security and privacy advocacy, Incident management, Telemetry integration, Customer requirement definition
Technologies
Azure, Linux, Windows, Docker, Kubernetes, Power BI, Synapse, AKS, Data Factory, Purview
Responsibilities
Design data refresh and query optimization features; Review code for correctness and security; Debug complex issues in distributed systems; Run live site operations on-call; Integrate logging and instrumentation; Build dashboards and alerts; Collaborate with product managers to define customer requirements
Seniority
Senior, hands-on IC