Senior Software Engineer
Core
Design, build, and own optimal data processing architectures and systems for mission-critical analytical data pipelines, dashboards, and metrics at PiB scale, leveraging Azure and open-source technologies to generate real-time insights.
Role type
Senior Software Engineer (Data Analytics Platform)
Builds
Scalable, fault-tolerant data pipelines, core datasets, dashboards, and metrics for Bing's grounding business.
Domain
Big Data Analytics / Cloud Infrastructure
Deliverable
production ML models | product features | dashboards & analysis
Required skills
C#, C++, Java, Python, Spark, Flink, Kafka, EventHub, HDFS, Azure Blob Storage, Azure cloud environment, AI for coding/testing/data processing, data pipeline performance optimization, data compliance and governance
Preferred skills
Domain expertise in Spark or Flink for PiB-level data, experience leveraging AI in data processing and validation
Technologies
Azure, Spark, Flink, Kafka, EventHub, HDFS, Azure Blob
Responsibilities
Design and develop end-to-end data assets; build core datasets and scalable pipelines; implement data anomaly detection and quality checks; optimize pipelines for compute and storage efficiency; ensure high-quality datasets and SLAs; collaborate with data scientists and product managers.
Seniority
Senior, hands-on IC
