Senior Software Development Engineer, Insights Data Services
Core
Design and optimize distributed batch and streaming pipelines to process cost and usage data at massive scale for AWS customers.
Role type
Senior Software Development Engineer (Data Infrastructure)
Builds
Distributed data processing systems for AWS Cost Explorer, Budgets, and Cost Anomaly Detection
Domain
Cloud infrastructure, data engineering, cost management
Deliverable
production ML models | product features | infrastructure
Required skills
Distributed systems design, batch and streaming pipeline optimization, system architecture, technical mentorship, operational excellence, data modeling
Preferred skills
Full software development lifecycle management, code review leadership, source control management, testing strategies
Technologies
Spark, EMR
Responsibilities
Design and implement large-scale distributed data processing systems handling trillions of records, Build and optimize batch and streaming pipelines for throughput and latency, Drive technical decisions on architecture and data modeling, Mentor engineers and lead design reviews, Own operational excellence including monitoring and on-call, Collaborate with product and partner teams to deliver customer-facing features
Seniority
Senior, hands-on IC with mentorship responsibilities