IND Senior Engineer, Data
Core
Design, build, and maintain scalable multi-tenant data platforms and infrastructure on AWS using Hadoop, Spark, and IaC to support data engineering, analytics, and business intelligence workloads.
Role type
Senior IC Data Platform Engineer (SRE focus)
Builds
Production data platforms, PaaS/SaaS solutions, and self-service data tools for data engineers and analysts
Domain
Insurance / Big Data & Cloud Infrastructure
Deliverable
production ML models | product features | infrastructure
Required skills
Hadoop, AWS EMR, Python, SQL, Spark, Linux, Terraform, CloudFormation, Jenkins, Splunk, Dynatrace, CloudWatch, ETL, data ingestion, data preparation, incident management, SRE principles, Infrastructure as Code, CI/CD pipelines
Preferred skills
Machine learning algorithms, data visualization, observability dashboards, change management processes
Technologies
AWS EMR, Hadoop, Spark, Terraform, CloudFormation, Jenkins, Splunk, Dynatrace, CloudWatch
Responsibilities
Administer Big Data platforms across Hadoop clusters in the cloud; Design and maintain multi-tenant Data Platforms via IaC; Drive triaging and service restoration for high-impact incidents; Implement SRE principles for automated response and reliability; Evolve architecture for Platform, PaaS, and SaaS solutions; Provide technical leadership and mentorship to junior engineers; Enable self-service capabilities for data wrangling and analysis; Manage data assets, metadata, and visualization for discoverability
Seniority
Senior, hands-on IC with mentorship responsibilities