Data Engineer
Core
Design, develop, and implement scalable data and platform solutions across AWS cloud and hybrid/on-premises environments, building production-grade data pipelines and automation frameworks.
Role type
Senior Data Engineer
Builds
Production-grade data pipelines, platform services, and automation frameworks
Domain
Cloud data engineering and platform operations
Deliverable
production ML models
Required skills
Python, PySpark, SQL, AWS, Linux/Unix administration, ETL/ELT, Data Lake/Lakehouse architectures, CI/CD, Git, Distributed data processing
Preferred skills
Streaming/event-driven architectures, OpenSearch administration, Monitoring/observability tools, Data governance/security, Insurance/banking domain experience
Technologies
AWS Glue, EMR, S3, Redshift, Lambda, Kafka/MSK, DBT, Hive, Trino, Presto, OpenSearch, Amazon Bedrock, AgentCore, Model Context Protocol (MCP), Apache Iceberg, Datadog, Amazon CloudWatch, Grafana, Prometheus
Responsibilities
Design and implement scalable data solutions; Build and optimize data pipelines; Support enterprise data platforms (data lakes, lakehouse); Develop CI/CD pipelines; Implement and support platform technologies; Monitor platform reliability and performance; Troubleshoot production issues; Collaborate on platform modernization.