Senior Data Engineer - AWS
Core
Design, build, and optimize scalable data pipelines and infrastructure on AWS to support analytics and machine learning initiatives for clients across healthcare, high-tech, CPG, and finance.
Role type
Senior IC data engineer (AWS cloud)
Builds
Production data pipelines, ETL processes, and data infrastructure
Domain
Cloud data engineering / Big data
Deliverable
production ML models | infrastructure
Required skills
AWS services (S3, Glue, EMR, Lambda, Redshift), Python, Java, Scala, SQL, NoSQL, data warehousing, big data technologies
Preferred skills
Docker, Kubernetes, Apache Airflow
Responsibilities
Design and maintain scalable data pipelines and ETL processes; Optimize data storage and retrieval mechanisms; Implement data governance and security best practices; Troubleshoot and debug data pipeline issues; Collaborate with data scientists and analysts to implement solutions; Stay abreast of emerging technologies and recommend innovative solutions