Senior AWS Data Engineer â Data Lake Platform
Core
Design, build, and optimize enterprise-scale data lake platforms on AWS, managing end-to-end data ingestion, processing, and serving workflows.
Role type
Senior IC AWS Data Engineer (Data Lake Platform)
Builds
Enterprise data lake platforms, scalable data pipelines, and data-serving solutions for analytics and downstream consumption.
Domain
Cloud Data Engineering / Big Data
Required skills
AWS Data Services (S3, EMR, Glue, Athena, Redshift, Lambda, RDS, IAM), PySpark, Apache Spark, Apache Airflow, Python, Advanced SQL, Data Modeling, PostgreSQL, Hasura/GraphQL
Preferred skills
dbt, Apache Iceberg/Delta Lake/Hudi, Kafka, Amazon Aurora, BFSI/Insurance domain experience
Technologies
AWS, PySpark, Apache Airflow, PostgreSQL, Hasura, GraphQL, Apache Iceberg, Delta Lake, Apache Hudi, Kafka, dbt
Responsibilities
Design and maintain scalable AWS-based data lake platforms; Build data ingestion, staging, transformation, and consumption layers; Develop and optimize data processing pipelines using PySpark and EMR; Implement workflow orchestration with Apache Airflow; Monitor pipeline performance, troubleshoot issues, and ensure SLAs; Implement data security, access controls, and governance best practices; Optimize query execution, storage utilization, and AWS infrastructure costs.
Seniority
Senior, hands-on IC
