AWS Data Engineer
Core
Build and maintain scalable ETL/ELT pipelines and evolve the AWS-based data lakehouse for industrial data sources and high-volume time-series data.
Role type
Senior IC AWS Data Engineer (Data Lakehouse)
Builds
Production-ready, analytics-optimized datasets and scalable data infrastructure
Domain
Energy infrastructure + Cloud Data Engineering
Deliverable
production ML models | product features | dashboards & analysis
Required skills
AWS Glue, Athena, Lambda, S3, Apache Iceberg, PySpark, Python, advanced SQL, Terraform/CloudFormation, data modeling (medallion architecture), ETL/ELT pipeline design
Preferred skills
Step Functions, Kinesis, Lake Formation, DynamoDB, boto3, pyiceberg, pyarrow, CI/CD, time-series/IoT data handling
Technologies
AWS, Apache Iceberg, PySpark, Terraform, CloudFormation, Python, SQL
Responsibilities
Build and maintain scalable ETL/ELT pipelines for batch and real-time processing; Optimize data lakehouse storage, performance, and cost; Manage orchestration workflows with complex dependencies; Implement data governance, security controls, and audit policies; Build monitoring, alerting, and data quality testing
Seniority
Senior, hands-on IC
