Data Engineer-Data Platforms-AWS
Core
Design, build, and support scalable, secure, and high-performance data platforms on AWS.
Role type
Senior IC AWS Data Engineer
Builds
Data pipelines, serverless and containerized workloads, batch and large-scale data processing solutions
Domain
Cloud data engineering on AWS
Deliverable
production ML models
Required skills
AWS services (S3, Lambda, EC2, EKS, Glue, Athena, RDS, VPC, IAM, CloudFormation), SQL, Python/Scala, Apache Spark, ETL/ELT, data modeling, distributed systems
Preferred skills
DBT, Snowflake, Databricks, modern data lake/lakehouse architectures
Technologies
AWS EMR, AWS Glue Catalog, Kinesis, Managed Streaming for Apache Kafka, AWS RedShift, Aurora, DynamoDB, AWS DMS, Apache Airflow, AWS Databrew, RedShift Spectrum
Responsibilities
Design and develop data pipelines and platforms; Build and operate serverless and containerized workloads; Develop batch and large-scale data processing solutions; Implement data ingestion, transformation, and analytics; Write complex SQL queries; Manage and optimize data storage solutions; Design and manage AWS infrastructure using IaC; Apply AWS security best practices; Develop clean, scalable code; Monitor, troubleshoot, and optimize performance, cost, and reliability; Collaborate with cross-functional teams
