AWS Data Engineer
Core
Design, develop, and maintain scalable data engineering solutions, pipelines, and cloud-based data platforms on AWS.
Role type
Senior IC AWS Data Engineer
Builds
Scalable data pipelines, ETL/ELT workflows, data lakes, and data warehouse solutions
Domain
Cloud data engineering on AWS
Required skills
AWS Glue, Python, PySpark, SQL, Amazon S3, AWS Lambda, Amazon Redshift, Apache Spark, ETL/ELT workflows, data modeling, data lakes, data warehousing
Preferred skills
Terraform, CloudFormation, Kinesis, Kafka, SQS, CI/CD, Git, Snowflake, data governance, data quality frameworks
Technologies
AWS Glue, S3, Lambda, IAM, Step Functions, Kinesis, Kafka, SQS, Redshift, Snowflake, Athena, EMR, Terraform, CloudFormation, PySpark, Python, SQL
Responsibilities
Design and build scalable data pipelines on AWS; Develop ETL/ELT workflows using AWS Glue, Lambda, EMR, and Step Functions; Build data ingestion solutions using Kinesis, Kafka, or SQS; Design and optimize data lakes using Amazon S3, Glue Data Catalog, and Lake Formation; Develop and optimize data warehouse solutions using Amazon Redshift or Snowflake; Implement data quality checks, monitoring, logging, and production support processes; Develop data transformation solutions using Python/PySpark and SQL; Support CI/CD deployments and contribute to automation and DevOps practices; Troubleshoot production issues and ensure reliable data pipelines
Seniority
Senior, hands-on IC
