AWS Cloud Data Engineer
Core
Design, build, and maintain scalable data architectures and pipelines using AWS to ingest, transform, and store large volumes of structured and unstructured data for data scientists and analysts.
Role type
Senior IC AWS Cloud Data Engineer
Builds
Scalable data pipelines, data models, and workflows for batch and real-time processing.
Domain
Cloud Data Engineering / Big Data
Deliverable
production ML models | product features
Required skills
Python, SQL, dbt, Apache Spark, PySpark, Terraform, AWS (Glue, Lambda, S3, EKS, ECS, VPC), Airflow, Snowflake, Delta Lake
Preferred skills
Knowledge of AWS SDK (boto), Kubernetes deployment for Airflow, Snowpipe, Apache Iceberg, Cortex AI
Technologies
AWS, dbt, Databricks, Apache Spark, Terraform, Snowflake, Airflow, Kubernetes, Delta Lake
Responsibilities
Write complex SQL transformations to clean and structure data; Develop modular, reusable data pipelines; Implement data testing and validation (schema tests, data quality checks); Design and develop scalable data pipelines using Databricks and Apache Spark; Transform and process large datasets using PySpark, SQL, and Delta Lake; Implement data ingestion from multiple sources (APIs, streaming, databases).
