AWS Data Engineer
Core
Design, implement, optimize, and maintain data engineering solutions on AWS for customers, including data warehouse, data lake, and lake-house architectures.
Role type
Senior IC data engineer (AWS)
Builds
Data pipelines, data platforms, and analytical solutions
Domain
Cloud data engineering (AWS)
Required skills
AWS services (Glue, Lambda, Step Functions, Redshift, EMR, Kinesis), PySpark/Spark Scala, Python, SQL, Databricks, streaming data pipelines, NoSQL databases, Git, CI/CD
Preferred skills
AWS certifications, Amazon AppFlow, EKS, API Gateway, BI/visualization tools (Tableau/Power BI)
Technologies
AWS Glue, AWS Lambda, AWS Step Functions, Amazon Redshift, Amazon EMR, Amazon Kinesis, PySpark, Spark Scala, Databricks, Python, SQL, Git
Responsibilities
Design and implement data engineering solutions on AWS; develop and optimize data pipelines using PySpark/Spark Scala; manage large-scale data processing workloads on Databricks; implement streaming data pipelines for near real-time analytics; develop CI/CD pipelines for data engineering components.
Seniority
Mid-level, hands-on IC