AWS Engineer
Core
Design, build, and maintain scalable ETL/ELT pipelines and data solutions on AWS Databricks for data scientists, analysts, and business stakeholders.
Role type
Senior Data Engineer (AWS Databricks)
Builds
Scalable data pipelines, Delta Lake solutions, and data platform infrastructure
Domain
Cloud Data Engineering / AWS
Deliverable
production ML models
Required skills
AWS Databricks, PySpark, SQL, Delta Lake, AWS Glue, Apache Airflow, AWS Step Functions, Git, CI/CD
Preferred skills
Real-time/streaming frameworks, data quality frameworks, infrastructure automation, agile delivery
Technologies
AWS Databricks, PySpark, SQL, Delta Lake, Amazon S3, Amazon RDS, AWS Glue, AWS Lambda, Amazon Redshift, Apache Airflow, AWS Step Functions, Git, AWS CodePipeline, AWS CodeBuild
Responsibilities
Design and deploy scalable ETL/ELT pipelines; Build and maintain data ingestion and processing pipelines; Implement and manage Delta Lake solutions; Optimize Spark workloads for performance and cost; Ensure data quality and integrity through monitoring and validation; Collaborate with cross-functional teams on reporting and analytics; Support pipeline orchestration and scheduling; Participate in CI/CD implementation; Apply data governance and security best practices; Support production issue resolution and platform improvement.