Senior AWS Data Engineer (Strong Databricks)
Core
Design and lead scalable, secure, and high-performance cloud data platforms across AWS/Azure, focusing on data pipelines, processing frameworks, and cloud infrastructure.
Role type
Senior hands-on IC data engineer (cloud platforms)
Builds
Enterprise-scale data solutions, data lakes, data warehouses, and lakehouse solutions
Domain
Cloud data engineering (AWS/Azure)
Required skills
AWS and/or Azure data services, ETL/ELT development, Data Lakes/Lakehouses/Warehousing, Medallion Architecture, Advanced SQL, Python, Apache Spark, Databricks, Kafka, Airflow, dbt, Data modeling, Data quality, Data governance, Git, CI/CD, DevOps
Preferred skills
AWS or Azure certifications, Databricks certification, Snowflake, Real-time data processing, Infrastructure as Code (Terraform/CloudFormation/Bicep), Data observability, Data Mesh concepts
Technologies
AWS, Azure, Databricks, Spark, Kafka, Airflow, dbt, Snowflake, Terraform, CloudFormation, Bicep
Responsibilities
Design, develop, and maintain scalable cloud-based data pipelines and data platforms; Build and optimize data lakes, data warehouses, and lakehouse solutions; Implement Medallion Architecture; Develop and maintain robust ETL/ELT pipelines; Develop and optimize complex SQL queries, data models, and transformation logic; Implement data quality checks, validation frameworks, error handling, and monitoring mechanisms; Optimize data pipeline performance, scalability, reliability, and cloud infrastructure costs; Implement CI/CD pipelines, automated testing, and DevOps practices; Troubleshoot production issues and ensure data pipeline availability, accuracy, and timely delivery; Mentor junior Data Engineers and promote engineering best practices.
Seniority
Senior, hands-on IC