Data Engineer (AWS)
Core
Design, build, and maintain scalable data pipelines and data platforms on AWS cloud infrastructure.
Role type
Senior Data Engineer (AWS)
Builds
Data lakes, data warehouses, and ETL/ELT workflows for analytics and reporting
Domain
Cloud data engineering (AWS)
Deliverable
production ML models | product features | dashboards & analysis
Required skills
AWS services (S3, Glue, Redshift, EMR, Lambda, Athena, IAM, RDS), SQL, Python, PySpark, ETL/ELT pipeline development, big data technologies (Spark, Hadoop, Databricks), workflow orchestration (Apache Airflow), data warehousing and data lake architecture, version control (Git)
Preferred skills
AWS certifications, Snowflake, Databricks, real-time data processing (Kafka, Kinesis), CI/CD pipelines, machine learning data pipelines
Technologies
AWS, S3, Glue, Redshift, EMR, Lambda, Athena, IAM, RDS, Spark, Hadoop, Databricks, Apache Airflow, Kafka, Kinesis, Snowflake, Git
Responsibilities
Design and develop scalable data pipelines and ETL/ELT workflows; Build and optimize data solutions on AWS cloud platforms; Develop and manage data lakes and data warehouses; Integrate data from multiple sources ensuring quality and consistency; Implement data modeling, transformation, and validation processes; Optimize data processing jobs for performance and cost efficiency; Monitor and troubleshoot data pipeline and infrastructure issues; Create and maintain technical documentation for data architecture
Seniority
Senior, hands-on IC