Middle Data Engineer
Core
Build and operate a scalable AWS data lakehouse for an e-commerce client, managing data pipelines from ingestion to analytics-ready datasets.
Role type
Middle Data Engineer
Builds
AWS data lakehouse, medallion-layer data products, and curated datasets for Snowflake
Domain
E-commerce, Cloud Data Engineering
Required skills
Python, PySpark, SQL, AWS data services (S3, Glue, EMR, Athena), Airflow (MWAA), data modeling (dimensional, SCD), data integration, data quality practices, Git, CI/CD, Infrastructure as Code (Terraform)
Preferred skills
DataHub, Snowflake, dbt, Power BI, semantic layers
Technologies
AWS (S3, Glue, EMR, Athena, Lambda, MWAA), Apache Iceberg, Snowflake, Airflow, DataHub, Terraform, GitLab
Responsibilities
Develop and maintain scalable data pipelines; integrate data from databases, APIs, and file sources; implement data transformations and medallion layer models; apply automated testing and data quality practices; prepare curated data for Snowflake; collaborate on CI/CD and infrastructure; monitor pipelines and troubleshoot issues.
Seniority
Mid-level, hands-on IC
