Middle Data Engineer
Core
Design, build, and maintain scalable batch and near-real-time data pipelines, data warehouses, and cloud-based data platforms for high-load business environments.
Role type
Middle+/Senior Data Engineer
Builds
Scalable data pipelines, data lakes, lakehouse architectures, and data warehouses
Domain
Cloud data engineering (AWS)
Required skills
Python, SQL, Spark/PySpark, AWS data services, ETL/ELT pipeline development, data modeling, CI/CD, Docker, Terraform
Preferred skills
Kafka/Kinesis, Delta Lake/Iceberg/Hudi, Kubernetes, GCP/Azure data services, BI tools, AI/ML data workflows
Technologies
Python, SQL, Spark, PySpark, Airflow, dbt, AWS (S3, Glue, Lambda, Athena, EMR, Redshift, Firehose, Kinesis, SQS, EventBridge), Databricks, Snowflake, BigQuery, Terraform, Docker, Git
Responsibilities
Design and optimize ETL/ELT workflows; build and support data lakes and warehouses; integrate data from APIs, databases, and streaming sources; ensure data quality and monitoring; contribute to infrastructure automation and CI/CD.
Seniority
Middle+/Senior, hands-on IC