Data Engineer (Cloud)
Core
Design and maintain scalable ETL/ELT pipelines and data lake zones for enterprise and public sector digital transformation.
Role type
Senior Cloud Data Engineer
Builds
Cloud-based data platforms, data lakes, and production-ready data pipelines
Domain
Cloud data engineering, Big Data, Azure ecosystem
Deliverable
production ML models | product features
Required skills
Python, Scala, or Java; SQL; Apache Spark; Databricks Platform (Unity Catalog, Notebooks, SQL Warehouses, LakeFlow); ETL/ELT pipeline design; relational databases; data warehousing; data lakes; workflow orchestration (Apache Airflow, Prefect); Git version control
Preferred skills
Streaming technologies (Apache Kafka, Spark Streaming, Apache Flink); Lakehouse Catalog technologies (Delta, Iceberg); modern data warehouses (Snowflake, Amazon Redshift, Google BigQuery, Azure Synapse); containerization (Docker, Kubernetes); CI/CD pipelines; Infrastructure as Code (Terraform, CloudFormation)
Technologies
Databricks, Azure, AWS, Google Cloud, Apache Spark, Apache Airflow, Prefect, Unity Catalog, Delta, Iceberg, Snowflake, Amazon Redshift, Google BigQuery, Azure Synapse, Apache Kafka, Docker, Kubernetes, Terraform, CloudFormation
Responsibilities
Design data lake zones; build and maintain scalable ETL/ELT pipelines; work with relational databases, data warehouses, and data lakes; translate business logic into production-ready pipelines; contribute to reusability initiatives
Seniority
Senior, hands-on IC
