Data Engineer
Core
Designing and deploying robust, scalable data platforms in cloud environments to support high-value analytical use cases for clients across various sectors.
Role type
Senior Data Engineer
Builds
End-to-end data pipelines (real-time and batch), data storage architectures, and data services/APIs.
Domain
Digital Product Consulting / Cloud Data Engineering
Deliverable
production ML models | product features | infrastructure
Required skills
Python, Scala, Cloud architecture (AWS/GCP/Azure), Distributed processing (Apache Spark, Apache Flink), Data orchestration (Airflow, Dagster), Real-time streaming (Kafka, Kinesis), Infrastructure-as-Code (Terraform), SQL, Data governance tools (dbt, Great Expectations)
Preferred skills
MLOps, DataOps practices, REST API design, Service-oriented architectures
Technologies
Apache Spark, Apache Flink, Kafka, Kinesis, AWS, GCP, Azure, Terraform, Airflow, dbt, SQL
Responsibilities
Analyze business requirements and translate them into scalable data architectures; Design and maintain end-to-end data pipelines covering ingestion, transformation, and enrichment; Develop distributed processing frameworks and real-time streaming architectures; Deploy and manage cloud data infrastructure using Infrastructure-as-Code; Implement CI/CD and monitoring workflows for data reliability.
Seniority
Senior, hands-on IC
