Data Engineer – Cloud & AI Solutions
Core
Design, build, and evolve modern data architectures in cloud environments, creating scalable ETL/ELT pipelines and integrating ML/GenAI models for prestigious brands.
Role type
Mid-level Data Engineer (Cloud & AI)
Builds
Scalable data pipelines, Data Warehouses, Data Lakes, and Lakehouse platforms on GCP and AWS.
Domain
Cloud Data Engineering, Generative AI, Multi-cloud Infrastructure
Deliverable
production ML models
Required skills
SQL, Python, Cloud Dataflow, Amazon Redshift, Apache Airflow, Git, CI/CD
Preferred skills
Databricks, Apache Spark, LangChain, Terraform, Vector Database
Technologies
Google Cloud Platform (GCP), AWS, BigQuery, Amazon S3, Amazon Athena, Databricks, Apache Airflow, LangChain, LlamaIndex, CrewAI, AutoGen
Responsibilities
Design and develop scalable ETL/ELT pipelines on GCP and AWS; Implement batch and real-time data processing; Manage and optimize Data Warehouse, Data Lake, and Lakehouse ecosystems; Collaborate with Data Science teams to integrate ML and Generative AI models; Automate deployment and operational processes via Infrastructure as Code; Ensure data quality, security, and compliance throughout the data lifecycle.
Seniority
Mid-level, hands-on IC