Cloud Data Engineer
Core
Design, build, and evolve modern cloud data architectures, including scalable ETL/ELT pipelines and data lake/warehouse management for prestigious brands.
Role type
Cloud Data Engineer
Builds
Scalable ETL/ELT pipelines, Data Warehouse and Data Lake ecosystems, and data integration solutions for clients.
Domain
Cloud computing, Data Engineering, Data & AI
Deliverable
production ML models
Required skills
Google Cloud Platform (GCP), AWS, SQL, Python, Go, Node.js, C/C++, Apache Airflow, Cloud Composer, Git, CI/CD
Preferred skills
Generative AI, Large Language Models (LLM), Retrieval-Augmented Generation (RAG), Vector Database, LangChain, LlamaIndex, CrewAI, AutoGen, Terraform, Data security and encryption
Technologies
BigQuery, Cloud Storage, Cloud Dataflow, Cloud Pub/Sub, Cloud Composer, Amazon S3, AWS Glue, Amazon Athena, AWS Lambda, Amazon Redshift
Responsibilities
Design and develop scalable ETL/ELT pipelines on GCP and AWS; Implement batch and real-time streaming data processes; Manage and optimize Data Warehouse and Data Lake ecosystems; Collaborate with Data Science and AI teams to integrate ML models and support Generative AI solutions; Ensure data quality, security, and compliance throughout the data lifecycle; Automate deployment and operational processes using Infrastructure as Code and CI/CD pipelines.
Seniority
Mid-level (2-3 years experience)
