Aws Gcp Data Engineer Senior Consultant
Core
Design, develop, and optimize scalable cloud-based data platforms and pipelines on AWS and GCP.
Role type
Senior IC data engineer (multi-cloud)
Builds
Production data pipelines, ETL/ELT workflows, and data models
Domain
Cloud data engineering (AWS/GCP)
Deliverable
production ML models | product features
Required skills
AWS services (IAM, Lambda, S3, RDS, Redshift), GCP (BigQuery, performance optimization, cost management), DBT, Airflow, Advanced SQL, Python, Data modeling (Facts, Dimensions, SCDs), CI/CD, Terraform/CloudFormation, Data quality frameworks
Preferred skills
Cross-cloud data pipeline experience, Cloud security and IAM best practices
Technologies
AWS, GCP, BigQuery, DBT, Airflow, Terraform, CloudFormation
Responsibilities
Design and develop scalable data pipelines on AWS and GCP; Build and optimize ETL/ELT workflows; Develop and maintain DBT models and transformations; Implement Airflow workflows and scheduling solutions; Ensure data quality, governance, and security standards; Optimize BigQuery performance and cost management; Implement CI/CD practices for data engineering projects
Seniority
Senior, hands-on IC