Senior Cloud Data Engineer
Core
Lead the end-to-end migration of a large-scale financial data platform from Google Cloud Platform to AWS, building pipelines and architectures for petabytes of critical data.
Role type
Senior Cloud Data Engineer (Migration & Architecture)
Builds
Enterprise data migration pipelines, AWS data architecture (Redshift, Aurora, Glue, Kinesis), and production-grade dashboarding solutions.
Domain
Financial Services / Cloud Data Engineering
Deliverable
production ML models | product features | infrastructure
Required skills
Enterprise-scale data migration (OLAP/OLTP), schema conversion, ETL/ELT pipeline design, dimensional modeling, Change Data Capture (CDC), real-time replication, latency tuning, error handling and retry strategies, AWS data services (Redshift, Aurora, DMS, Glue, Kinesis, Lambda, S3), GCP services (BigQuery, Cloud Spanner, Dataflow, Pub/Sub), Infrastructure as Code (Terraform, CloudFormation), CI/CD automation.
Preferred skills
AWS or GCP professional certifications, experience with driver personalization engines, strong opinions on consistency models.
Technologies
AWS (Redshift, Aurora PostgreSQL, DMS, Glue, Kinesis, MSK, Lambda, S3, Lake Formation, QuickSight), GCP (BigQuery, Cloud Spanner, Dataflow, Pub/Sub, Cloud SQL), Terraform, CloudFormation, Grafana.
Responsibilities
Own end-to-end data migration execution including data mapping and lift-and-shift; design and implement synchronization pipelines with tight SLAs; implement target AWS data architecture; migrate historical and time-series data at scale; build observability frameworks for data fidelity; mentor peers and elevate team technical standards; partner with stakeholders on data governance and analytics requirements.
Seniority
Senior, hands-on IC with mentorship responsibilities.