Lead Data Engineer
Core
Lead the design, build, and operation of reusable, cloud-native data capabilities on Google Cloud Platform (GCP) to power enterprise analytics and AI.
Role type
Lead Data Engineer (Cloud Infrastructure)
Builds
Reusable data frameworks, ingestion pipelines, transformation libraries, and orchestration tooling for GCP services.
Domain
Financial Services / Cloud Data Engineering
Deliverable
production ML models | product features | infrastructure
Required skills
Python, Java, Spark SQL, GCP services (BigQuery, Dataflow, Dataproc, Pub/Sub, Cloud Storage), Cloud Composer/Airflow, CI/CD, data modeling, data quality, IAM/security
Preferred skills
Logging/monitoring stacks, automated testing, cloud architecture principles, Agile transformations
Technologies
Google Cloud Platform, BigQuery, Dataflow, Apache Beam, Dataproc, Spark, Cloud Storage, Cloud Composer, Airflow, Python, Java, SQL
Responsibilities
Design scalable data platform architectures, build opinionated ingestion frameworks, develop shared transformation libraries, implement data modeling and semantic layers, enforce security and governance controls, partner with domain teams to onboard use cases, document patterns and best practices.
Seniority
Senior, hands-on IC with leadership responsibilities