Lead Data Engineer - Technology Data Product
Core
Design, build, and maintain enterprise data pipelines and cloud-native services on Google Cloud Platform to transform operational and business data into trusted insights.
Role type
Lead Data Engineer (Technology Data Product)
Builds
Scalable data pipelines, reusable data models, cloud-native services, and deployment automation on GCP.
Domain
Financial Services / Data Engineering
Deliverable
production ML models
Required skills
Advanced SQL, BigQuery, Python, Terraform, GitLab CI/CD, Dataform, Cloud Composer, API Integration, Data Quality Monitoring
Preferred skills
Docker, Cloud Run, Pub/Sub, Apache Beam, Developer Telemetry
Technologies
Google Cloud Platform, BigQuery, Cloud Composer, Dataform, Terraform, GitLab, Python, SQL, Docker, Cloud Run, Pub/Sub
Responsibilities
Design and build production batch and incremental data pipelines; Optimize BigQuery datasets and query performance; Implement automated transformation workflows and data quality checks; Create Terraform configurations and CI/CD pipelines; Build secure integrations with enterprise APIs; Configure pipeline monitoring and alerting; Partner with product owners to translate requirements into technical solutions; Maintain technical documentation and data lineage; Conduct code reviews and mentor team engineers.
Seniority
Senior, hands-on IC with leadership responsibilities