Senior/Lead GCP Data Engineer
Core
Design, build, and optimize scalable cloud-native data platforms and pipelines on Google Cloud Platform to support AI, machine learning, and advanced analytics products.
Role type
Senior/Lead GCP Data Engineer
Builds
Scalable data platforms, ingestion, transformation, and storage solutions for large-scale datasets used by AI/ML teams and business analytics.
Domain
Financial services / Cloud data engineering
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Python, SQL, PySpark, Airflow, Google Cloud Platform (BigQuery, Cloud Storage, Cloud Composer), relational and distributed database systems, software engineering best practices (testing, CI/CD, version control)
Preferred skills
Infrastructure provisioning and deployment automation, monitoring and observability (ELK Stack), MLOps architectures, large-scale data transformation, event-driven or streaming data architectures (Kafka, Pub/Sub, Dataflow), dbt
Technologies
Google Cloud Platform, PySpark, Airflow, BigQuery, Cloud Storage, Cloud Composer, ELK Stack, Kafka, Pub/Sub, Dataflow, dbt, Vertex AI, Dialogflow
Responsibilities
Design, develop, and maintain scalable cloud-native data pipelines; Build and optimize data ingestion, transformation, and storage solutions; Develop reliable data models supporting analytics, reporting, machine learning, and AI use cases; Collaborate with cross-functional teams to translate business requirements into technical solutions; Implement modern software engineering practices including automated testing and CI/CD; Monitor and improve platform reliability, observability, and performance; Support AI, machine learning, and MLOps initiatives by delivering trusted data assets
Seniority
Senior/Lead, hands-on IC
