Senior Data Engineer
Core
Build robust, scalable data flows and advanced data modeling to enable analysis and data-driven decision-making for a large organization.
Role type
Senior Data Engineer (Consultant)
Builds
Scalable data pipelines, data warehousing solutions, and event-driven data handling on Google Cloud Platform.
Domain
Data Engineering, Cloud Infrastructure, Big Data
Deliverable
production ML models
Required skills
Jinja SQL, dbt, Terraform, Google Cloud Platform (GCP), BigQuery, Cloud Functions, Dataflow, Cloud Run, Cloud Build, GitHub CI/CD, Kafka, Data Warehousing, Data Modeling
Preferred skills
Python, Identity and Access Management (IAM), AI-assisted development tools
Technologies
GCP, BigQuery, dbt, Jinja SQL, Terraform, GitHub, Kafka
Responsibilities
Develop and maintain scalable data pipelines for collection, storage, and processing; Work with Jinja SQL and dbt for transformation and modeling; Develop and manage solutions in Google Cloud Platform; Work with Infrastructure as Code using Terraform; Develop and maintain CI/CD flows in GitHub; Work with event-driven data handling using Kafka; Optimize BigQuery and data pipelines for performance and scalability; Ensure data quality, performance, and availability; Drive best practices in code structure, documentation, and data modeling.
Seniority
Senior, hands-on IC