Data Engineer
Core
Design and develop scalable cloud-based data pipelines to ingest, transform, and orchestrate enterprise data for analytics-ready datasets.
Role type
Senior GCP Data Engineer
Builds
Scalable data integration pipelines and analytics-ready datasets for reporting and advanced analytics
Domain
Retail / E-commerce / Cloud Data Engineering
Deliverable
production ML models | product features
Required skills
Google BigQuery, Python, SQL, DBT, Airflow/Cloud Composer, ETL/ELT pipeline architecture, Data quality frameworks, CI/CD workflows
Preferred skills
Ascend.io, Databricks, Fivetran, Dataflow, Data cataloging/governance tools, Real-time/event-driven processing (Pub/Sub, Kafka)
Technologies
Google BigQuery, Python, SQL, DBT, Airflow, Cloud Composer, Ascend.io, Databricks, Fivetran, Dataflow, Pub/Sub, Kafka
Responsibilities
Lead development of scalable data integration pipelines for structured and semi-structured data; Design and develop pipelines to ingest data from enterprise systems (ERP, CRM, E-commerce) into Google BigQuery; Implement transformation logic using DBT for modular data models; Automate and monitor complex data workflows using Airflow/Cloud Composer; Develop efficient Python and SQL code for ingestion, transformation, and performance tuning; Establish robust data quality checks and testing strategies; Mentor junior engineers and conduct peer code reviews
Seniority
Senior, hands-on IC with mentorship responsibilities