Senior Data Engineer
Core
Design and develop scalable cloud-based data pipelines to ingest, transform, and orchestrate enterprise data for analytics-ready datasets.
Role type
Senior Data Engineer (ETL/ELT)
Builds
Scalable data integration pipelines and analytics-ready datasets for reporting and advanced analytics.
Domain
Retail & Entertainment / Cloud Data Engineering
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Google BigQuery, Python, SQL, DBT, Airflow/Cloud Composer, Data Warehousing, ETL/ELT Pipeline Development, Data Quality Frameworks, Query Optimization
Preferred skills
Ascend.io, Databricks, Fivetran, Dataflow, Data Cataloging/Governance, CI/CD, Git, Real-time Event Processing (Pub/Sub, Kafka)
Technologies
Google BigQuery, Python, SQL, DBT, Airflow, Cloud Composer, Ascend.io, Databricks, Fivetran, Dataflow, Collibra, Pub/Sub, Kafka
Responsibilities
Lead development of scalable, secure data integration pipelines; Design and develop pipelines to ingest structured/semi-structured data from enterprise systems; Build analytics-ready pipelines transforming raw data into curated datasets; Implement transformation logic using DBT; Apply BigQuery best practices for performance; Automate and monitor complex data workflows using Airflow; Develop efficient Python and SQL code; Establish robust data quality checks and testing strategies; Mentor junior engineers and conduct peer code reviews.
Seniority
Senior, hands-on IC with mentorship responsibilities