Data Engineer
Core
Develop, implement, test, and maintain data pipelines and data structures within a cloud-based data store and warehouse to support BI and Data Science initiatives.
Role type
Data Engineer
Builds
Real-time streaming data ingestion and processing pipelines, ETL/ELT pipelines, and data products for Home Services.
Domain
Retail / Data Engineering
Deliverable
production ML models | product features | infrastructure
Required skills
Python, SQL, BigQuery, Jenkins, dbt, Airflow/Kubeflow, data warehousing, dimensional modeling, Git, CI/CD
Preferred skills
Tableau, Agile methodologies, Jira, whiteboard design to code implementation
Technologies
Google Dataflow, Apache Beam, Jenkins, BigQuery, dbt, Airflow, Kubeflow, Git, Tableau
Responsibilities
Implement real-time streaming data ingestion and processing pipelines; Interface with BI analysts and IT to design and test pipelines; Maintain data architecture standards and ETL/ELT best practices; Participate in Scrum delivery process; Support solutions in production.
Seniority
Mid-level IC
