Senior Data Engineer
Core
Design, build, and operate the data platform supporting analytics, reports, data products, and machine learning models for the INSIDER Store.
Role type
Senior hands-on IC data engineer
Builds
Scalable data pipelines, ELT/ETL routines, and infrastructure for data warehouse and streaming
Domain
E-commerce / Fashion retail / Cloud data engineering
Deliverable
production ML models | product features | dashboards & analysis | infrastructure
Required skills
SQL, Python, GCP (BigQuery, Pub/Sub, Dataflow), data orchestration (Airflow/Composer), Infrastructure as Code (Terraform), CI/CD, data testing and observability
Preferred skills
dbt, semantic/metric layer, Kafka, Spark, Dataproc, Shopify APIs, MLOps, feature stores, cost optimization in BigQuery
Technologies
GCP, BigQuery, Pub/Sub, Dataflow, Airflow, Composer, Terraform, Git, Kafka, Spark, Dataproc, Shopify APIs
Responsibilities
Design and develop scalable data pipelines with focus on reliability and maintainability; Implement ELT/ETL routines with observability and secure reprocessing; Build integrations with external sources like Shopify and UseInsider; Ensure data quality and governance via automated tests and monitoring; Develop and maintain infrastructure as code and CI/CD pipelines; Optimize costs and performance in the Data Warehouse
Seniority
Senior, hands-on IC
