Data Platform Engineer
Core
Build production data pipelines and strengthen the data ecosystem using standards, quality controls, governance, and observability to enable product teams to deliver reliable data faster.
Role type
Senior Data Platform Engineer (DataOps)
Builds
Production data pipelines on Databricks + Unity Catalog + dbt
Domain
Retail technology / Data Engineering
Deliverable
production ML models
Required skills
SQL, Spark, Databricks (Jobs/Workflows, Delta), dbt, Unity Catalog, CI/CD, Observability, Containerization (Docker/K8s), Streaming (Kafka/Event Hubs), Orchestration (Airflow/Prefect/Dagster)
Preferred skills
Retail domain knowledge, Data Science collaboration
Technologies
Databricks, Unity Catalog, dbt, Delta Lake, Kubernetes, Airflow, Spark, SQL, Datadog, Kafka, Docker
Responsibilities
Migrate multi-technology architectures to Databricks + Unity Catalog + dbt; Implement robust, fault-tolerant data ingestion and processing systems; Deploy end-to-end observability and alerting to reduce MTTR; Manage datasets under Unity Catalog for governance and security; Pilot data contracts and SLOs; Create standardized code blocks and documentation to limit technical debt.
Seniority
Senior, hands-on IC