Senior Data Platform Engineer
Core
Own day-to-day operation and monitoring of data platforms and pipelines to ensure stability, observability, and cost-efficiency.
Role type
Senior Data Platform Engineer (Operations)
Builds
Stable, observable, and cost-efficient data platforms and pipelines supporting data products.
Domain
Cloud data infrastructure and operations
Deliverable
infrastructure
Required skills
Data platform operations, data processing concepts (batch, scheduling, dependencies), Azure data services, SQL, version control, problem-solving, scripting/programming, automation, observability (monitoring, alerting, logging), incident handling, CI/CD practices, Kubernetes, event streaming platforms, infrastructure-as-code.
Preferred skills
Modern data stack (AWS, Snowflake, dbt, SQLMesh), Git/GitHub, platform automation, building small tools/utilities.
Technologies
Azure, AWS, Snowflake, dbt, SQLMesh, Git, GitHub, Kubernetes, Kafka, Python, Bash, SQL, IaaC
Responsibilities
Operate and monitor data platforms (Azure and on-prem/legacy) for availability and performance; run and support data processing workflows including incident handling and troubleshooting; implement and improve observability for data platforms; drive continuous improvements in operations by simplifying tasks and automating recurring operational tasks; collaborate with data engineers to operationalize new data products; contribute to operational documentation and knowledge sharing.
Seniority
Senior, hands-on IC