Data Engineer, Staff
Core
Design, build, and operate a modern, scalable data platform using Databricks Lakehouse as a core foundation, focusing on reusable frameworks, shared components, and standardized pipelines for analytics, reporting, and AI/ML use cases.
Role type
Staff Data Engineer (Platform & Frameworks)
Builds
Scalable batch and streaming data pipelines, reusable data engineering frameworks, libraries, and templates for ingestion, transformation, validation, and publishing.
Domain
Information Technology / Data Engineering / Cloud Platforms
Deliverable
production ML models
Required skills
Python, SQL, NoSQL, Data Structures and algorithms, AWS (IAM, networking, multi-account), Databricks Lakehouse (Delta Lake, Unity Catalog), Data modeling, Schema evolution, Pipeline orchestration, AI-assisted automation, Data quality monitoring, Cost optimization, Security and governance.
Preferred skills
Data observability tools, Enterprise ingestion tools (Fivetran, HVR), Data lineage/metadata management, Secret management (Vault), Global distributed team experience.
Responsibilities
Design and maintain scalable data pipelines; Develop reusable frameworks and libraries; Implement AI-based automation for schema inference, data quality, and self-healing; Monitor SLIs/SLOs and participate in incident response; Drive adoption of standardized patterns and mentor junior engineers.
Seniority
Staff, hands-on IC with architectural ownership and mentorship.
