Data Platform Tech Lead
Core
Design, build, and maintain large-scale batch and streaming data pipelines, Data Lake/Lakehouse, and backend services exposing data platform capabilities.
Role type
Tech Lead (Data Platform & Backend Engineering)
Builds
Production-scale data pipelines, Data Lake/Lakehouse, REST APIs, and data platform infrastructure.
Domain
Data Engineering, Distributed Systems, Cloud Platforms
Required skills
Spark (tuning, partitioning, debugging), Python, Advanced SQL, Backend development (REST APIs, microservices), Database management (relational, analytical, NoSQL, streaming), Cloud platforms, CI/CD, Testing, Performance profiling, AI/LLM workflow integration.
Preferred skills
Databricks, Azure data services, Kafka/Flink, Delta Lake/Iceberg, Data governance, Cyber security background.
Technologies
Spark, Python, SQL, REST APIs, Microservices, Kafka, Flink, Delta Lake, Iceberg, Azure, Databricks, LLMs.
Responsibilities
Design and optimize large-scale data pipelines; Build and evolve Data Lake/Lakehouse architecture; Develop backend services and APIs; Implement data quality and observability; Automate platform improvements including AI-assisted workflows; Conduct design reviews and mentor team members.
Seniority
Senior, hands-on IC with leadership responsibilities