Senior Solution Architect- Spark & Databricks Expert
Core
Lead complex customer engagements to design, implement, and optimize large-scale Apache Spark and Databricks workloads, acting as a trusted technical advisor.
Role type
Senior Solution Architect (Data Engineering & Analytics)
Builds
Large-scale data processing solutions, PoCs, and technical demonstrations for enterprise clients
Domain
Data Engineering, Cloud Infrastructure, Lakehouse Architecture
Deliverable
production ML models
Required skills
Apache Spark internals, PySpark development, Databricks SQL optimization, Delta Lake, Structured Streaming, Lakehouse architecture, Cloud infrastructure, Solution architecture, Customer engagement leadership, Technical mentoring
Preferred skills
Databricks Certified Data Engineer Professional, Delta Live Tables (DLT), Unity Catalog (UC), Large-scale data migration experience, AI-assisted analytics initiatives
Technologies
Apache Spark, Databricks, PySpark, Delta Lake, Structured Streaming, Delta Live Tables, Unity Catalog, Cloud Infrastructure
Responsibilities
Lead customer engagements from discovery through delivery; Design and optimize large-scale Spark/Databricks workloads; Troubleshoot and debug distributed data processing jobs; Develop and deliver PoCs and technical workshops; Act as a trusted technical advisor for business leaders; Drive technical decision-making for scalable data architectures; Mentor junior engineers and promote engineering best practices
Seniority
Senior, hands-on IC with strategic consulting