Senior Solution Architect- Spark & Databricks Expert
Core
Lead complex customer engagements as a trusted advisor, bridging hands-on data engineering with strategic technical leadership to build and implement scalable Spark/Databricks solutions.
Role type
Senior Solution Architect (Data Engineering & Lakehouse)
Builds
Large-scale Spark/Databricks workloads, PoCs, and workshops for enterprise customers
Domain
Data Engineering, Lakehouse Architecture, Cloud Infrastructure
Deliverable
production ML models | product features
Required skills
Apache Spark internals, PySpark, Databricks SQL performance tuning, Delta Lake, Structured Streaming, cloud infrastructure, job optimization, debugging, workload governance, solution architecture, customer leadership, technical advocacy, mentorship
Preferred skills
Databricks Certified Data Engineer Professional, Delta Live Tables (DLT), Unity Catalog (UC), large-scale data migration, AI-assisted analytics
Technologies
Apache Spark, Databricks, Delta Lake, Structured Streaming, Delta Live Tables, Unity Catalog, DBSQL
Responsibilities
Lead engagements from discovery to delivery with full ownership; Architect, implement, and optimize large-scale Spark/Databricks workloads; Troubleshoot and tune distributed data jobs and SQL workloads; Design and execute PoCs and workshops; Act as a technical advocate for customers; Collaborate with product and engineering teams; Champion best practices and mentor junior engineers