Specialist Solutions Architect - Data Engineering
Core
Guide strategic customers in designing, building, and optimizing production-grade data workloads on the Databricks Data Intelligence Platform using Apache Spark and modern streaming frameworks.
Role type
Specialist Solutions Architect (Data Engineering)
Builds
Production-grade batch and streaming pipelines, operational data layers (Lakebase), and interactive data applications on Databricks.
Domain
Data Engineering / Big Data / Cloud Data Platforms
Deliverable
production ML models
Required skills
Apache Spark, Delta Lake, real-time streaming (Kafka, CDC), Python, SQL, Scala/Java, system design, customer advisory, pre-sales/post-sales consulting
Preferred skills
Cloud platforms (AWS, Azure, GCP), legacy data lake modernization, operational/HTAP architectures, reverse ETL, technical community engagement, public speaking
Technologies
Databricks, Apache Spark, Delta Lake, Kafka, Genie Code, Cursor, Postgres
Responsibilities
Lead end-to-end technical design, proof of concepts (PoCs), and workload sizing for strategic customer engagements; Design, build, and optimize scalable, high-performance batch and streaming pipelines; Build and operationalize custom user-facing data applications using Databricks Apps; Leverage AI coding assistants and LLMs to rapidly prototype and deliver architectural assets; Mentor peers, contribute reusable architecture assets, and deliver technical workshops.
Seniority
Senior, hands-on IC with advisory responsibilities