Senior Data Engineer (Databricks)
Core
Build scalable data pipelines in Databricks to power real-time customer engagement and identity resolution for enterprise clients.
Role type
Senior Data Engineer (Databricks)
Builds
Scalable batch and near real-time data pipelines, unified customer profiles, and activation-ready audiences for CRM and marketing teams.
Domain
Digital Marketing, Customer Data Platforms (CDP), Martech
Deliverable
production ML models | product features
Required skills
Databricks (Spark, PySpark, Structured Streaming, Delta Lake), Python, SQL, Data Modeling, Identity Resolution, Data Governance, Cloud Platforms (AWS/Azure/GCP), CI/CD
Preferred skills
Databricks Certification, Streaming/CDC patterns, Delta Sharing, Reverse ETL, Consent Management Platforms, Analytics Tools (ThoughtSpot/Tableau)
Technologies
Databricks, Spark, PySpark, Delta Lake, mParticle, Braze, AWS, Azure, GCP, Git, ThoughtSpot
Responsibilities
Design and maintain scalable data pipelines integrating legacy and operational systems; Build unified customer profiles and support identity resolution; Develop automated data quality and governance frameworks; Troubleshoot pipeline issues and optimize infrastructure costs; Provide technical guidance through code reviews and mentoring.
Seniority
Senior, hands-on IC