Lead Software Engineer: Data Eng (Employee Plat.)
Core
Lead Data Engineer designing, building, and maintaining scalable data platforms and pipelines on AWS and Databricks.
Role type
Senior IC data engineering lead
Builds
Data platforms, pipelines, reusable Python/Scala libraries, and automation frameworks
Domain
Financial services data engineering
Deliverable
production ML models | product features | infrastructure
Required skills
Python, Databricks, Spark, AWS, system design, CI/CD, streaming architectures, technical leadership, mentoring
Preferred skills
AWS certification, Databricks certification, GenAI tool validation, event-driven ingestion
Technologies
AWS, Databricks, Spark, Python, Scala, GitHub Copilot, Claude Code
Responsibilities
Architect and deliver data platforms and pipelines across ingestion, transformation, curation, and consumption; build reusable libraries and automation; own operational excellence including data quality, monitoring, and incident triage; lead and mentor engineers; drive adoption of AI-assisted engineering practices with validation controls.
Seniority
Senior, hands-on IC with leadership responsibilities