Associate Director, Data Platforms — Technical Lead
Core
Lead the transition of existing data pipelines to a cloud-native lakehouse platform, ensuring reliability, observability, and secure data distribution for enterprise data products.
Role type
Senior IC data platform engineering lead (cloud & lakehouse)
Builds
Cloud-native data pipelines, reusable engineering patterns, and governed data lake assets on AWS
Domain
Financial data infrastructure, cloud data engineering, and data mastering
Deliverable
production ML models | product features | dashboards & analysis
Required skills
AWS cloud services (S3, Glue, Lambda, Kinesis, Lake Formation), Databricks (Delta Lake, Unity Catalog), data pipeline migration, data mastering/MDM, CI/CD, infrastructure automation, data quality & lineage, AI-assisted engineering
Preferred skills
Experience with investment/risk/market data workflows, LLM integration in engineering workflows
Technologies
AWS (S3, Glue, Lambda, Kinesis, Lake Formation, IAM, CodePipeline, CodeBuild), Databricks (Delta Lake, Unity Catalog), NeoXam DataHub, PySpark, SQL
Responsibilities
Partner with core teams to execute data pipeline transitions; define and operationalize asset-agnostic onboarding patterns; integrate pipelines with enterprise data mastering platforms; serve as senior technical lead for architecture reviews and code standards; drive engineering best practices including observability and incident response; collaborate with global teams to enforce governance and security controls.
Seniority
Senior, hands-on IC with strategic influence