Data Engineer Lead
Core
Lead the design, implementation, and delivery of large-scale data architecture, storage, and pipelines to power portfolio construction, investment research, and monitoring for a multi-asset fund of funds.
Role type
Senior hands-on IC Data Engineer Lead
Builds
Lakehouse architecture on Databricks and AWS, ingestion/transformation/serving pipelines, AI agent workflows and tool integrations
Domain
Financial Services / Data Engineering / AI Engineering
Deliverable
production ML models (via careerplan.io/jobs/JR7200-data-engineer-lead-at-capgroup)
Required skills
Python, SQL, distributed data processing, data modeling, data governance, CI/CD, AI agent direction, prompt engineering, security design
Preferred skills
N/A
Technologies
Databricks, AWS, PySpark, Delta Lake, Unity Catalog, Airflow, dbt, Terraform, Harness, Datadog, Deequ, Databricks Genie
Responsibilities
Set data engineering strategy and roadmap; design and build data pipelines; analyze datasets for business capabilities; own delivery of cross-team data initiatives; lead AI-first engineering practices; build reusable agent workflows; define testing strategies and data quality controls; partner with investment professionals on product vision; lead design/code reviews and mentor engineers
Seniority
Senior, hands-on IC
