Lead Software Engineer - Python & Big Data
Core
Lead an AI-first transformation of data engineering and analytics, building autonomous agents and modernizing the data mesh for the Global Prime Brokerage team.
Role type
Senior IC Lead Software Engineer (Python & Big Data)
Builds
AI-driven data products, autonomous data engineering agents, and modernized data mesh platforms.
Domain
Financial Services / Big Data & AI
Required skills
Python, PySpark, Java, Spark, Databricks, Snowflake, Iceberg, CI/CD, containerization, ML pipelines, NLP, LLMs, agentic frameworks, data governance, lineage, data quality, SDLC
Preferred skills
Python, Java
Responsibilities
Define and enforce architecture for an AI-driven data product lifecycle; Build and run autonomous data engineering agents; Design analytics platforms for reporting; Establish monitoring and alerting for performance and reliability; Provide technical leadership and guidance to teammates; Drive adoption of enterprise-approved AI-assisted engineering practices; Lead migration from legacy analytics stacks to the strategic mesh ecosystem; Industrialize entity resolution with ML/LLM solutions.
Seniority
Senior, hands-on IC with leadership responsibilities
