Principal Data Engineer - CoreAI
Core
Own and define end-to-end data and analytics architecture for CoreAI and Foundry platforms, designing large-scale, robust data pipelines and architectures supporting AI workloads.
Role type
Principal Data Engineer (AI/Analytics)
Builds
Scalable ETL/ELT workflows, data models, semantic layers, and trusted data sets for AI initiatives.
Domain
Cloud Data Engineering & AI Analytics
Deliverable
production ML models | infrastructure
Required skills
Architecting large-scale distributed data systems, Cloud environments (Azure), Data pipeline optimization, Data governance & security, SQL, PySpark, Azure Data Lake, Azure Synapse, Azure Data Explorer, Technical roadmap planning, Mentoring senior engineers
Preferred skills
Experience with highly regulated enterprise environments, Leading technical projects
Technologies
Azure, Spark, Synapse, SQL, PySpark, Azure Data Explorer
Responsibilities
Design and optimize large-scale data pipelines and architectures, Develop and extend scalable ETL/ELT workflows, Implement data validation protocols and governance best practices, Partner with data scientists and business leaders to translate needs into technical solutions, Mentor senior engineers and guide complex design decisions, Align data solutions with business goals through cross-functional collaboration
Seniority
Principal, strategy & mentorship