Senior Data Engineer (AI & LLM Solutions)
Core
Design, develop, and optimize enterprise-scale data platforms and pipelines to support analytics, machine learning, and Generative AI solutions including RAG and vector search.
Role type
Senior hands-on IC data engineer (AI & LLM)
Builds
Scalable data platforms, ETL/ELT pipelines, Lakehouse architectures, and AI-ready data foundations
Domain
Cloud data engineering, Generative AI, Microsoft Azure ecosystem
Deliverable
production ML models
Required skills
Microsoft Fabric, Azure Data Factory, Azure Synapse Analytics, Azure Databricks, Python, PySpark, SQL, RAG architecture, Vector search, Azure OpenAI, Data governance, Power BI
Preferred skills
Microsoft Fabric Analytics Engineer certification, Azure Data Engineer certification, Azure Data Scientist certification, Azure Solutions Architect certification, Databricks certification
Technologies
Microsoft Fabric, Azure Data Factory, Azure Synapse Analytics, Azure Data Lake Storage Gen2, Azure Databricks, Azure Event Hubs, PySpark, Spark SQL, KQL, SQL Server, PostgreSQL, MySQL, Microsoft Purview, Power BI, Azure DevOps, Git
Responsibilities
Design and develop enterprise-scale data solutions using Microsoft Fabric and Azure services; Build and optimize scalable ETL/ELT pipelines for structured and unstructured data; Develop data foundations that support AI, Machine Learning, and Generative AI solutions; Design and implement Retrieval-Augmented Generation (RAG) architectures and vector search solutions; Provide technical guidance and mentorship to junior and mid-level data engineers; Implement data governance and cataloging solutions using Microsoft Purview
Seniority
Senior, hands-on IC
