Business Data Insights Senior Specialist
Core
Design and build robust data pipelines and deploy machine learning and generative AI solutions using Azure cloud platforms to deliver production-ready AI features.
Role type
Senior IC Data & AI Engineer
Builds
Scalable data pipelines, ETL/ELT workflows, RAG pipelines, and operationalized ML/GenAI models
Domain
Cloud Data Engineering & Generative AI
Deliverable
production ML models
Required skills
Azure Data Factory, Azure Databricks (PySpark), Azure Data Lake, SQL, Python, Azure Machine Learning, Azure OpenAI, RAG pipelines, Vector databases, MLOps, CI/CD, Docker, Kubernetes
Preferred skills
Power BI, Informatica, SSIS, Teradata, Oracle, LangChain, Semantic Kernel, TensorFlow, PyTorch, scikit-learn
Technologies
Azure Data Lake, Azure Data Factory, Azure Databricks, Azure Machine Learning, Azure OpenAI, Azure AI Search, FAISS, Pinecone, PySpark, Spark SQL, LangChain, Semantic Kernel, Docker, Kubernetes, Git
Responsibilities
Design, develop, and maintain scalable data pipelines; Build automated ETL/ELT pipelines for analytics and AI; Design and fine-tune ML and generative AI models; Develop RAG pipelines integrating LLMs with enterprise data; Collaborate with stakeholders to translate requirements into technical solutions; Monitor and optimize pipeline and model performance in production
Seniority
Senior, hands-on IC