Data Engineer II
Core
Build and operate shared data, automation, and AI capabilities for the Msec Unified data platform, focusing on reliable pipelines, intelligent agents, and reusable services.
Role type
Senior IC Data & AI Automation Engineer
Builds
Production data pipelines, intelligent systems, APIs, and self-service interfaces for cost, spend, utilization, and operational data.
Domain
Cloud Data Engineering & Generative AI
Deliverable
production ML models | product features | infrastructure
Required skills
Python, SQL, Azure data services, API integration, CI/CD, data modeling, data quality, lineage monitoring, GenAI application development, RAG solutions, MCP integrations, incident management, workflow automation, data governance, responsible AI practices.
Preferred skills
FastAPI, Azure DevOps, Teams integrations, telemetry, secret management, RBAC, managed identity.
Technologies
Azure, Fabric, Kusto, Python, FastAPI, Azure DevOps, MCP
Responsibilities
Develop batch and near-real-time data pipelines; build copilots and agents grounded in governed data; automate operational workflows and replace spreadsheet-dependent processes; implement telemetry, health dashboards, and anomaly detection; investigate incidents and drive root-cause remediation; translate business needs into scalable technical designs.
Seniority
Mid-Senior, hands-on IC
