Senior Software Engineer-Data
Core
Design, develop, and operate petabyte-scale data pipelines and AI-native agents that transform raw data into intelligence and drive business optimization.
Role type
Senior IC data engineering and AI agent development engineer
Builds
Production data pipelines, curated semantic data models, AI agents, and executive KPI dashboards
Domain
Enterprise data platforms, cloud data lakes, and generative AI
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Large-scale distributed data processing, semantic data modeling, SQL, Python/Scala, data governance, LLM orchestration, RAG, NL2SQL
Preferred skills
Azure AI Foundry, Copilot Studio, MCP-based integrations, fine-tuning workflows
Technologies
Spark, Databricks, Synapse, ADLS Gen2, Fabric OneLake
Responsibilities
Design system architecture for large-scale data platforms with focus on scalability and reliability; Transform staging data into canonical and curated data products; Instrument and analyze telemetry to surface anomalies and optimization opportunities; Develop AI-native agents that decompose natural-language questions and return insights; Partner with stakeholders to define and ship KPIs and persona dashboards; Build data governance frameworks including tagging, RBAC, lineage, and audit telemetry.
Seniority
Senior, hands-on IC