Senior Data Engineer
Core
Architect high-performance data infrastructure and real-time pipelines enabling agentic AI to reason over complex enterprise environments.
Role type
Senior IC AI Data Engineer
Builds
Real-time data pipelines, ETL/ELT workflows, and reusable data frameworks for enterprise-scale AI systems
Domain
Enterprise technology, AI infrastructure, Cloud data engineering
Deliverable
production ML models | infrastructure
Required skills
Azure data services, SQL, Python, ETL/ELT design, Data modeling, PySpark, CI/CD implementation
Preferred skills
Java, REST APIs, Event Hubs, Azure Functions
Technologies
Azure Data Factory, Azure Databricks, Azure SQL Database, Azure Blob Storage, Azure Key Vault, Azure Monitor, Microsoft Entra ID, Apache Spark, PySpark
Responsibilities
Design and develop scalable data pipelines; Build and maintain ETL/ELT workflows; Implement data integration solutions; Ensure data quality, security, and governance; Optimize data processing performance; Develop reusable frameworks and standards; Monitor and troubleshoot pipelines; Support analytics and ML initiatives; Implement CI/CD pipelines
Seniority
Senior, hands-on IC