Data/AI Engineer
Core
Design and deliver next-generation data pipelines, BI solutions, AI/ML platforms, streaming APIs, and scalable microservices on Azure to power research and analytics products.
Role type
Senior Data Engineer (Lakehouse, Streaming, Microservices)
Builds
ETL pipelines, Lakehouse architectures (Delta Lake), Knowledge Graph models, SSE endpoints, and microservices on AKS
Domain
Healthcare research enablement, Cloud Data Engineering, Real-time Streaming
Deliverable
production ML models | product features | dashboards & analysis | infrastructure
Required skills
Azure Databricks, Delta Lake, Spark, Python, SQL, Azure Kubernetes Service (AKS), Docker, Kubernetes, Helm, Azure DevOps, Kafka, Redis, RabbitMQ, Async Python, SSE, Neo4j
Preferred skills
Fivetran, Power BI, MLflow, Generative AI, API Gateway (NGINX, Kong)
Responsibilities
Design and optimize Lakehouse architectures; Build and maintain ETL pipelines and data ingestion workflows; Develop scalable microservices and web APIs; Implement real-time streaming endpoints (SSE) and message broker integrations; Write comprehensive unit, integration, and load tests; Mentor junior engineers on best practices
Seniority
Senior, hands-on IC