Senior AI Data Engineer
Core
Design, build, and optimize enterprise-scale data platforms and pipelines enabling scalable AI, machine learning, and Generative AI solutions.
Role type
Senior IC AI Data Engineer
Builds
Cloud-native data platforms, batch and real-time pipelines, feature stores, metadata services, and data APIs for AI/GenAI
Domain
Financial services / AI Infrastructure / Data Engineering
Deliverable
production ML models | infrastructure
Required skills
Python, SQL, Spark, distributed data processing, cloud-native architecture (AWS/Azure/GCP), data lakes/lakehouses, streaming technologies (Kafka/Kinesis), workflow orchestration (Airflow), vector databases, RAG, embeddings, MLOps, Infrastructure as Code
Preferred skills
Agentic AI, semantic search, automated testing, CI/CD
Technologies
Python, SQL, Spark, AWS, Azure, GCP, Kafka, Kinesis, Apache Airflow, Azure Data Factory, vector databases
Responsibilities
Design scalable cloud-native data platforms for enterprise AI; Lead development of robust batch and real-time pipelines for model training and inference; Build data architectures supporting LLMs, RAG, and embeddings; Develop reusable data products and feature stores; Ensure data quality through automated validation and observability; Optimize data processing performance and cost; Collaborate on production-ready datasets and model deployment; Implement data governance and security controls; Design resilient, fault-tolerant pipelines using event-driven architectures; Contribute to MLOps and AgenticOps capabilities.
Seniority
Senior, hands-on IC
