AI Data Engineer
Core
Design, develop, and manage scalable data infrastructure powering AI, ML, and Generative AI applications.
Role type
Senior AI Data Engineer
Builds
Scalable ETL/ELT pipelines, data lakes/warehouses/lakehouses, and data platforms for model training and inference
Domain
Artificial Intelligence, Machine Learning, Generative AI, Cloud Data Engineering
Deliverable
production ML models
Required skills
Python, SQL, Apache Spark, Kafka, Airflow, AWS/Azure/GCP, Vector databases, RAG architectures, Data modeling, Docker, Kubernetes, CI/CD
Preferred skills
LangChain, LlamaIndex, MLOps, Feature stores, Databricks, Snowflake, Data observability
Technologies
Apache Spark, Kafka, Airflow, AWS, Azure, GCP, Snowflake, Databricks, Delta Lake, Docker, Kubernetes
Responsibilities
Design and maintain scalable ETL/ELT pipelines for structured and unstructured data; Build data infrastructure for ML and Generative AI model training and deployment; Implement data lakes, warehouses, and lakehouse architectures; Establish data quality checks, monitoring, and governance frameworks; Lead technical discussions and mentor junior engineers
Seniority
Senior, hands-on IC
