Data Engineer, AI Support
Core
Data Engineer supporting AI/ML research by building data pipelines, preparing datasets for training/evaluation, and ensuring data quality for language, vision, and multimodal systems.
Role type
Data Engineer (AI Support)
Builds
Reliable data workflows and datasets for AI/ML research and experimentation
Domain
Artificial Intelligence / Machine Learning / Data Engineering
Deliverable
production ML models
Required skills
Python (vectorized libraries), SQL, NoSQL, data modeling, ETL/pipeline development, data quality assurance, dataset versioning, metadata management, Linux/Bash scripting, CI/CD automation, distributed data processing concepts
Preferred skills
Cloud platforms (Azure/AWS/GCP), data orchestration (Airflow/Prefect/Dagster/Spark), data annotation platforms (Label Studio/Prodigy), experiment tracking (Weights & Biases/Langfuse), graph databases
Technologies
Python, SQL, NoSQL, Linux, Bash, GitHub Actions, GitLab CI, Terraform, Weights & Biases, Langfuse, Airflow, Prefect, Dagster, Spark, Azure, AWS, Google Cloud, Label Studio, Prodigy, W&B, Langfuse
Responsibilities
Prepare and organize data for research and ML projects; Build data workflows moving raw data to usable datasets; Identify data quality issues and structure data for AI applications; Automate data preparation tasks; Develop visualizations for dataset understanding; Integrate data across research tools and AI platforms; Protect sensitive information and follow data handling practices
Seniority
Mid-level, hands-on IC
