Data Engineer
Core
Build and own data pipelines for analytics and model training, specifically handling long-horizon agentic data at scale.
Role type
Senior Data Engineer (Agentic Data & ML Infrastructure)
Builds
Reliable internal analytics datasets and production data pipelines for model training
Domain
AI/ML Data Infrastructure, Agentic Systems
Deliverable
production ML models
Required skills
SQL, Python, Data Modeling, ETL/ELT, Workflow Orchestration, Cloud Storage, Streaming Processing, Data Quality
Preferred skills
Agentic/LLM-generated data processing, Model training pipelines, Large-scale interaction datasets, Data infrastructure background
Technologies
Airflow, Dagster, Prefect, Object Storage, Batch Compute, IAM
Responsibilities
Build and operate production data pipelines; Wrangle agentic data into structured datasets; Design and evolve schemas and storage formats; Debug pipeline failures and manage operations; Choose ETL/ELT approaches based on tradeoffs; Communicate data lineage and quality to stakeholders.
