Data Engineer
Core
Design and operate production data ingestion, transformation, and retrieval infrastructure for AI systems.
Role type
Senior Data Engineer (AI Infrastructure)
Builds
Ingestion pipelines, data warehouses/lakehouses, and retrieval layers for RAG systems.
Domain
AI Engineering / Data Infrastructure
Deliverable
production ML models | infrastructure
Required skills
Python, SQL, Spark, Kafka, dbt, Airflow, Snowflake, BigQuery, AWS, Azure, Docker, CI/CD, Terraform, pgvector, Pinecone, Qdrant
Preferred skills
Flink, Dagster, Prefect, Jupyter, HIPAA compliance, open-source contributions
Responsibilities
Build batch and streaming ingestion pipelines with schema evolution; design warehouse and lakehouse architectures; implement chunking and indexing for RAG systems; enforce data quality tests and lineage; manage PII classification and access controls; deploy containerized solutions on cloud platforms.
Seniority
Senior, hands-on IC
