Data Engineer - AI Team
Core
Design, build, and operate scalable data pipelines and infrastructure to power AI models and agents in production for a cybersecurity analytics platform.
Role type
Senior IC data engineer (AI infrastructure)
Builds
Production-grade data layer, pipelines, and storage systems for AI applications
Domain
Cybersecurity / AI Infrastructure
Deliverable
production ML models
Required skills
Data pipeline design (batch + streaming), Data storage systems (data lakes, warehouses, graph, vector DBs), Data quality monitoring, Python, Go, Docker, Kubernetes, dbt, Spark, PostgreSQL, Neo4j, Trino, DuckDB, Temporal
Preferred skills
ML feature extraction pipelines, Security data (logs, telemetry), AWS cloud platforms, Collaboration with ML researchers
Technologies
DuckDB, dbt, Temporal, Trino, Spark, PostgreSQL, PGVector, Neo4j, Datadog, Python, Go, Docker, Kubernetes, AWS
Responsibilities
Design and operate scalable data pipelines for AI systems; Own the end-to-end data lifecycle from ingestion to serving; Ensure high data quality through monitoring and validation; Partner with AI engineers to translate model needs into data infrastructure; Define and evolve data strategy for AI applications
Seniority
Senior, hands-on IC
