Senior Data Engineer
Core
Architecting and managing scalable data infrastructure to power AI and machine learning applications, including model training, feature engineering, and real-time inference.
Role type
Senior IC data engineer (AI/ML infrastructure)
Builds
Scalable data pipelines, feature stores, vector databases, and real-time streaming solutions for AI workloads
Domain
Gaming industry + AI/ML data engineering
Deliverable
production ML models
Required skills
Python, SQL, Terraform, Docker, Kubernetes, Airflow, Prefect, Spark, Dask, DBT, Vector/Graph databases (Neo4j), distributed computing, data mesh architectures
Preferred skills
Experience with Data Lake/Lake House architectures, network engineering
Technologies
AWS, Azure, Google Cloud Platform, Neo4j, Airflow, Prefect, Spark, Dask, DBT, Terraform, Docker, Kubernetes
Responsibilities
Lead design and development of robust data pipelines for AI/ML workloads; Design data architectures supporting AI model training including feature stores and vector databases; Develop high-performance pipelines processing structured, semi-structured, and unstructured data; Implement best practices for data quality, lineage, security, and compliance; Develop automated data workflows integrating with DevOps and MLOps frameworks; Optimize feature extraction and real-time inference pipelines with data scientists and AI/ML engineers.
Seniority
Senior, hands-on IC