Data Engineer
Core
Design, build, test, optimize, and maintain scalable batch ETL and near-real-time data pipelines and architectures for machine learning and data science initiatives.
Role type
Data Engineer
Builds
Scalable data pipelines, data warehouses, operational data stores, and API integrations
Domain
Gaming industry, cloud data services, machine learning infrastructure
Deliverable
production ML models
Required skills
SQL, Python, data modeling, relational and NoSQL databases, event-driven architectures, Apache Airflow, Apache Spark, AWS services (S3, Athena, EC2, RedShift, EMR, EKS, RDS, Lambda)
Preferred skills
ML models understanding, containerization and orchestration (Docker/Kubernetes), gaming industry experience
Responsibilities
Design and develop scalable batch ETL and near-real-time data pipelines; ensure data quality, accuracy, and consistency; implement internal process improvements for data delivery and infrastructure scalability; build new API integrations to support data volume and complexity increases; communicate with data scientists, MLOps engineers, product owners, and BI analysts to understand business processes and system architecture
Seniority
Mid-level, hands-on IC