Platform Data Engineer
Core
Building and operating an organization-wide data ingestion and connectivity layer (data lake) to support real-time fraud detection, anti-money laundering, and gambling addiction identification.
Role type
Senior Data Engineer (Platform)
Builds
Universal big data and AI platform, data ingestion pipelines (batch, streaming, CDC, event-driven, API), and data lake infrastructure.
Domain
Lottery/Gambling industry, Big Data, Cloud Infrastructure
Deliverable
production ML models | infrastructure
Required skills
Python, Apache Spark, SQL, NoSQL, Terraform, CI/CD, Cloud computing, Containerization, Data orchestration
Preferred skills
Experience with Delta Live Tables, dbt, Azure Databricks
Technologies
Azure Databricks, Delta Live Tables, Python, dbt, Terraform, SQL, NoSQL
Responsibilities
Write infrastructure-as-code and automate building, testing, and deploying within CI/CD pipelines; Develop and deliver high-quality data solutions solving specific business problems; Manage governance tooling, identity management, and connectivity; Lead design discussions and own a platform domain end-to-end.
Seniority
Senior, hands-on IC