Data Engineer
Core
Building and maintaining data infrastructure, warehouses, and lakes for AI and ML-driven business solutions.
Role type
Data Engineer
Builds
Data warehouses, data lakes, and streaming data platforms
Domain
Big Data, AI/ML infrastructure
Deliverable
production ML models
Required skills
Spark, Python, Scala, SQL, Hadoop, Map/reduce, Docker, Kubernetes, CI/CD, functional programming
Preferred skills
BI Tools (Tableau, Metabase), sbt, pip
Technologies
Spark, Hadoop, Kubernetes, Jenkins, GitLab CI, Tableau, Metabase, Python, Scala