Sr. Big Data Engineer
Core
Design and implement end-to-end data warehouse, data lake, and lake house projects at petabyte scale.
Role type
Senior Big Data Engineer
Builds
Data pipelines, data warehouses, data lakes, and lake houses
Domain
Big Data, Data Engineering
Deliverable
production ML models
Required skills
Spark, Scala, Python, Java, Hadoop, SQL, Oracle, Netezza, NiFi
Responsibilities
Build and implement end-to-end data warehouse, data lake, and lake house projects; Design complex data pipelines using Spark with Scala, Python, or Java on Hadoop or object storage; Work with Oracle and Netezza databases; Debug production issues, determine root causes, and implement mitigation plans.
