Lead Data Engineer - Spark/Scala
Core
Designing data architectures, developing data extraction strategies, and optimizing data ingestion pipelines for large organizations.
Role type
Lead Data Engineer (Big Data)
Builds
Data architectures, extraction strategies, and ingestion pipelines
Domain
Big Data / Cloud / Data Engineering
Deliverable
production ML models | infrastructure
Required skills
Spark, Scala, Hadoop, HDFS, MapReduce, Hive, Kafka, technical leadership, code quality assurance
Preferred skills
Experience leading development teams, mentoring engineers
Technologies
Spark, Scala, Hadoop, HDFS, MapReduce, Hive, Kafka
Responsibilities
Participate in data architecture design workshops, develop data extraction strategies, optimize data ingestion flows, coordinate developer activities, act as technical reference for code quality and architecture, drive continuous improvement processes
Seniority
Senior, hands-on IC with leadership responsibilities
