Big Data Engineer - Technical Leader
Core
Lead the design and evolution of a Big Data system for a Finance client, ensuring scalability, maintainability, security, and reliability.
Role type
Senior Big Data Technical Leader
Builds
Scalable Big Data platforms and integration layers for Finance clients
Domain
Finance, Big Data, Distributed Computing
Deliverable
production ML models | product features | infrastructure
Required skills
Big Data project management, Cloudera/Databricks/AWS frameworks, streaming processing (Flink, Storm, Spark Streaming, Kafka), Java/Python/Scala, NoSQL databases (HBase, Cassandra, MongoDB), data architecture patterns, distributed computing concepts
Preferred skills
Machine Learning/Deep Learning fundamentals (clustering, classification, regression), batch processing (Spark, Athena, BigQuery, Hadoop, Hive), data storage (S3, GCS, HDFS), data wrangling, cleansing, exploration, featurization
Responsibilities
Manage Big Data projects and coordinate a dedicated development team, manage integration layers on the Big Data platform, define architectural standards and rules for system evolution, design and validate technical solutions
Seniority
Senior, hands-on IC with leadership responsibilities
