Lead Data Engineer (Python, Spark, AWS)
Core
Design, develop, test, implement, and support full-stack technical solutions and robust cloud-based data platforms to drive financial empowerment experiences for millions of customers.
Role type
Lead Data Engineer (Python, Spark, AWS)
Builds
Cloud-based data solutions, distributed microservices, and real-time streaming applications
Domain
Financial Services / Big Data Engineering
Deliverable
production ML models | product features | infrastructure
Required skills
Python, SQL, Java, Scala, Spark, Hadoop, Kafka, Redshift, Snowflake, NoSQL (MongoDB, Cassandra), UNIX/Linux shell scripting, Agile practices
Preferred skills
Real-time data streaming, interactive AI tooling, mentoring, technology trend experimentation
Technologies
AWS, Redshift, Snowflake, Spark, Kafka, Hadoop, Hive, EMR, Gurobi, MySQL, MongoDB, Cassandra
Responsibilities
Collaborate with Agile teams to design and implement full-stack solutions; Work with developers on distributed microservices and full-stack systems; Perform unit tests and code reviews for performance tuning; Mentor engineering community members; Deliver cloud-based solutions with digital product managers.
Seniority
Lead, hands-on IC with mentorship responsibilities