Lead Data Engineer (Python, PySpark, AWS)
Core
Design, develop, test, implement, and support full-stack technical solutions and robust cloud-based data platforms to drive financial empowerment experiences for millions of customers.
Role type
Lead Data Engineer (Python, PySpark, AWS)
Builds
Cloud-based data solutions, distributed microservices, and real-time streaming applications
Domain
Financial Services / Big Data Engineering
Deliverable
production ML models | product features | infrastructure
Required skills
Python, SQL, PySpark, AWS, NoSQL databases, Cloud data warehousing, UNIX/Linux shell scripting, Agile engineering practices
Preferred skills
Java, Scala, Open Source RDBMS, Real-time data streaming, Interactive AI tooling
Technologies
Redshift, Snowflake, Kafka, Hadoop, Hive, EMR, Gurobi, Mongo, Cassandra, MySQL
Responsibilities
Collaborate with Agile teams to design and implement full-stack solutions; Mentor engineering community members; Perform unit tests and code reviews for performance tuning; Work with ML and distributed systems teams; Deliver cloud solutions for digital product managers
Seniority
Senior, hands-on IC with leadership responsibilities