Lead Data Engineer
Core
Design and build enterprise-level scalable, low-latency, fault-tolerant data platforms and processing applications to provide meaningful insights for millions of Americans.
Role type
Lead Data Engineer
Builds
Next-generation data-driven governance controls, distributed data pipelines, and analytics data stores.
Domain
Financial services / Big Data Engineering
Deliverable
production ML models | product features | infrastructure
Required skills
Python, Java, Typescript, SQL, Scala, Databricks, Snowflake, Spark, Kafka, AWS Big Data Services, Redshift, CI/CD, Agile methodologies, unit testing, code reviews, performance tuning
Preferred skills
Real-time data and streaming applications, NoSQL implementation, data warehousing, UNIX/Linux shell scripting, distributed microservices
Technologies
Databricks, Snowflake, Spark, Kafka, AWS, Redshift, DynamoDB, OpenSearch, Flink, React
Responsibilities
Lead design and build of scalable data platforms; Build governance controls and analytics data stores; Lead a group of engineers building data pipelines; Influence best practices for data architecture; Collaborate with digital product managers to deliver cloud-based solutions; Perform unit tests and conduct code reviews.
Seniority
Senior, hands-on IC with leadership responsibilities
