Lead Data Engineer (Cloud Operations Resilience Engineering)
Core
Design, develop, test, and support full-stack technical solutions for Capital One's foundational cloud infrastructure layer, focusing on observability, connectivity, resilience, and availability.
Role type
Lead Data Engineer (Cloud Operations Resilience Engineering)
Builds
Robust cloud-based solutions and foundational cloud infrastructure services
Domain
Financial Services / Cloud Infrastructure / Data Engineering
Deliverable
production ML models | infrastructure
Required skills
Java, Scala, Python, SQL, NoSQL databases, Cloud data warehousing (Redshift, Snowflake), Big data technologies, Distributed data/computing tools, Real-time data streaming, UNIX/Linux shell scripting
Preferred skills
Experience with MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, MySQL, MongoDB, Cassandra, Agile engineering practices
Technologies
AWS, Microsoft Azure, Google Cloud, Redshift, Snowflake, Kafka, Spark, Hadoop, Hive, EMR, MongoDB, Cassandra
Responsibilities
Collaborate with Agile teams to design and implement full-stack solutions; Work with developers experienced in machine learning and distributed microservices; Mentor engineering community members; Perform unit tests and code reviews; Deliver cloud-based solutions for digital product managers
Seniority
Lead, hands-on IC with mentorship responsibilities