Data Engineer 4 (Manager, IC)-EDT
Core
Design, build, and deliver scalable cloud data solutions and platforms, influencing a team of developers and data scientists to drive a major transformation in Capital One's data technology.
Role type
Senior IC Data Engineer (Manager level)
Builds
Cloud-first data pipelines, platforms, and applications for Capital One's data lifecycle
Domain
Financial Services / Cloud Data Engineering
Required skills
Python, SQL, Spark, Databricks, Snowflake, distributed data systems, data pipeline design, data modeling, cloud data warehousing, data security
Preferred skills
Real-time/streaming data pipelines, data observability, data orchestration, NoSQL databases, Agile development, reusable data products
Technologies
Python, Spark, Databricks, Snowflake, AWS, Azure, Google Cloud, EMR, Glue, Airflow, Dagster, MongoDB, Cassandra, DynamoDB, Redshift
Responsibilities
Design and build data pipelines and platforms focusing on scalability and resilience; Architect and enforce common data engineering design patterns; Collaborate with product managers and software engineers to deliver cloud solutions; Mentor other members of the data community; Implement data security standards and compliance measures
Seniority
Senior, hands-on IC with management influence