Principal Data Engineer
Core
Primary technical authority for Data Engineering and Data Platform architecture, designing innovative solutions on Snowflake and AWS to support the UK's small businesses with funding.
Role type
Principal Data Engineer (Data Platform & Architecture)
Builds
Scalable cloud data warehouse, lakehouse, streaming and analytics solutions on Snowflake and AWS.
Domain
FinTech / Cloud Data Engineering
Deliverable
production ML models
Required skills
Snowflake, AWS, Apache Iceberg, Amazon Redshift, S3, dbt, Apache Airflow, Terraform, GitHub Actions, AI tooling, data governance, data lineage, community of practice leadership
Preferred skills
Leading complex large-scale migrations from legacy systems, designing data products across source-aligned/aggregate/consumer-aligned patterns, automating infrastructure and deployment pipelines, implementing data observability, leveraging AI for data engineering workflows, establishing standards adoption across teams, cross-functional partnership, mentoring technical teams, architecting custom AI solutions
Technologies
Snowflake, AWS, Apache Iceberg, Amazon Redshift, S3, dbt, Apache Airflow, Terraform, GitHub Actions
Responsibilities
Own Data Platform strategy and execute multi-phased roadmap for migration to Future State Data Platform; Lead architecture, design and development of scalable cloud data solutions; Define ingestion, transformation, orchestration patterns and publication boundaries; Identify and resolve architectural bottlenecks and technical debt; Own Data as a Product Community of Practice and standards; Champion data quality, lineage, observability and governance; Work on data architecture decisions as a key member of the Data Architecture Review Board
Seniority
Principal, hands-on IC with strategic leadership