Contract Software Data Engineer - Chester - Inside IR35 - Investment Banking
Core
Build and enhance a strategic enterprise platform for ingesting, processing, and assuring large-scale communication, collaboration, and transactional data in a highly regulated financial environment.
Role type
Senior Data Platform Engineer (Compliance & Streaming)
Builds
Resilient enterprise-scale data pipelines, streaming ingestion solutions, and production-grade compliance and assurance controls.
Domain
Financial Services / Investment Banking / Regulatory Technology (RegTech)
Required skills
Python, PySpark, Apache Kafka, Apache NiFi, Hadoop ecosystem, Hive, Advanced SQL, REST API integration, Data modelling, Distributed systems engineering, CI/CD
Preferred skills
Microsoft Azure, Microsoft Graph, Entra ID, Grafana, Splunk, Tableau, Power BI, Java, AI-assisted development tools
Technologies
Apache Kafka, Apache NiFi, Apache Spark, PySpark, Hadoop, Hive, Microsoft Azure, Microsoft Graph, Entra ID
Responsibilities
Design and develop resilient enterprise-scale data pipelines; Build integrations across vendor APIs and streaming technologies; Engineer high-volume batch and near real-time processing solutions; Develop reusable ingestion and processing frameworks; Implement robust data handling patterns including replay and schema evolution; Translate regulatory requirements into deterministic control logic; Write clean, maintainable, and testable Python and PySpark code.
Seniority
Senior, hands-on IC