Data Engineer
Core
Build and maintain ETL pipelines to transform raw imagery and video from optical sensing platforms into clean, ML-ready datasets for the Machine Learning team.
Role type
Data Engineer (Imagery/Video)
Builds
Production ETL pipelines for large volumes of image and video data
Domain
Deep-tech, optics, autonomous systems, defence
Deliverable
production ML models
Required skills
ETL pipeline design, SQL, Python prototyping, unstructured/semi-structured data handling, data quality assessment, dataset labelling and balancing
Preferred skills
Computer vision pipelines, cloud data storage/processing (S3, BigQuery), OpenCV, data versioning, annotation tooling
Technologies
SQL, Python, Pandas, Matplotlib, S3, BigQuery, OpenCV
Responsibilities
Design and maintain ETL pipelines for imagery/video; conduct exploratory data analysis on dataset quality; clean and structure datasets for ML training; build prototype visualisations to surface data issues; optimise SQL queries for large datasets; collaborate with ML engineers on data requirements; document datasets and data quality processes
Seniority
Mid-level, hands-on IC
