Data Engineer Consultant
Core
Design, develop, and maintain scalable data pipelines and data products supporting critical business and operational needs in the Defence domain.
Role type
Senior Data Engineer
Builds
Cloud-based data platform solutions, scalable data pipelines, and data products
Domain
Defence / Cloud Data Engineering
Deliverable
production ML models | product features | infrastructure
Required skills
Python, PySpark, ETL development, data modeling, Databricks, Delta Tables, Parquet, S3 architecture, Apache Airflow, cloud platforms (AWS/Azure/GCP), data quality frameworks
Preferred skills
Agile methodologies
Technologies
Databricks, Apache Airflow, AWS, Azure, GCP, Delta Tables, Parquet, S3
Responsibilities
Design and build robust ETL pipelines, Develop scalable data products and architectures, Work with modern Lakehouse and Medallion architectures, Ensure data quality, testing, and reliability, Collaborate within agile cross-functional teams, Contribute to cloud-based data platform solutions
Seniority
Senior, hands-on IC
