Data Integration Engineer
Core
Design and deliver scalable data integration solutions to connect systems, platforms, and business functions for Australian government and defense customers.
Role type
Data Integration Engineer
Builds
ETL/ELT pipelines, reusable integration frameworks, and secure data migration solutions for government agencies.
Domain
Government defense and national security (Australia)
Deliverable
production ML models | product features
Required skills
ETL/ELT development, SQL, relational databases, data warehouses, cloud platforms (Azure, AWS, GCP), API/web service integration, data transformation, data quality practices, Python, PySpark, Java, CI/CD pipelines, source control, encryption, privacy compliance
Preferred skills
Apache Spark, dbt, Kafka, real-time integration patterns, Infrastructure as Code, Power BI/Tableau, Agile/DevOps/ITIL
Technologies
Azure Data Factory, Databricks, Microsoft Fabric, Azure Synapse, AWS Glue, Informatica, Snowflake, SSIS, Talend, Redshift, BigQuery, JSON, XML, CSV, Parquet, Avro
Responsibilities
Design and optimize ETL/ELT pipelines across enterprise applications and cloud platforms; develop reusable integration frameworks and validation processes; support system implementations and data migrations; collaborate with stakeholders to translate requirements into technical outcomes.
Seniority
Mid-level to Senior, hands-on IC
