Data Engineer - Fixed Term Contract
Core
Design and build scalable data solutions on Azure to support livestock data analytics for government, industry, and farmers.
Role type
Senior Azure Data Engineer
Builds
Data pipelines, storage solutions, and data models for livestock data analytics
Domain
Agriculture / Data Engineering
Deliverable
production ML models | product features
Required skills
Python, SQL (T-SQL), Azure Data Factory, Azure Databricks, Azure Synapse, Azure Data Lake, data modeling, schema design
Preferred skills
Performance tuning, data quality testing, GDPR compliance, large-scale data analysis
Technologies
Azure Databricks, Azure Data Factory, Azure Synapse, Azure Data Lake, Azure DevOps, Python, T-SQL
Responsibilities
Design and implement Azure data storage solutions; build and maintain data pipelines for integration and processing; ensure data quality through testing and validation; optimize data processing performance; develop and maintain data models and schemas; collaborate with cross-functional teams for analytics and reporting; ensure data security and privacy compliance; work with large datasets for analysis.
Seniority
Mid-to-Senior, hands-on IC
