Data Engineer, Bureau of Data Technology & Strategy
Core
Design, build, and document scalable hybrid technology architecture using on-premise and cloud resources on Azure; migrate complex Python applications to cloud-native architecture; build automated data extraction, transfer, and load processes.
Role type
Senior Data Engineer (Cloud/Python)
Builds
Cloud-native data infrastructure, automated ETL pipelines, and hybrid technology architectures for public health analytics.
Domain
Public Health / Cloud Infrastructure
Deliverable
infrastructure
Required skills
Python, Azure, ETL platforms (Azure Data Factory, Airflow), Cloud-native architecture, Data modeling, Infrastructure configuration, Application migration, Open source technologies, Statistical/ML model deployment
Preferred skills
5+ years cloud-based data science, 5+ years Python, 3+ years Python web frameworks (FastAPI, Django, Flask), 3+ years ETL platforms
Technologies
Azure, Python, FastAPI, Django, Flask, Azure Data Factory, Airflow
Responsibilities
Provide data engineering and infrastructure configuration support for complex Python applications; Aid migration of complex Python applications from on-premise environments to Azure; Build and oversee automated data extraction, transfer, and load processes; Design, implement, test, deploy, update, and document statistical, machine learning, and deep learning models; Propose and implement improvements to data science infrastructure and processes.
Seniority
Senior, hands-on IC