Azure Data Engineer in St. Louis, MO
Core
Build data processing systems and pipelines integrating internal and external data sources to support reporting and analytics data products for US federal government clients.
Role type
Azure Data Engineer
Builds
Data processing systems, ETL pipelines, reusable components, and accessible data models
Domain
US Federal Government / Cloud Data Engineering
Deliverable
production ML models | product features
Required skills
Azure cloud native technologies, ETL pipeline development (Azure Data Factory, Event Hubs, Event Grid, Azure Functions), Databricks/Spark, CosmosDB, AzureSQL, Redis, Synapse, orchestration (Airflow/Oozie), Python or Java, SQL, streaming and batching solutions, complex data structures (CSV, JSON, XML), DevOps/CI/CD
Preferred skills
Cloud migrations, multi-cloud platform experience (Azure, AWS, GCP, VMware, Oracle Cloud)
Responsibilities
Create new pipelines and build reusable components at scale, write complex queries to transform raw data, clean and optimize data for integration, implement data management projects, restructure web architecture, solve complex data issues and perform root cause analysis, own the data pipeline and support systems failures
Seniority
Mid-level, hands-on IC
