Data Engineer in St. Louis, MO
Core
Designing and building scalable data architectures, ETL pipelines, and data models to support application migration and cloud deployment for US federal government clients.
Role type
Data Engineer
Builds
Scalable data architectures, ETL pipelines, data models, and migration strategies for cloud environments.
Domain
US Federal Government / Cloud Data Engineering
Deliverable
production ML models | infrastructure
Required skills
Python, SQL, Spark, PySpark, Cloud-based ETL services, Data orchestration, Data quality processes
Preferred skills
Databricks, Palantir, Snowflake
Responsibilities
Design and develop scalable data architectures; Create data models and schemas; Develop and maintain robust data pipelines; Implement real-time and batch processing pipelines; Design and implement ETL processes; Develop scripts and workflows for data extraction, transformation, and loading; Develop and maintain data cleansing routines; Create monitoring systems to track data quality metrics; Collaborate with the migration team to plan and execute data migration strategies; Troubleshoot and resolve data-related issues during migration; Optimize data processing and storage for improved performance in cloud environments; Implement data security measures to protect sensitive information; Ensure compliance with data protection regulations; Develop and maintain data access controls and audit trails; Create and maintain comprehensive documentation for data architectures and processes.
Seniority
Mid-Senior level (5+ years experience)