Data Engineer - (Public Sector)
Core
Design, build, and maintain data pipelines and systems to transform raw data into scalable solutions for government agencies.
Role type
Data Engineer
Builds
Data pipelines, data tables, views, marts, and backend APIs
Domain
Public Sector / Government IT
Deliverable
production ML models | product features | infrastructure
Required skills
SQL, Python, ETL pipeline tools, database design, big data frameworks, system design, web scraping
Preferred skills
Cloud platforms (AWS/Azure/GCP), data modeling, REST APIs, data governance
Technologies
SSIS, AWS DMS, AWS Lambda, Glue, ECS, EventBridge, Spark, Kafka, RabbitMQ, Hadoop, PostgreSQL, MySQL, MongoDB, Cassandra, VoltDB, AWS S3, Athena, BeautifulSoup, Selenium, Node.js
Responsibilities
Design and deploy data tables and marts across warehouses and lakes; perform data extraction, cleaning, and transformation; build batch and real-time pipelines; integrate data silos; develop backend APIs; participate in code reviews and pair programming.
Seniority
Mid-level (3+ years experience)
