Data Engineer - (Public Sector)
Core
Design, build, and maintain data pipelines and systems to transform raw data into insights for government agencies.
Role type
Data Engineer
Builds
Data tables, views, marts, and scalable batch/real-time pipelines
Domain
Public sector IT / Data Engineering
Deliverable
production ML models | product features | infrastructure
Required skills
SQL, Python, ETL pipeline tools, database design, big data frameworks, system design, web scraping
Preferred skills
Cloud platforms, data modeling, REST APIs, data governance
Technologies
AWS, Azure, Google Cloud, SSIS, AWS DMS, AWS Lambda, Glue, ECS, EventBridge, Spring, Hadoop, Spark, Kafka, RabbitMQ, PostgreSQL, MySQL, MongoDB, Cassandra, VoltDB, AWS S3, Athena, Postgres/GIS, BeautifulSoup, Selenium, PhantomJS, Node.js
Responsibilities
Design and deploy data tables/views/marts; perform data extraction, cleaning, transformation, and flow; build and maintain large-scale batch and real-time pipelines; integrate data silos; develop backend APIs and databases; participate in pair programming and code reviews.
Seniority
Mid-level, hands-on IC
