Data Engineer
Core
Design, implement, and maintain scalable data pipelines, ETL processes, and APIs to ingest, catalog, normalize data, and ensure high data quality and availability for government agencies and commercial partners.
Role type
Senior Data Engineer (Cloud & Data Platform)
Builds
Scalable data-driven products, data pipelines, APIs, and central data catalogs
Domain
Government technology, cybersecurity, cloud data infrastructure
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Python, PySpark, SQL, AWS ETL tools (MSK, Firehose, SNS, Airflow), Data modeling, Data governance, Metadata management, Open table formats (Iceberg, Parquet), Big Data technologies (Hadoop, Spark), Cloud services (AWS, GCP)
Preferred skills
Data mesh principles, Domain ownership, Data product thinking, Federated governance, RBAC/ABAC models
Responsibilities
Design and maintain scalable data pipelines and ETL processes; Create and manage APIs for data access and integration; Lead data modelling efforts to support business goals; Configure and maintain central data catalogs and governance platforms; Implement best practices for data governance and regulatory compliance; Collaborate with cross-functional teams to build scalable data-driven products; Support data consumers in using approved data products
Seniority
Senior, hands-on IC
