Data Engineer(P3)
Core
Designing, delivering, and supporting robust data solutions and services to enable the Department of Safeguards' strategic and operational goals, including managing on-premise data platforms.
Role type
Data Engineer (Solution Architect)
Builds
Data pipelines, data products, and services supporting efficient data processing, integration, and analysis for the Department of Safeguards.
Domain
Nuclear safeguards and international nuclear inspectorate
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Data architecture, ETL pipeline development, database development (SQL/NoSQL), data modeling, performance tuning, Python, SQL, Spark, Trino, Airflow, Iceberg, Kafka, S3, Elasticsearch
Preferred skills
On-premise data architecture management
Technologies
Spark, Trino, Airflow, Iceberg, Jupyter, dbt core, Kafka, S3, Elasticsearch, SQL Server, MongoDB, Opensearch
Responsibilities
Collaborate with stakeholders to design and implement data products using modern data lakehouse architecture; Design, build, and maintain data pipelines integrating large volumes of data; Maintain and monitor on-premise data architecture; Optimize data flows, database queries, and conduct performance tuning; Assess emerging data technologies and prototype approaches.
Seniority
Mid-Senior (5+ years experience)