Data Engineer - CLEARED
Core
Designing secure, scalable enterprise data solutions for modernizing a federal background investigation system via cloud migration.
Role type
Senior Data Engineer (Security Cleared)
Builds
Enterprise data lakes, lakehouse architectures, and high-performance ETL/ELT pipelines on AWS.
Domain
Federal government / Cloud Data Engineering
Deliverable
production ML models | product features | infrastructure
Required skills
AWS Glue, Apache Spark/PySpark, SQL, Python, PostgreSQL, Oracle, SQL Server, DynamoDB, AWS DMS, Amazon Redshift, Data Modeling, Dimensional Modeling, Data Lineage, Data Quality, Event-Driven Architectures, Schema Evolution, Metadata Management
Preferred skills
AWS Certified Data Engineer, AWS Certified Solutions Architect, Enterprise Data Lake/Lakehouse experience, Qlik, Real-time data integration
Technologies
AWS (S3, Glue, Redshift, Lambda, EventBridge, SQS/SNS, IAM, CloudWatch, Secrets Manager), Apache Spark, PySpark, SQL, Python, PostgreSQL, Oracle, SQL Server, DynamoDB, AWS DMS, Amazon Redshift, Qlik
Responsibilities
Design secure, scalable database architectures; Define data models and storage strategies; Develop and maintain scalable ETL/ELT pipelines; Implement Change Data Capture; Optimize SQL queries and Spark jobs; Establish data lineage and quality processes; Collaborate with developers and stakeholders to translate requirements into data solutions.
Seniority
Senior, hands-on IC
