Lead Data Engineer
Core
Design and build secure, scalable, cloud-native data platforms on AWS to ingest enterprise data and power analytics for Anti-Money Laundering (AML) controls using a medallion architecture.
Role type
Senior IC Lead Data Platform Engineer
Builds
AWS-based data platforms, data lake/warehouse integrations, and resilient batch/streaming pipelines for AML analytics.
Domain
Financial Services / Anti-Money Laundering (AML) / Cloud Data Engineering
Deliverable
production ML models | product features | infrastructure
Required skills
AWS platform depth (S3, Glue, EMR, EKS, RDS), Snowflake expertise (Streams, Tasks, Snowpark), Distributed processing (Spark), Data engineering architecture (medallion, SCD/CDC), Orchestration (Airflow), Infrastructure-as-Code (Terraform/CloudFormation), Reliability and security design, DevOps for data
Preferred skills
dbt proficiency, Observability practices, Security and privacy (OAuth2/OIDC, data masking), Regulated domains experience, AWS certifications, Data governance frameworks
Technologies
AWS (EKS, S3, RDS, EMR, Glue, Airflow), Snowflake, Spark, dbt, Terraform, CloudFormation
Responsibilities
Lead technical direction for the AML Data Foundation Hub; Design and build secure, scalable data platforms; Mentor and coach engineers; Engineer resilient ingestion patterns and orchestrate pipelines; Design for high availability, resiliency, and disaster recovery; Own CI/CD for data and platform components.
Seniority
Senior, hands-on IC with technical lead responsibilities