DevOps and Data Engineer
Core
Build and maintain cloud infrastructure, CI/CD pipelines, and data processing tools to power Proofpoint's data pipelines and analytics capabilities.
Role type
DevOps and Data Engineer
Builds
Cloud infrastructure, CI/CD pipelines, data ingestion microservices, and ETL jobs for data lake analytics
Domain
Cybersecurity / Cloud Infrastructure / Data Engineering
Deliverable
production ML models | infrastructure
Required skills
AWS core services (S3, IAM, VPC, CloudWatch, Lambda, ECS/EKS), AWS data services (Glue, Athena), Infrastructure-as-Code (Terraform, AWS CDK), CI/CD (GitHub Actions, Jenkins), Container orchestration (Docker, ECS/EKS, Kubernetes), PySpark
Preferred skills
Data quality frameworks (Great Expectations, Deequ), Open table formats (Apache Iceberg, Delta Lake), Lakehouse patterns, Cybersecurity background
Technologies
AWS, Terraform, AWS CDK, GitHub Actions, Jenkins, Docker, ECS, EKS, Kubernetes, PySpark, S3, Glue, Athena, CloudWatch, Datadog
Responsibilities
Implement and maintain CI/CD pipelines for automated testing and deployment of AWS Glue ETL jobs; Build and manage cloud infrastructure on AWS using Infrastructure-as-Code; Own the observability stack for data pipelines; Manage container and compute infrastructure for data ingestion microservices; Build and maintain AWS Glue ETL jobs using PySpark
Seniority
Mid-level, hands-on IC
