Data Engineer
Core
Design, build, and maintain scalable data pipelines and platforms for security telemetry ingestion, AI/ML support, and enterprise security tooling integration.
Role type
Senior Data Engineer (Security & Cloud)
Builds
Group Security Data Platform, scalable data pipelines (batch/real-time), data models, and data products for analytics and detection.
Domain
Cyber Security Engineering, Cloud Infrastructure, Data Engineering
Deliverable
production ML models | product features | infrastructure
Required skills
AWS services (EC2, S3, Lambda, Athena, Kinesis, Redshift, Glue, EMR, DynamoDB, IAM, Step Functions, SQS, SNS, CloudWatch), Python framework development, PySpark/Spark, SQL, Terraform, Docker, Kubernetes, streaming data processing, event-driven architectures, data encryption (SSL/TLS, at rest/in transit), CI/CD, DevSecOps.
Preferred skills
Gen AI tools (Claude, GitHub Copilot, VS Code Co-pilot), complex automation engineering, distributed data processing.
Technologies
AWS, Python, PySpark, SQL, Terraform, Jenkins, Docker, Kubernetes, Kafka, Snowflake, DBT, ServiceNow SecOps.
Responsibilities
Drive development of scalable data solutions and pipelines; design and maintain data models and products; ensure data quality, reliability, and observability; integrate data solutions into enterprise platforms; contribute to DevOps practices including infrastructure-as-code; own and develop technical strategy for medium to complex engineering initiatives.
Seniority
Senior, hands-on IC with strategic ownership