Senior Data Engineer, Data Platform
Core
Design, develop, and operate cloud-native systems for processing high-volume data sets and streams to enable data analytics across the organization and customers.
Role type
Senior IC data engineer (cloud-native data platform)
Builds
High-volume data pipelines, micro-services, and containers on AWS
Domain
Cybersecurity / Network Intelligence / Cloud Infrastructure
Deliverable
production ML models
Required skills
Cloud services (AWS), Distributed storage platforms (Object Storage, SQL, NoSQL), CI/CD pipelines (Jenkins, GitHub Actions), Micro-services orchestration, Container management, Troubleshooting
Preferred skills
IaC tools (AWS CloudFormation, HashiCorp Terraform), Streaming platforms (Apache Kafka), Data transformation platforms (Apache Spark, Apache Flink), Data analytics and search engines (ElasticSearch, PrestoDB), Systems monitoring and performance optimization
Technologies
AWS, Jenkins, GitHub Actions, Apache Kafka, Apache Spark, Apache Flink, ElasticSearch, PrestoDB, Terraform, CloudFormation
Responsibilities
Design and develop systems for processing high-volume data sets and streams; Orchestrate micro-services, containers, and large-scale data pipelines; Work with specialists to improve operational quality; Contribute to company-wide practices for secure service design and operation
Seniority
Senior, hands-on IC
