Senior Data Engineer, Data Platform
Core
Design, develop, and operate cloud-native data platforms and pipelines to enable data analytics for the organization and its customers.
Role type
Senior IC data engineer (cloud-native data platform)
Builds
High-volume data processing systems, micro-services, containers, and large-scale data pipelines
Domain
Cybersecurity / Network Intelligence / Cloud Infrastructure
Deliverable
production ML models
Required skills
Cloud services, distributed storage platforms, CI/CD pipelines, micro-services orchestration, container management, data pipeline orchestration
Preferred skills
IaC tools (AWS CloudFormation, Terraform), streaming platforms (Apache Kafka), data transformation platforms (Apache Spark, Apache Flink), data analytics and search engines (ElasticSearch, PrestoDB), systems monitoring, performance optimization
Technologies
AWS, Jenkins, GitHub Actions, Apache Kafka, Apache Spark, Apache Flink, ElasticSearch, PrestoDB, Terraform, CloudFormation
Responsibilities
Design and develop systems for processing high-volume data sets and streams; orchestrate micro-services, containers, and large-scale data pipelines; collaborate with specialists to improve operational quality; contribute to company-wide practices for secure service design and operation
Seniority
Senior, hands-on IC
