Principal Data Engineer (Cortex)
Core
Design, build, and maintain end-to-end data pipelines and platforms that serve as the backbone for cyber attack detection capabilities within the security research group.
Role type
Principal Data Engineer (Security Research)
Builds
Cloud-based data pipelines, data platforms, and frameworks for cyber attack detection.
Domain
Cybersecurity / Cloud Data Engineering
Deliverable
production ML models | infrastructure
Required skills
Cloud data pipeline architecture, distributed processing frameworks (Apache Beam, Spark), Cloud MPP databases (BigQuery, Redshift, Snowflake), Python, SQL, Docker, Kubernetes, GCP
Preferred skills
Data science background, Cyber security knowledge, GCP expertise
Technologies
Apache Beam, GKE, Spark, BigQuery, Redshift, Snowflake, Azure SQL DWH, Azure Kusto, Docker, Kubernetes
Responsibilities
Lead design and implementation of complex end-to-end data pipelines in cloud environments; Collect, analyze, and translate complex data requirements from stakeholders including data analysts, developers, and security researchers; Develop robust, scalable cloud-based data solutions using Python and distributed processing frameworks; Utilize AI in the development cycle for code generation, review, and testing; Model and manage data within cloud MPP databases and data lakes.
Seniority
Principal, hands-on IC with strategic leadership