Software Engineer - Data Platform (Hybrid, GBR)
Core
Build and operate a hyper-scale data lake to centralize Falcon platform data for analytics, machine learning, and threat hunting.
Role type
Senior Data Platform Engineer
Builds
Petabyte-scale data processing systems, storage, pipelines, and query frameworks for the Falcon security platform
Domain
Cybersecurity / Distributed Systems
Deliverable
production ML models | product features | infrastructure
Required skills
Distributed systems design, Data pipeline engineering, Java/Scala, Python, SQL/NoSQL databases, Linux administration, Test-driven development
Preferred skills
Go, Kubernetes, Jenkins, Parquet, Protocol Buffers/GRPC
Technologies
Apache Spark, Kafka, Flink, Iceberg, Delta Lake, Hive, Presto, Trino, Postgres, MySQL, Cassandra, DynamoDB
Responsibilities
Design and maintain data platforms processing petabytes of data, Develop scalable data pipelines and storage systems, Optimize service efficiency for internal and external customers, Research and implement new data query methods
Seniority
Senior, hands-on IC