Sr. Software Engineer - Data Query Platform - London (Hybrid)
Core
Building and operating ultra-high-scale data platforms and pipelines to centralize security event data for threat hunting, analytics, and machine learning.
Role type
Senior Software Engineer (Data Platform)
Builds
Hyper-scale data lake, scalable data pipelines, and query frameworks for the Falcon security platform.
Domain
Cybersecurity, Big Data, Distributed Systems
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Java, Scala, Kotlin, Apache Spark, Flink, distributed systems design, algorithms, relational SQL, NoSQL databases, test-driven development, Linux administration
Preferred skills
Go, Pinot, Iceberg, Kubernetes, Jenkins, Parquet, Protocol Buffers, GRPC
Technologies
Java, Scala, Kotlin, Apache Spark, Flink, Iceberg, Postgres, MySQL, Cassandra, DynamoDB, Kubernetes, AWS
Responsibilities
Write fault-tolerant Java code within Apache Spark for platform products; Design and maintain ultra-high-scale data platforms processing petabytes of data; Participate in technical reviews and develop new features; Improve efficiency and reduce latency of high-performance services; Research and implement efficient data querying methods
Seniority
Senior, hands-on IC