CareerPlanSign in

Senior Data Engineer

San Francisco, United States of America💼 Full-time🗓 2026-01-27 → 2026-09-28

Core

Designing and implementing large-scale relational and medallion data architectures and production data pipelines for mission-critical information security capabilities.

Role type

Senior IC data engineer (distributed computing)

Builds

Data-intensive systems, data models, and pipelines supporting security services

Domain

Cybersecurity, distributed computing, big data

Deliverable

production ML models | product features

Required skills

Relational and medallion data architecture design, production data pipeline implementation at scale, JVM languages (Scala/Java), Apache Spark, Golang, Swift, data modeling, big data platforms, cloud compute environments (OpenStack, AWS, Azure), code reviews, technical documentation

Preferred skills

Data governance and compliance frameworks, data quality frameworks and validation techniques, knowledge engineering (semantic models, knowledge graphs), ML/AI workflows and feature engineering, mentoring engineers

Technologies

Apache Spark, OpenStack, AWS, Azure, Scala, Java, Golang, Swift

Responsibilities

Design and implement relational and medallion data architectures, build production data pipelines at scale, collaborate with engineering teams on security service delivery, optimize data models, conduct code reviews, contribute to technical best practices

Seniority

Senior, hands-on IC

Sourced via apple · Listed on CareerPlan, which tracks 877,000+ jobs from 20+ sources.