Staff Software Engineer - Data Platform
Core
Design, architect, and develop a unified data platform providing common storage, ingestion, processing, and query layers for the Harness ecosystem, enabling real-time/batch processing and semantic data modeling for AI initiatives.
Role type
Staff Software Engineer - Data Platform
Builds
Unified Data Platform (UDP) supporting core Harness AI initiatives like Knowledge Graph and AI-powered dashboarding
Domain
SaaS / AI Software Delivery / Data Infrastructure
Deliverable
production ML models | product features | infrastructure
Required skills
Backend engineering, low-latency/high-concurrency microservices, JVM-based languages (Java/Scala/Kotlin), Data Platform technologies (Kafka, Spark, Iceberg, Trino/StarRocks, Pinot/Druid), OLAP modeling
Preferred skills
Deep exposure to specific data platform technologies mentioned, infrastructure automation (Helm, Terraform)
Technologies
Kafka, Apache Spark, Helm, Terraform, Trino, StarRocks, Pinot, Druid, Iceberg, Java, Scala, Kotlin
Responsibilities
Design architecture and development of the data platform, mentor senior/junior engineers via peer reviews and debugging, author high/low level design documents, implement infrastructure automation, diagnose production performance issues
Seniority
Staff, hands-on IC with mentorship
