Senior Data Platform Engineer
Core
Design and evolve enterprise-scale logging platform architecture, building high-throughput ingestion pipelines, and implementing security-focused observability solutions.
Role type
Senior Data Platform Engineer (Logging & Security Infrastructure)
Builds
Scalable logging infrastructure, data lakes, security lakes, and multi-tier storage strategies for petabyte-scale log data.
Domain
Legal Technology / Security / Big Data Engineering
Deliverable
production ML models | infrastructure
Required skills
Enterprise-scale logging architecture, Data lake design, Big data processing (Map Reduce, Hadoop, Cassandra), Data modeling (Kimball, Inmon, Data Vault), Streaming data (Apache Kafka, Kinesis, Event Hubs), Cloud storage (AWS S3, Azure Data Lake, GCS), Infrastructure as Code (Terraform, CloudFormation), Data pipeline engineering (Apache Spark, Flink), API design, Observability.
Preferred skills
Python/Go/Scala programming, Kubernetes, SIEM integration, Multi-cloud architecture, Data governance, Cost optimization, Technical leadership.
Responsibilities
Design scalable logging infrastructure including data lakes and multi-tier storage; Build and optimize high-throughput log ingestion pipelines; Architect ELK stack and OpenSearch deployments; Design data retention and lifecycle management strategies; Partner with security leads on platform roadmap; Build Infrastructure as Code for provisioning and disaster recovery; Optimize query performance and data partitioning; Design API layers for log data access; Mentor team members on logging best practices.
Seniority
Senior, hands-on IC with technical leadership