Sr. Engineer - Data & ML Platform (Hybrid)
Core
Building a scalable ML Experimentation Platform from the ground up to support data preparation, feature engineering, model training, and serving for threat analytics and insights activation.
Role type
Senior Machine Learning Platform Engineer
Builds
Self-service ML experimentation pipelines and production ML infrastructure
Domain
Cybersecurity, Distributed Systems, Cloud Infrastructure
Deliverable
production ML models
Required skills
Distributed systems, Machine Learning concepts, Data platform engineering, Python, Kubernetes, Workflow orchestration, Infrastructure as code, CI/CD, Containerization
Preferred skills
Apache Spark, Flink, Iceberg, Go, Pinot, Jenkins, Parquet, Protocol Buffers, GRPC
Technologies
Kubernetes, GCP, Apache Spark, Flink, Iceberg, MLFlow, Ray, Vertex AI, Terraform, FluxCD, GitHub Actions, Jupyter Notebooks, NVidia Workbench
Responsibilities
Design and build scalable ML pipelines for data preparation and model serving; Modularize complex ML code into standardized components; Establish repeatable patterns for model deployment and monitoring; Leverage workflow orchestration for complex data and ML execution; Review code changes and champion software best practices; Utilize AI technologies to enhance decision-making and streamline workflows
Seniority
Senior, hands-on IC
