Senior Cybersecurity Data Engineer - AI/ML SME
Core
Design and maintain a centralized, cloud-native data lakehouse and AI/ML platform to unify security telemetry and enable real-time intelligence for threat hunters and data scientists.
Role type
Senior IC Cybersecurity Data Engineer (AI/ML SME)
Builds
A high-performance, scalable data ecosystem integrating ingestion, feature stores, vector databases, and API connectors for enterprise security applications.
Domain
Cybersecurity, Cloud Data Engineering, Machine Learning, Generative AI
Deliverable
production ML models | infrastructure
Required skills
AWS SageMaker, MLflow, Feature Stores (Feast), Vector Databases (Pinecone, Milvus, Qdrant), Apache Spark, Ray, Python, SQL, REST APIs, Webhooks, Kafka, MLOps automation
Preferred skills
Open-source LLM deployment, LangChain, LlamaIndex, Reverse-ETL tools (Census, Hightouch)
Technologies
AWS SageMaker, MLflow, Feast, Pinecone, Milvus, Qdrant, Pgvector, Apache Spark, AWS EMR, Ray, Dask, AWS Kinesis, Kafka, GitHub Actions, GitLab CI, Jenkins, Pandas, NumPy, Scikit-Learn
Responsibilities
Design and provision infrastructure for end-to-end machine learning lifecycles including distributed training and inference; Architect and manage the enterprise Feature Store to ensure low-latency feature delivery; Build and maintain vector databases and indexing pipelines for LLMs and RAG patterns; Design and secure high-throughput APIs and data connectors for external system integration; Establish CI/CD automation pipelines to transition data science notebooks to production workflows; Configure and optimize compute engines for heavy data science workloads.
Seniority
Senior, hands-on IC
