Senior data platform engineer
Core
Senior Data Platform Engineer responsible for owning and operating the shared data infrastructure (Databricks, Kafka, Airflow, Elasticsearch, Kubernetes) for R&D teams, ensuring reliability, performance, and cost efficiency.
Role type
Senior hands-on IC data platform engineer (via careerplan.io/jobs/73-00B-D5-27E-senior-data-platform-engineer-at-lusha)
Builds
Large-scale batch and streaming data pipelines, data platform infrastructure, and AI/LLM tooling (MCP servers, agent interfaces)
Domain
Data Engineering / Cloud Infrastructure / AI Integration
Deliverable
production ML models | infrastructure
Required skills
Databricks (Unity Catalog, Delta Lake, Structured Streaming), Confluent Kafka, Apache Airflow, Python, SQL, AWS, Terraform, Kubernetes, Spark, Data Modeling
Preferred skills
Elasticsearch at scale, FinOps, Vault, CI/CD
Technologies
Databricks, Confluent, Kafka, Airflow, Elasticsearch, AWS, Kubernetes, Terraform, Docker, MCP, LLMs
Responsibilities
Administer and evolve core data platforms (Databricks, Kafka, Airflow, Elasticsearch); design and run large-scale batch and streaming pipelines; drive architecture decisions; build and integrate LLM/agent tooling into workflows; set engineering standards for testing and observability.
Seniority
Senior, hands-on IC