Data Tool Stack Engineer
Core
Design, implement, and maintain on-premises and hybrid data tool stacks with a focus on Kubernetes-based environments, building scalable data ingestion, streaming, and integration solutions.
Role type
Senior IC data platform engineer (Kubernetes/DevOps)
Builds
Modern data ingestion, streaming, and integration solutions; scalable data platforms; automated CI/CD pipelines.
Domain
Data Engineering / Cloud Infrastructure / DevOps
Required skills
Python, SQL, Kubernetes, Helm, CI/CD, ETL/ELT, Apache Airflow, dbt, PySpark, Kafka, MQTT, Debezium, Trino/Starburst, Grafana, Elasticsearch, OpenSearch, Networking (Nginx, VNets)
Preferred skills
Microsoft Azure, Databricks, Terraform, Infrastructure-as-Code, hybrid cloud architectures, AI agents in DevOps
Technologies
Kubernetes, Helm, Kafka, MQTT, Debezium, PySpark, Apache Airflow, dbt, Trino, Starburst, Grafana, Elasticsearch, OpenSearch, Nginx, Azure, Databricks, Terraform
Responsibilities
Design and maintain on-premises and hybrid data tool stacks; build and operate scalable data ingestion and messaging solutions; develop and orchestrate ETL/ELT pipelines; establish and improve CI/CD pipelines; integrate distributed query engines; design networking and connectivity concepts; implement observability and logging solutions.
Seniority
Senior, hands-on IC