Staff Software Engineer - Semantic Foundation
Core
Design, deploy, scale, and maintain highly available Apache Airflow clusters and data infrastructure for enterprise ETL/ELT workflows.
Role type
Staff Software Engineer (Data Platform Engineering)
Builds
Scalable data infrastructure, CI/CD pipelines, monitoring systems, and internal developer tools.
Domain
Cloud Data Engineering & DevOps
Deliverable
production ML models | infrastructure
Required skills
Apache Airflow, Kubernetes, Terraform, Helm, ArgoCD, GitHub Actions, AWS (EKS, EC2, S3, VPC, IAM), Azure, Docker, Spark, Snowflake, Azure Synapse, Apache Kafka, dbt, Grafana, Prometheus, Loki, DataHub, Python, Bash, Go, SQL
Preferred skills
Cloud cost-optimization, data cataloging/metadata platforms, engineering standards definition, roadmap planning, mentorship
Technologies
Apache Airflow, Terraform, Helm, ArgoCD, GitHub Actions, Kubernetes, EKS, AKS, Docker, AWS, Azure, Spark, EMR, Snowflake, Azure Synapse, Kafka, dbt, Grafana, Prometheus, Loki, DataHub
Responsibilities
Architect and manage CI/CD pipelines for data pipelines and infrastructure; Build monitoring, logging, and alerting systems; Monitor and optimize cloud and compute infrastructure costs; Define engineering standards for code quality, testing, and access controls; Partner on data platform roadmap and mentor engineers.
Seniority
Staff, hands-on IC with strategic ownership