Senior Software Engineer, Data Ingestion
Core
Design and develop highly scalable streaming and batch pipelines to ingest structured and unstructured datasets into Slack's Lakehouse, enabling production use cases for customers.
Role type
Senior Software Engineer, Data Ingestion
Builds
Slack's Lakehouse solutions and scalable data ingestion platform
Domain
SaaS / Data Engineering
Required skills
Streaming and Lakehouse technologies (Kafka, Flink, Spark, Iceberg, Hudi, Delta), Batch data pipelines (Spark, Airflow, EMR, S3), Distributed microservices (Kubernetes, Docker, AWS ECS/EKS, Terraform), Object-oriented and functional programming (SQL, Python, Java/Scala, Go)
Preferred skills
AI-assisted software development and automation (Claude Code/Codex)
Technologies
Kafka, Kafka Connect, Flink, Spark Streaming, Iceberg, Hudi, Delta, Spark, Airflow, EMR, S3, Kubernetes, Docker, AWS ECS, AWS EKS, Terraform, Grafana
Responsibilities
Design and implement Slack's Lakehouse solutions; Automate dataset lifecycle management (schema evolution, metadata, migration); Lead technical initiatives end-to-end; Mentor other engineers
Seniority
Senior, hands-on IC with mentorship
