Engineer IV
Core
Build and maintain data pipelines bringing raw data into the Anaplan Lakehouse to power operational insights and decision-making.
Role type
Senior Data Infrastructure Engineer
Builds
Resilient data pipelines, CI/CD systems, and observability dashboards for the Anaplan Lakehouse
Domain
Data Infrastructure / Cloud Engineering
Deliverable
infrastructure
Required skills
Data pipeline architecture, CI/CD strategy, Kubernetes deployment, Apache Pulsar, Apache Flink, Databricks Lakehouse, Schema management, Automated testing, Observability stack (Prometheus, Grafana, ELK), Technical leadership
Preferred skills
Cloud platforms (AWS, GCP, Azure), Infrastructure as Code (Terraform), Cross-regional system design
Technologies
Pulsar, Flink, Databricks, Kubernetes, Terraform, Prometheus, Grafana, ELK, SQL, Pandas
Responsibilities
Own infrastructure for data ingestion into the Lakehouse; Lead CI/CD strategy for automated deployments; Monitor pipeline health via metrics and alerts; Partner with stakeholders to translate business needs into technical solutions; Investigate performance and scalability issues; Mentor engineers and lead cross-cutting projects
Seniority
Senior, hands-on IC with leadership responsibilities