Senior Data Platform Engineer
Core
Designing, building, and evolving scalable data infrastructure, high-volume ingestion pipelines, and foundational data systems for analytics, product apps, and AI workloads.
Role type
Senior IC data platform engineer
Builds
Data lake, ingestion services, large-scale data pipelines, and core data infrastructure
Domain
Data engineering / Cloud infrastructure (via careerplan.io/jobs/86-003-86-B6E-senior-data-platform-engineer-at-orca-ai)
Deliverable
production ML models
Required skills
Python, SQL, Kubernetes, Terraform, Airflow or Prefect, Snowflake, distributed systems architecture, memory management, performance tuning
Preferred skills
KEDA, microservices architecture, CI/CD, system design
Technologies
Kubernetes, Terraform, KEDA, Airflow, Prefect, Snowflake
Responsibilities
Build complex high-volume batch and near-real-time ingestion services; Design and implement data solutions in a distributed microservices environment; Develop and optimize large-scale data pipelines for batch and streaming; Ensure data quality, compliance, and governance; Manage and optimize Kubernetes infrastructure with KEDA; Own the full lifecycle of the data stack using Terraform and Kubernetes; Provide technical guidance on infrastructure, CI/CD, testing, and system design; Deep-dive into memory management and performance tuning for distributed systems.
