Data Platform Engineer officer
Core
Design, build, and run core services and reusable components for an open-architecture data platform enabling scalable ingestion, metadata-driven processing, and reliable multi-engine data consumption.
Role type
Senior IC Data Platform Engineer
Builds
Streaming & batch ingestion frameworks, metadata-driven pipelines, API/consumption layer integrations, transformation engine, MDM engine, and platform observability.
Domain
Financial services data infrastructure
Required skills
Python, Java, Spark, SQL optimization, Snowflake, Databricks, Apache Iceberg, distributed computing, CI/CD, Kubernetes
Preferred skills
Rust, Kafka, cloud environments (AWS/GCP/Azure), data catalogs (Polaris/Horizon/Unity), data modeling
Technologies
Spark, Snowflake, Databricks, Apache Iceberg, Parquet, Polaris, Horizon, Unity Catalog, Trino, Kafka, Kubernetes, AWS, GCP, Azure
Responsibilities
Design and build backend services and shared libraries; Engineer reusable platform components aligned with open formats; Implement platform security controls; Build and maintain platform observability; Collaborate with architects to define scalable designs; Drive engineering excellence through code reviews and automated testing; Participate in on-call and major incident management.
Seniority
Senior, hands-on IC