Principal Data Platform Engineer
Core
Design and build greenfield, cloud-native data platforms, real-time pipelines, and data products for enterprise clients.
Role type
Principal Data Platform Engineer (hands-on IC)
Builds
Cloud-native data platforms, real-time pipelines, and data products
Domain
Data Engineering / Software Engineering / AI
Deliverable
production ML models | product features | infrastructure
Required skills
Python, SQL, Spark, Databricks, Snowflake, AWS, GCP, Kafka, Flink, Airflow, Terraform, dbt
Preferred skills
Data mesh architecture, data contracts, infrastructure-as-code, CI/CD, mentoring senior engineers
Technologies
Databricks, Snowflake, AWS, GCP, Kafka, Flink, Kinesis, Pub/Sub, Airflow, Dataflow, Glue, Spark, Postgres, BigQuery, Cassandra, MongoDB, Terraform, Pulumi, GitHub Actions, ArgoCD, dbt, Great Expectations, Soda
Responsibilities
Own end-to-end architecture of modern data platforms; Design scalable data ecosystems using data mesh and data products; Build and optimise batch and real-time pipelines; Process and transform large datasets; Implement secure, compliant data solutions; Work directly with clients to translate business needs into engineering decisions; Set engineering standards and mentor teams
Seniority
Principal, hands-on IC with technical direction and mentorship