Senior Data Engineer
Core
Design, develop, and operate scalable data pipelines and modern data platform infrastructure for brokerage trading and digital investing platforms.
Role type
Senior IC data engineer (cloud & distributed systems)
Builds
High-performance batch and real-time streaming data pipelines, data models, and cloud data infrastructure
Domain
Financial services / Brokerage technology / Cloud data engineering
Required skills
SQL, Python, Google Cloud Dataproc, Apache Spark, Kubernetes, dbt, Terraform, CI/CD, Git, Cloud data warehousing (BigQuery, Dataflow, Pub/Sub)
Preferred skills
Financial services domain knowledge, Event-driven/streaming architectures (Kafka), Cloud certifications, AI-assisted developer tooling
Technologies
Google Cloud Platform (GCP), Kubernetes, dbt, Terraform, Apache Spark, Google Cloud Dataproc, BigQuery, Cloud Composer, Dataflow, Pub/Sub, MSSQL, PostgreSQL
Responsibilities
Lead technical design and optimization of scalable batch and real-time streaming data pipelines; Architect and maintain modular data models and transformation workflows using SQL and dbt; Build and scale high-throughput big data processing workloads on Google Cloud Dataproc and Apache Spark; Provision and manage resilient cloud data infrastructure using Terraform with CI/CD automation; Analyze and resolve production data anomalies and implement monitoring solutions; Ensure data quality, lineage, and regulatory compliance; Partner with cross-functional teams to deliver data products; Define engineering standards and mentor junior engineers
Seniority
Senior, hands-on IC