Senior Data Engineer
Core
Build and manage reliable data pipelines to aggregate, ingest, and process data from diverse source systems for analytical consumption and client solutions.
Role type
Senior Data Engineer
Builds
Data pipelines, data models, and tracking processes supporting entity resolution models
Domain
Financial services / Data Engineering
Deliverable
production ML models
Required skills
Python, SQL, Google Cloud Platform (GCP), Data Modeling, Version Control (Git), CI/CD integration
Preferred skills
Google BigQuery, BigTable, Dataflow, PySpark, Scala, JSON, AVRO, PARQUET, Entity Resolution concepts
Technologies
Python, SQL, GCP, BigQuery, BigTable, Dataflow, PySpark, Scala, Git
Responsibilities
Build and manage reliable data pipelines; Integrate, cleanse, and structure large datasets; Develop tracking processes to support data quality and entity resolution models; Leverage GCP technologies to propose optimization improvements; Implement data management, security, and maintenance best practices; Collaborate with regional and global teams to standardize workflows
Seniority
Senior, hands-on IC
