Data Engineer, Specialist (PITech- Core - Middle Office Team 1)
Core
Building and maintaining scalable data pipelines to ensure seamless integration and efficient data flow across various platforms.
Role type
Senior IC data engineer (ETL & data architecture) (via careerplan.io/jobs/182646-data-engineer-specialist-pitech-core-middle-office-team-1-at-vanguard)
Builds
Scalable ETL processes, database systems, and unified datasets for analytics and business intelligence
Domain
Financial services (Wealth management, asset management, investments, banking)
Required skills
ETL process design, Database architecture, Cloud data platforms (AWS, GCP, Azure), Big data technologies (Spark, Delta Lake), Data orchestration (Airflow, Kafka), SQL/Python/Pandas, DevOps (Docker, Terraform), Medallion architecture
Preferred skills
AI tools (Claude Code, GitHub Copilot), Functional domain exposure in Wealth/Asset Management/Banking
Technologies
AWS (Redshift, Glue, S3, EMR, Lambda, Kinesis, Athena, Iceberg), Google Cloud (BigQuery, Dataflow), Azure (Synapse, Data Factory), Databricks, Airflow, Kafka, Docker, Terraform, GitHub Actions
Responsibilities
Design and maintain scalable ETL processes; Architect and manage database systems; Integrate data from APIs, on-premises databases, and cloud storage; Collaborate with analysts and data scientists; Monitor and optimize data pipelines; Develop automation frameworks; Work with cloud-based data platforms; Optimize storage and query performance; Lead special projects on data architecture and migration
Seniority
Mid-Senior, hands-on IC
