Senior Data Engineer
Core
Build and maintain feature pipelines for an enterprise feature store, delivering analytics-ready datasets and ensuring data quality for ML training and inference.
Role type
Senior IC data engineer (feature engineering & pipelines)
Builds
Reusable enterprise data pipelines and feature assets for ML operations
Domain
Cloud data engineering (AWS/Snowflake) for financial services (retirement, annuities, wealth, insurance)
Deliverable
production ML models
Required skills
Python, SQL, PySpark, AWS Glue, Snowflake, CI/CD, Feature Engineering, Data Quality, Root Cause Analysis
Preferred skills
AWS SageMaker, Model Lifecycle Management, Infrastructure as Code (AWS CDK), GenAI tools (GitHub Copilot)
Technologies
AWS (Glue, S3, Lambda, EventBridge, IAM, Athena, SageMaker), Snowflake (Snowpipe, Streams, Tasks, Stored Procedures, Snowpark), GitHub Actions, PySpark
Responsibilities
Design, build, test, deploy, and support end-to-end data pipelines; Apply feature engineering practices (encoding, scaling, imputation); Own data quality via automated tests, reconciliation, and monitoring; Document feature lineage and definitions; Collaborate with Data Scientists and MLOps to position data for training/inference; Leverage AI-powered engineering tools to improve efficiency.
Seniority
Senior, hands-on IC
