Senior Data Engineer
Core
Design, develop, and maintain high-quality data pipelines and storage systems to drive platform delivery and solve sophisticated business problems for Prudential's financial data lakes.
Role type
Senior Data Engineer (Financial Services)
Builds
Data pipelines, data lakes, data warehouses, and analytics platforms (via careerplan.io/jobs/R-124740-1-senior-data-engineer-at-pru)
Domain
Financial Services / Data Engineering
Required skills
Python, SQL, Java, Scala, PySpark/Apache Spark, Shell scripting, AWS Redshift, Snowflake, Kafka, Kinesis, Airflow, Ansible, CloudFormation, Unit/Integration testing, DevOps automation
Preferred skills
Serverless data pipeline development (AWS Glue, Lambda, Step Functions), Architecture Patterns, Design Thinking
Technologies
AWS (Redshift, Snowflake, Glue, Lambda, Step Functions, Kinesis, Kafka, Airflow, CloudFormation, Ansible), Spark, Tableau, Power BI
Responsibilities
Build and optimize data pipelines and storage systems; Develop efficient, documented code adhering to standards; Conduct complex data analysis and prepare data for modeling; Collaborate on data acquisition, transformation, and quality processes; Write unit, integration, and functional automation tests; Coach others and embed learning in day-to-day work
Seniority
Senior, hands-on IC
