FBS Agile Dev Team Member III (Python / PySpark Developer)
Core
Design, build, test, deploy, and support scalable data pipelines and orchestration workflows using PySpark and Python.
Role type
Senior Data Engineer (ETL & Data Warehousing)
Builds
Data pipelines, orchestration workflows, and data platforms
Domain
Cloud Data Engineering (AWS) and Data Warehousing
Deliverable
production ML models
Required skills
PySpark, Python, SQL, AWS EMR Serverless, AWS Glue, AWS Step Functions, AWS EventBridge, Amazon S3, Apache Airflow, DB2, Snowflake, Amazon Athena, Informatica PowerCenter
Preferred skills
Metadata-driven ETL frameworks, large-scale ETL modernization, cloud migration, data quality, data governance, reconciliation processes
Technologies
AWS EMR Serverless, AWS Glue, AWS Step Functions, AWS EventBridge, Amazon S3, Apache Airflow, Snowflake, Amazon Athena, Informatica PowerCenter
Responsibilities
Establish common ETL patterns and scalable design standards, Build and support data pipelines and orchestration workflows, Collaborate with business stakeholders to translate requirements into technical solutions, Drive performance optimization and operational excellence across data platforms
Seniority
Senior, hands-on IC
