Data Engineer, WWASFT
Core
Design, implement, and support scalable data infrastructure solutions to integrate heterogeneous data sources, aggregate and retrieve data for reporting, analysis, and machine learning models.
Role type
Senior IC data engineer (AWS big data)
Builds
Scalable data pipelines, data warehouses, and data sets for business reporting and ML
Domain
Retail/Fintech, AWS big data
Deliverable
production ML models | product features | dashboards & analysis
Required skills
SQL, Python, data modeling, warehousing, ETL pipeline design, distributed systems, data extraction, data ingestion, data processing, code debugging, version control, code review
Preferred skills
AWS Redshift, AWS S3, AWS Glue, AWS EMR, AWS Kinesis, AWS FireHose, AWS Lambda, AWS IAM, non-relational databases, end-to-end project delivery
Technologies
AWS (Redshift, S3, Glue, EMR, Kinesis, FireHose, Lambda, IAM), SQL, Python, Scala
Responsibilities
Design and develop ETL pipelines from diverse data sources; oversee and improve production operations including optimization and release management; establish best practices for data integration solutions; collaborate with Product, Data Science, and BI teams to deliver data; read, write, and debug data processing and orchestration code.
Seniority
Mid-Senior, hands-on IC
