Senior Data Engineer, AWS Infrastructure Supply Chain Automation
Core
Build and maintain serverless data lake and warehouse systems to drive multi-billion dollar business decisions with minimal human intervention.
Role type
Senior IC data engineer (AWS infrastructure)
Builds
Production data lake and warehouse infrastructure using 100% native AWS serverless components
Domain
Cloud infrastructure, data engineering, supply chain automation
Required skills
ETL pipeline development, data modeling, SQL, Python, Spark, AWS Glue, AWS Lambda, AWS S3, AWS Athena, AWS Redshift Spectrum, data security, data partitioning, data compression
Preferred skills
Big data technologies (Hadoop, Hive, EMR), operating large data warehouses
Responsibilities
Develop automated ETL pipelines with monitoring; Implement reporting and analytics infrastructure; Develop data security and permissions solutions; Develop data objects for business analytics; Optimize data warehouse and lake tables; Maintain data catalog and documentation; Collaborate with customers to gather requirements
Seniority
Senior, hands-on IC