Data Engineer IV
Core
Design, develop, and optimize scalable cloud-based data pipelines and integration solutions to enable enterprise analytics, reporting, and business intelligence for convenience retail and petroleum brands.
Role type
Senior IC data engineer (cloud data platforms)
Builds
Scalable data pipelines, data models, and integration solutions for enterprise analytics and BI
Domain
Retail and petroleum industry; Cloud data engineering
Deliverable
production ML models
Required skills
AWS (S3, Glue, Redshift, AppFlow, Lake Formation, Step Functions), SQL, Python, PySpark, Data modeling (dimensional, data lakehouse), Apache Iceberg, Parquet, ETL/ELT, Semantic layers, SaaS integration (Salesforce, NetSuite), Infrastructure as Code (Terraform), CI/CD, DevOps, Data governance
Preferred skills
AI/ML techniques for data engineering (automated quality checks, anomaly detection), Mentoring, Technical leadership
Technologies
AWS, PySpark, Terraform, Git, Azure DevOps, Salesforce, NetSuite, Apache Iceberg, Parquet
Responsibilities
Design and optimize cloud-based data pipelines; Lead complex data integration solutions; Design scalable data models and ingestion frameworks; Apply data architecture principles; Establish engineering standards and best practices; Partner with stakeholders to translate requirements; Drive automation and CI/CD; Troubleshoot platform issues; Mentor other engineers; Evaluate emerging technologies; Support data governance initiatives
Seniority
Senior, hands-on IC with mentorship responsibilities