Senior Data Engineer
Core
Design, build, and maintain AWS Glue (PySpark) ETL pipelines and interactive Amazon QuickSight dashboards to drive operational and strategic decision-making.
Role type
Senior IC data engineer (BI & analytics)
Builds
Layered data lake architecture (raw → core → presentation) and interactive BI dashboards
Domain
Cloud data engineering and business intelligence
Required skills
AWS Glue (PySpark), AWS Step Functions, Python, SQL, Amazon QuickSight, Apache Iceberg, ETL pipeline design, data quality checks, REST API integration
Preferred skills
Infrastructure-as-code (AWS CDK, Terraform), CI/CD pipelines, PII detection/redaction, EventBridge/SQS/SNS patterns
Technologies
AWS Glue, PySpark, AWS Step Functions, Amazon S3, Amazon Athena, Amazon QuickSight, Apache Iceberg, EventBridge, SQS, SNS, Salesforce, JIRA, Zendesk, GitHub Actions, CodePipeline
Responsibilities
Design and optimize ETL jobs for data ingestion from SaaS platforms; orchestrate pipelines using Step Functions with error handling; build and maintain QuickSight dashboards and datasets; troubleshoot production pipeline failures and performance bottlenecks; implement incremental loading and schema evolution strategies; document technical components and collaborate on code reviews.
Seniority
Senior, hands-on IC
