Software Engineer III
Core
Design and build end-to-end ETL/ELT pipelines on Databricks using PySpark and SQL, develop AWS data workflows, and build secure platform controls.
Role type
Senior IC data engineering software engineer
Builds
ETL/ELT pipelines, AWS data workflows, REST APIs, secure data-access controls
Domain
Cloud data engineering (AWS, Databricks)
Deliverable
production ML models
Required skills
PySpark, SQL, AWS Lambda, AWS Step Functions, AWS SQS, AWS SNS, AWS API Gateway, AWS Secrets Manager, Terraform, Apache Airflow, Apache NiFi, Autosys, FastAPI, Python, object-oriented programming
Preferred skills
Jenkins, Jira, Git, Spinnaker, pytest, unittest, statistical data analysis, full data lifecycle familiarity
Technologies
Databricks, PySpark, SQL, AWS, Lambda, Step Functions, SQS, SNS, API Gateway, Secrets Manager, Terraform, Apache Airflow, Apache NiFi, Autosys, FastAPI, Jenkins, Jira, Git, Spinnaker, pytest, unittest
Responsibilities
Design and build ETL/ELT pipelines on Databricks; Develop and orchestrate AWS data workflows; Implement orchestration, scheduling, SLAs, backfills, runbooks, monitoring, and incident triage; Build secure platform and data-access controls; Develop REST APIs; Perform advanced SQL data operations
Seniority
Senior, hands-on IC
