Data Operations Engineer
Core
Build and maintain scalable data pipelines, integrate data sources, and ensure reliability and security of cloud-based data platforms within AWS environments.
Role type
Senior IC Data Operations Engineer
Builds
Automated data ingestion, transformation, and processing solutions supporting analytics and reporting
Domain
Cloud data engineering and operations on AWS
Required skills
Python, SQL, AWS data services (S3, Glue, Lambda), ETL/ELT design, CI/CD pipelines, Infrastructure as Code, cloud security principles, troubleshooting
Preferred skills
AWS Redshift/Athena/EMR/Kinesis, Apache Spark/PySpark, Terraform/CloudFormation, GitHub Actions/GitLab CI, data lake architectures, event-driven processing, data modeling/metadata management, regulated environment experience
Technologies
AWS (S3, Glue, Lambda, Redshift, Athena, EMR, Kinesis, CloudWatch), Python, SQL, Git, Terraform, CloudFormation, Apache Spark, PySpark
Responsibilities
Develop and optimize data pipelines and integration workflows; Build automated data ingestion and processing solutions; Monitor pipelines and resolve performance/reliability issues; Support data quality, validation, and governance controls; Develop and maintain automated deployments using CI/CD; Contribute to technical design discussions and implementation decisions
Seniority
Senior, hands-on IC