Data Engineer
Core
Design, implement, and optimize end-to-end CI/CD pipelines for AWS-based environments to automate build, test, and deployment processes for complex application and data systems.
Role type
Senior IC Data Engineer (Cloud Infrastructure & CI/CD)
Builds
Automated CI/CD pipelines, cloud infrastructure platforms, and data integration workflows on AWS.
Domain
Cloud Infrastructure, Data Engineering, DevOps
Deliverable
production ML models | infrastructure
Required skills
AWS services (compute, storage, networking, identity, monitoring), CI/CD pipeline design and optimization, GitHub Actions (workflows, runners, secrets management), Informatica Cloud (data integration, transformations, scheduling), Snowflake (Cortex Code, workload management, schema evolution, automated deployments), observability (logging, metrics, alerting), code review practices, technical documentation.
Preferred skills
Mentorship of team members, evaluation of new AWS/GitHub/Snowflake capabilities, alignment with organizational objectives.
Technologies
AWS, GitHub Actions, Informatica Cloud, Snowflake
Responsibilities
Drive end-to-end design and implementation of Infra CI/CD pipelines that automate build, test, and deployment processes across AWS based environments; Coordinate closely with application and data engineering teams to integrate Github Actions workflows with repository strategies branching models and approval gates; Optimize configuration of AWS services used for infrastructure automation such as compute storage networking and security components; Implement robust deployment strategies for Informatica Cloud integrations including parameterization environment promotion and rollback procedures; Configure and maintain CI CD orchestration for Snowflake workloads leveraging Snowflake Cortex Code and related tooling; Establish strong observability and feedback mechanisms across all pipeline stages using logging metrics and alerting.
Seniority
Senior, hands-on IC
