Data Engineer
Core
Building, testing, and deploying secure data pipelines on the EDP platform for consulting clients.
Role type
Senior Data Engineer
Builds
Robust, scalable data pipelines and workflows
Domain
IT Consulting / Data Engineering
Deliverable
production ML models | product features | infrastructure
Required skills
Python, SQL, Terraform, AWS services (Lambda, ECS, MSK, RDS, EC2, Secrets Manager, ALB, Cloud Watch, Event Bridge), Streamsets, Kestra, dbt, Git, Docker, Go, C#, .Net, JavaScript, shell scripts
Preferred skills
Experience with timeseries source systems (Honeywell Plant Historian, OSI Pi), Windows & Unix operating systems
Technologies
Streamsets, Kestra, dbt, Git, Snowflake, AWS, Terraform, Docker, Thycotic Secret Server
Responsibilities
Develop and deploy data pipelines using standard patterns; Create and execute comprehensive test plans for pipelines; Monitor and manage platform performance and uptime; Implement security best practices and conduct vulnerability assessments; Assist in troubleshooting intricate technical issues
Seniority
Senior, hands-on IC
