Senior Data Engineer
Core
Developing Python data pipelines to build business data objects supporting applications.
Role type
Senior Data Engineer
Builds
Python data pipelines and business data objects
Domain
Industrial manufacturing data infrastructure
Deliverable
production ML models | product features | infrastructure
Required skills
Python, OOP principles, Git, CI/CD tools (Jenkins, Github Actions, Azure Devops), AWS (Bedrock, Lambda, Dynamo, Fargate, S3, Sagemaker, IAM, RDS), relational databases (PostgreSQL, Oracle), NoSQL databases (DynamoDB, MongoDB)
Preferred skills
Embedding Models and Concepts for data chunking
Technologies
Python, Git, Jenkins, Github Actions, Azure Devops, AWS, PostgreSQL, Oracle, DynamoDB, MongoDB
Responsibilities
Develop Python data pipelines, build and deploy CI/CD pipelines, implement source to target mapping, perform unit and integration testing, establish software quality practices
Seniority
Senior, hands-on IC