Senior Data Engineer
Core
Designing and maintaining scalable data pipelines for ingestion, transformation, and storage to support analytics clusters and client data needs.
Role type
Senior contract Data Engineer
Builds
Highly available data pipelines, data warehouses, and automated data infrastructure
Domain
Enterprise software consulting, cloud data engineering
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Data pipeline design, Cloud platforms (AWS/GCP/Azure), Python or Scala, SQL and data modelling, Distributed file systems, Infrastructure as code (Terraform/Ansible), CI/CD tools, Data processing at scale
Preferred skills
Mentoring client teams, Advocating agile practices, Improving client data capabilities
Technologies
AWS, GCP, Azure, Python, Scala, Git/Github, Terraform, Ansible, SQL
Responsibilities
Determine data processing and access needs with clients and teams, Create and support highly available data pipelines and storage solutions, Deliver software using agile practices (pair programming, TDD, CI/CD), Automate data infrastructure and deployments, Mentor client team members, Help improve team and client data capabilities
