Custom Software Engineer
Core
Design, build, and configure automated data ingestion pipelines and workflows aligned with analytics and AI-driven use cases.
Role type
Senior IC data engineer (Azure cloud)
Builds
Automated data ingestion pipelines, ETL workflows, and data orchestration infrastructure
Domain
Cloud data engineering, AI/ML data pipelines
Deliverable
production ML models
Required skills
Azure Data Factory, Azure Data Lake Storage, Azure SQL, Azure Service Bus, Ansible, Redis, containerization, ETL design, data orchestration
Preferred skills
CI/CD implementation, LLM pipeline integration
Technologies
Azure Data Factory, Azure Data Lake Storage, Azure SQL, Azure Service Bus, Azure Application Insights, Azure Container Apps, Ansible, Redis
Responsibilities
Build automated data ingestion pipelines from Azure Data Lake Storage and Azure SQL; Develop and maintain Azure Data Factory pipelines with linked services and triggers; Containerize ETL workflows using Azure Container Apps; Configure scheduling and message-based execution using Azure Service Bus; Utilize Ansible playbooks for infrastructure provisioning; Maintain Redis cache for managing intermediate LLM processing states; Implement monitoring, alerting, and logging through Azure Application Insights.
Seniority
Senior, hands-on IC (via careerplan.io/jobs/ATCI-5258910-S1924934-1-custom-software-engineer-at-accenture)