Custom Software Engineer
Core
Design, develop, and maintain scalable data pipelines and ETL processes to collect, process, and store large volumes of structured and unstructured data.
Role type
Senior IC Data Engineer
Builds
Production data pipelines, ETL processes, and data architecture
Domain
Data Engineering / Cloud Data Platforms (via careerplan.io/jobs/ATCI-5403212-S1965194-1-custom-software-engineer-at-accenture)
Deliverable
production ML models | infrastructure
Required skills
Python, PySpark, Java, Scala, SQL, NoSQL, ETL tools, Apache Airflow, AWS Glue, Google Dataflow, Azure Data Factory, Hadoop, Spark, Kafka, Docker, Kubernetes, Redshift, BigQuery, Snowflake
Preferred skills
Machine learning pipelines, data science workflows, data visualization tools
Technologies
AWS, GCP, Azure, Spark, Hadoop, Kafka, Redshift, BigQuery, Snowflake, Apache Airflow, Luigi, Tableau, Power BI
Responsibilities
Design and optimize data architecture for performance and scalability; Develop automation tools for data ingestion and integration; Collaborate with data scientists and business teams to deliver reliable data solutions; Implement data quality checks and monitor data integrity; Document data flows and ensure compliance with governance policies.
Seniority
Senior, hands-on IC
