Data Engineer
Core
Designing and developing ETL workflows, data pipelines, and ML-based algorithms to process data from various sources into the organization's data warehouse.
Role type
Mid-level data engineer (ETL & ML)
Builds
Data pipelines, ETL workflows, and automated data processing scripts
Domain
Management consulting / Data engineering
Deliverable
production ML models | data pipelines (via careerplan.io/jobs/5adbc54e-bd8e-44fa-8925-de94e30e5dfa-data-engineer-at-infosys-singapore-australia)
Required skills
ETL tools (Informatica, AWS Glue, Airflow), Python, SQL, CI-CD/DevOps, data quality controls, data security, data analytics patterns
Preferred skills
ML algorithm design, data visualization
Technologies
Informatica, Python, SQL, AWS Glue, Airflow, CI-CD tools
Responsibilities
Design and develop ETL workflows to move data into the data warehouse; Develop and implement data quality controls; Design and develop ML-based algorithms in Python; Create data visualizations and provide insights; Design and implement data security and access controls
Seniority
Mid-level (2-5 years experience)
