Data Engineer
Core
Design and implement database structures, scalable data pipelines, and ETL processes to collect, process, and integrate data from various sources for enterprise application support.
Role type
Senior Data Engineer / Data Architect
Builds
Scalable data pipelines, data APIs, and automation scripts
Domain
Enterprise Application Support, Big Data
Required skills
SQL, database management systems (MySQL, PostgreSQL, SQL Server), big data technologies (Hadoop, Spark), ETL tools, Python, Java, Scala
Preferred skills
Data architecture design, performance tuning, troubleshooting data issues
Responsibilities
Design and implement effective database structures and models; Develop, construct, test, and maintain scalable data pipelines; Implement ETL processes to ensure data consistency and quality; Integrate data from different sources; Develop data APIs and automation scripts; Monitor and optimize database and data processing system performance; Conduct performance tuning and troubleshoot data issues.
