Data Engineer
Core
Designs and establishes secure data architectures, develops data pipelines, and ensures data integrity for machine learning models and enterprise data.
Role type
Senior Data Engineer
Builds
Data pipelines, repositories, and models for structured/unstructured data
Domain
Big Data / Data Engineering
Deliverable
production ML models
Required skills
Data Modeling, ETL, Data Warehousing, Data Pipelines, SQL, Python, Java, Scala, Apache Spark, Apache Kafka, Apache Hadoop, AWS, Azure
Preferred skills
AI solution implementation, Programming Language Certification
Technologies
SQL, Python, Java, Scala, Apache Spark, Apache Kafka, Apache Hadoop, AWS, Azure
Responsibilities
Design and establish secure data architectures and programming changes for data pipelines; Write and execute testing plans and debug code integration issues; Lead a project team of data engineers to develop high-quality solutions; Analyze data inaccuracies and develop automated solutions to enhance data quality; Collaborate cross-functionally to define and develop report deliverables; Provide guidance and mentoring to less experienced staff members.