Data Engineer
Core
Designs and establishes secure and performant data architectures, pipelines, and repositories for structured/unstructured data to support machine learning models and enterprise data quality.
Role type
Senior Data Engineer
Builds
Data pipelines, repositories, and models
Domain
Big Data / Data Engineering
Deliverable
production ML models
Required skills
Data Modeling, ETL, Data Warehousing, Data Pipelines, SQL, Python, Java, Scala, Apache Spark, Apache Kafka, Apache Hadoop, AWS, Azure, Machine Learning
Preferred skills
AI solution implementation, Programming Language Certification
Technologies
SQL, Python, Java, Scala, Apache Spark, Apache Kafka, Apache Hadoop, AWS, Azure
Responsibilities
Design and establish secure data architectures and programming changes for data pipelines; Write and execute testing plans and debug code integration issues; Lead a project team to develop reliable data solutions; Analyze data inaccuracies and develop automated solutions to enhance data quality; Collaborate cross-functionally to define report deliverables; Provide guidance and mentoring to less experienced staff.
Seniority
Senior, hands-on IC with team leadership