Data Engineer
Core
Designing and developing analytics models, building data pipelines, and extracting/analyzing data from databases to support machine learning and complex business problems.
Role type
Data Engineer (IC)
Builds
Data pipelines, repositories, and analytics models
Domain
Big Data, Cloud Infrastructure, Machine Learning
Deliverable
production ML models
Required skills
Data Engineering, Data Modeling, Data Pipelines, ETL, Data Warehousing, SQL, Python, Java, Scala, Apache Spark, Apache Kafka, Apache Hadoop, AWS, Azure
Preferred skills
Programming Language Certification (SQL, Python)
Technologies
Amazon Web Services, Apache Hadoop, Apache Kafka, Apache Spark, Microsoft Azure, Java, Python, Scala, SQL
Responsibilities
Code, test, debug, and document programs for data pipelines and models; execute testing plans and identify code issues; analyze design and determine coding activities; participate in data science teams to develop solutions; identify technical problems and provide innovative solutions; execute data profiling to improve data quality; translate data into insights with business impact analysis.
Seniority
Junior, hands-on IC