Data Engineer
Core
Design, develop, and maintain scalable data pipelines and robust data architectures.
Role type
Data Engineer
Builds
Data pipelines and data architectures
Domain
Data Engineering
Deliverable
production ML models | infrastructure
Required skills
SQL, ETL, data warehousing, Apache Kafka, Apache Spark, Python, Java, Scala, cloud platforms (AWS, GCP, Azure), data modeling, database design, data governance
Preferred skills
Data quality control, problem-solving, data security compliance
Responsibilities
Design and maintain scalable data pipelines and robust data architectures, Collaborate with data scientists and analysts to ensure effective data integration and usage, Optimize data storage and retrieval processes for performance and efficiency, Implement data quality controls and resolve issues to ensure data accuracy and reliability, Ensure compliance with data security and privacy regulations
