AI data engineer
Core
Design, develop, and maintain scalable data pipelines and systems for AI applications, integrating models into production environments.
Role type
AI data engineer
Builds
scalable data pipelines and systems for AI applications
Domain
Artificial Intelligence and Data Engineering
Deliverable
production ML models
Required skills
Python, Java, Scala, Hadoop, Spark, Kafka, SQL, relational databases, NoSQL databases, cloud platforms (AWS, Azure, Google Cloud)
Preferred skills
data collection, cleansing, and preprocessing techniques, data storage and retrieval optimization, pipeline monitoring and troubleshooting, industry trend awareness
Technologies
Python, Java, Scala, Hadoop, Spark, Kafka, SQL, AWS, Azure, Google Cloud
Responsibilities
Design, develop, and maintain scalable data pipelines and systems for AI applications; Collaborate with data scientists and software engineers to integrate AI models into production environments; Implement data collection, cleansing, and preprocessing techniques to ensure data quality and integrity; Optimize data storage and retrieval processes to enhance system performance and efficiency; Monitor and troubleshoot data pipeline issues to ensure seamless data flow and system reliability; Contribute to the development of best practices and standards for data engineering processes
Seniority
Mid-level to Senior, hands-on IC
