Senior Data Engineer
Core
Designing and implementing scalable data pipelines, optimizing data workflows, and maintaining efficient data infrastructure to support business requirements.
Role type
Senior hands-on IC data engineer
Builds
Scalable data pipelines, optimized data sets, and robust data infrastructure
Domain
Data engineering, cloud platforms, big data processing
Deliverable
production ML models | infrastructure
Required skills
Python, Scala, Java, SQL, Apache Kafka, Apache Spark, AWS Glue, PostgreSQL, MySQL, MongoDB, Azure, data modeling, ETL, data warehousing
Preferred skills
Mentoring junior engineers, automation of manual processes, infrastructure redesign
Technologies
Apache Kafka, Apache Spark, AWS Glue, Azure, PostgreSQL, MySQL, MongoDB
Responsibilities
Design and develop scalable and reliable data pipelines; Construct intricate data sets aligning with business requirements; Identify and implement internal process enhancements like automation; Optimize and tune data workflows for performance; Maintain data security and compliance; Mentor junior data engineers
Seniority
Senior, hands-on IC