Software Engineer - Data Movement Platform
Required skills
2+ years of software engineering experience in a production setting, Proficient in object-oriented programming languages like Python, Scala, Go, or Java, Demonstrated expertise in designing and implementing large-scale systems, Excellent communication skills
Preferred skills
Experience working with cloud services, Airflow, Kubernetes, CI/CD, Spark, Flink and/or working with modern cloud-based infrastructure
Technologies
Python, Scala, Go, Java, Spark, Flink, Airflow, Kubernetes, CI/CD
Responsibilities
Refine and maintain data infrastructure technologies to support ML and analytics workflows, Own the Data Movement Platform used to enable batch and stream data processing, Invest in building new infrastructure for Spark, Flink, and Airflow technologies, Build automated solutions to minimize toilsome work for data users and provide a declarative, self-service experience, Collaborate with teammates to share on-call responsibilities and support monitoring/alerting
Seniority
2+ years of software engineering experience
Domain
Data Platform, Big Data, Machine Learning, Analytics
