Data Engineer
Required skills
Bachelor's degree in Computer Science/Engineering or equivalent, 2+ years of work experience in building data pipelines ingesting and transforming large data sets, 2+ years of work experience in big data technologies such as Spark, Kafka, Airflow, etc., Work experience in one or more general purpose programming languages, preferably Scala, Python, Track record of shipping quality code and delivering high quality features, Passionate about data and driving a data driven culture in the organization
Preferred skills
Hands-on experience with AWS ecosystem and Databricks, Prior experience working in a distributed, global team across time zones
Technologies
Spark, Kafka, AWS, Airflow, Scala, Python
Responsibilities
Join a team of talented data engineers who use cutting-edge big data technologies to solve impactful business problems, Work directly with Engineering, Data Science & Data Analysts teams to create both real-time streaming and batch data pipelines that power data driven decisions across the organization, Improve and maintain our data warehousing solutions and deliver trusted and easy-to-use datasets to both internal & external stakeholders, Participate in design discussions with other team members and find innovative solutions to new and existing business problems, Develop and enhance continuous integration and continuous delivery (CI/CD) pipelines for the team, Explore new technology options for data processing, storage, and share them with the team, Develop tools and contribute to internal & open source projects wherever possible
Seniority
Mid-level (2+ years experience required)
Domain
Retail, E-commerce, Data Engineering
