Data Engineer
Core
Design, build, and maintain large-scale batch and real-time data pipelines, data warehouses, and data lakes to support scalable data-driven products and applications.
Role type
Data Engineer
Builds
Production-grade data pipelines, ETL/ELT integrations, backend APIs, and databases for mobile and web applications.
Domain
Cloud technology, big data, and application development
Deliverable
production ML models | product features | infrastructure
Required skills
SQL, Python, data modeling, database design, system design, data extraction and cleaning, web scraping, cloud platform experience, big data frameworks, REST API integration
Preferred skills
Experience with data governance, knowledge of data structures and algorithms, familiarity with W3C DOM
Technologies
AWS, Azure, Google Cloud, SQL Server, PostgreSQL, MongoDB, MySQL, Hadoop, Spark, Kafka, RabbitMQ, Databricks, SSIS, AWS DMS, AWS Lambda, ECS, Eventbridge, AWS Glue, Spring, BeautifulSoup, CasperJS, PhantomJS, Selenium, Nodejs
Responsibilities
Design and deploy data tables, views, and marts; perform data extraction, cleaning, transformation, and flow; build and maintain efficient data pipelines; integrate and collate data silos; collaborate with cross-functional teams to build scalable data products; develop backend APIs and databases; work in an Agile environment with CI/CD practices.
Seniority
Mid-level to Senior, hands-on IC
