Data Engineer
Core
Design, build, and maintain large-scale batch and real-time data pipelines, data warehouses, and data lakes to transform raw data into actionable insights for decision-makers.
Role type
Senior Data Engineer
Builds
Scalable data platforms, ETL/ELT pipelines, data marts, and backend APIs
Domain
Cloud Data Engineering (AWS, Azure, GCP)
Deliverable
production ML models | product features | dashboards & analysis
Required skills
SQL, Python, ETL/ELT pipeline design, Cloud platforms (AWS, Azure, GCP), Big Data frameworks (Spark, Kafka, Hadoop), Database design (PostgreSQL, MongoDB, Cassandra), Web scraping, Data modeling, REST APIs, Linux/Windows environments
Preferred skills
Databricks, Microsoft Data Fabric, Data governance, System design
Technologies
AWS (DMS, Lambda, ECS, Glue, S3, Athena), Azure, Google Cloud, SQL Server, SSIS, Spark, Kafka, RabbitMQ, Hadoop, Databricks, Microsoft Data Fabric, Beautiful Soup, Selenium, Node.js
Responsibilities
Design and deploy data tables, views, and marts in data warehouses and lakes; Build and maintain efficient large-scale batch and real-time data pipelines; Integrate and collate data silos; Develop backend APIs and work on databases; Collaborate with cross-functional teams to build data-driven products; Perform data extraction, cleaning, transformation, and flow including web scraping.
Seniority
Senior, hands-on IC
