Data Engineer VMA
Core
Design, build, and maintain large-scale batch and real-time data pipelines, data warehouses, and operational data stores while integrating data silos and developing backend APIs.
Role type
Senior Data Engineer
Builds
Scalable data-driven products, data pipelines, and backend APIs
Domain
Cloud data engineering and big data infrastructure
Deliverable
production ML models | product features | dashboards & analysis | infrastructure
Required skills
SQL, Python, ETL/ELT pipeline design, database design, cloud platform expertise, big data frameworks, web scraping, REST API development, data modeling
Preferred skills
Experience with data governance, system design, and agile CI/CD practices
Technologies
AWS, Azure, Google Cloud, Spark, Kafka, RabbitMQ, Hadoop, SQL Server, PostgreSQL, MongoDB, Athena, Glue, SSIS, DMS, Spring, Beautiful Soup, Selenium, Nodejs
Responsibilities
Design and deploy data tables, views, and marts; perform data extraction, cleaning, and transformation; build and maintain efficient data pipelines; integrate data silos; collaborate with cross-functional teams to build scalable products; develop backend APIs and databases; work in an Agile environment with pair programming and code reviews
