Big Data Engineer
Core
Designing and maintaining end-to-end big data pipelines for data processing and warehousing.
Role type
Big Data Engineer
Builds
Data pipelines, ETL processes, and data warehouse solutions
Domain
Big Data, Data Engineering
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Hadoop, Hive, Spark, Scala, SQL, ETL, Unix scripting, version control, job scheduling
Preferred skills
Azure, Hive Query optimization, Spark code optimization
Responsibilities
Develop end-to-end big data pipelines, optimize Hive queries and Spark code, manage data warehouse/ETL concepts
Seniority
Mid-level, hands-on IC
Sourced via viewjobs · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.
