Big Data Engineer
Core
Design and operate end-to-end big data and analytics solutions, building scalable ETL/ELT pipelines and delivering real-time predictive dashboards for industrial digitalization.
Role type
Senior Big Data Engineer
Builds
Scalable ETL/ELT pipelines, real-time dashboards, and predictive analytics features for industrial operations.
Domain
Industrial automation, Oil & Gas, Petrochemicals, Utilities, Manufacturing
Required skills
PySpark, Scala, Apache Hadoop ecosystem (Cloudera, HDFS, Hive, Impala, Oozie), SQL, Power BI, Tableau, Python, data ingestion (Apache NiFi, Sqoop)
Preferred skills
AWS data services (Glue, Redshift), OSI PI System integration
Technologies
Cloudera, Hadoop, Hive, Impala, Oozie, Apache NiFi, Sqoop, Power BI, Tableau, Python, Scala, SQL, AWS
Responsibilities
Design and maintain robust ETL/ELT pipelines; Ingest data from industrial sensors and enterprise applications; Optimize data storage and query performance; Develop interactive dashboards for operational KPIs; Support development of predictive models by engineering data features; Perform data analysis and ad-hoc reporting; Tune Big Data platform and BI servers.
Seniority
Senior, hands-on IC