Big Data Engineer
Core
Design and operate end-to-end big data and analytics solutions for industrial digitalization, building scalable pipelines and real-time dashboards to drive operational efficiency and safety in Oil & Gas, Petrochemicals, Utilities, and Manufacturing.
Role type
Senior Big Data Engineer (Industrial Digitalization) (via careerplan.io/jobs/B5-008-49-666-big-data-engineer-at-intech-process-automation)
Builds
Scalable ETL/ELT pipelines, real-time predictive dashboards, and data integration layers for industrial systems.
Domain
Industrial Automation / Big Data / Oil & Gas
Required skills
PySpark, Scala, Apache Hadoop ecosystem (Cloudera, HDFS, Hive, Impala, Oozie), SQL, Power BI, Tableau, Python, Data Ingestion (Apache NiFi, Sqoop)
Preferred skills
AWS data services (Glue, Redshift), OSI PI System integration
Technologies
Cloudera, Hadoop, Hive, Impala, Oozie, PySpark, Scala, Apache NiFi, Sqoop, Power BI, Tableau, SQL, Oracle, IBM DB2, Amazon RDS
Responsibilities
Design and maintain robust ETL/ELT pipelines for pre-production and production environments; Ingest data from diverse sources including industrial sensors and relational databases; Optimize data storage and query performance using Hive, Impala, and HDFS; Develop interactive and real-time dashboards in Power BI and Tableau; Support the development of predictive models by engineering data features; Perform data analysis and ad-hoc reporting for plant manufacturing and safety; Ensure data accuracy and consistency across reporting platforms; Assist in maintenance and performance tuning of the Big Data platform and BI servers.
Seniority
Senior, hands-on IC
