Data Engineer - OCBC
Core
Administer and optimize complex hybrid cloud data, analytics, and AI/ML platforms to support enterprise operations and innovation.
Role type
Senior IC Data Engineer (Platform Operations)
Builds
Enterprise Data & AI platforms (Cloudera CDP/CML, Hadoop, Spark, AWS)
Domain
Financial Services / Big Data / Cloud Infrastructure
Deliverable
infrastructure
Required skills
Cloudera Data Platform (CDP), Cloudera Machine Learning (CML), Hadoop Ecosystem, Apache Spark, AWS Core Services, Hybrid Cloud Architecture, Kubernetes/OpenShift Administration, Python/Shell Scripting
Preferred skills
Vulnerability Management, MLOps Platforms, Infrastructure as Code (Terraform/Ansible), SRE Practices, Generative AI Platform Support, Vector Databases/RAG
Technologies
Cloudera CDP, Cloudera Machine Learning, HDFS, YARN, Hive, Impala, Ozone, Apache Spark, AWS (EC2, EKS, IAM, S3, VPC, CloudWatch, SageMaker, Bedrock, EMR, Glue, Athena), Kubernetes, OpenShift, Terraform, Ansible, Jenkins, GitLab CI/CD, GitHub Actions, ArgoCD
Responsibilities
Administer and support Cloudera Data Platform (CDP), Cloudera Machine Learning (CML), Hadoop, and Spark environments across AWS and on-premises infrastructure. Manage platform upgrades, security patching, vulnerability remediation, certificate management, and platform hardening activities. Support containerized platforms on Kubernetes, OpenShift, and AWS EKS, ensuring high availability and performance. Monitor, troubleshoot, and optimize Data, Analytics, AI/ML, and Generative AI platforms including AWS services such as SageMaker, Bedrock, EMR, and S3. Automate operational processes using Shell/Python scripting and collaborate with Infrastructure, Security, and SRE teams to improve platform reliability and scalability.
Seniority
Senior, hands-on IC
