Software Engineering Advisor- Hybrid
Core
Design, build, and optimize scalable batch and streaming data pipelines and cloud-native data platforms for healthcare analytics and GenAI use cases.
Role type
Senior Software Engineering Advisor (Data Engineering & Cloud Infrastructure)
Builds
Cloud-native data lakes, lakehouse storage, CI/CD pipelines, and GenAI-enabled data automation workflows.
Domain
Healthcare / Data Engineering / Cloud Infrastructure
Deliverable
production ML models
Required skills
Python, Apache Spark, Teradata Vantage, AWS (S3, Glue, EC2, IAM, Lake Formation), Delta Lake, Apache Iceberg, Apache Hudi, Terraform, Jenkins, CloudBees, Kafka, REST APIs, Looker, Tableau, Splunk, AWS Bedrock, Prompt Engineering
Preferred skills
None explicitly stated as preferred
Technologies
Databricks, EMR, QueryGrid, ClearScape Analytics, AI Unlimited, Immuta, Delphix, Git, CloudBees, Jenkins, Ansible, Tableau, Looker, Splunk, AWS Bedrock, Cursor, Copilot/VSCode
Responsibilities
Develop Teradata Vantage solutions for advanced analytics; Implement cloud-native data platforms on AWS; Build and manage lakehouse storage using Delta Lake, Iceberg, and Hudi; Provision infrastructure using Terraform; Create and operate CI/CD pipelines; Integrate governance and privacy controls; Design observability workflows; Enable analytics and self-service reporting; Apply prompt engineering and AWS Bedrock for GenAI use cases.
Seniority
Senior, hands-on IC
