Sr. Data Engineer - Cloud & AI Platform
Core
Design, build, and maintain enterprise data structures, pipelines, and microservices to deliver operational and analytical data assets for business use cases.
Role type
Senior Data Engineer (Cloud & AI Platform)
Builds
Enterprise data assets, data pipelines, and microservices for data consumers
Domain
Financial services / Big Data Engineering / Generative AI
Deliverable
production ML models | product features | infrastructure
Required skills
Python, PySpark, Scala, SQL, Hadoop, Hive, Impala, Spark, Kafka, No-SQL databases, CI/CD, DevOps
Preferred skills
Generative AI solutions, LLMs (Amazon Bedrock), prompt engineering, agent orchestration, AI governance frameworks
Technologies
Amazon Bedrock, Spark, Kafka, Hadoop, Hive, Impala
Responsibilities
Design and deploy frameworks and microservices to serve data assets; build robust programs for moving, transforming, and loading data; coordinate with Data Products Partners and Data Scientists to construct strategic data stores; ensure data quality and integrity for business use cases; provide consultation on data opportunities and strategy; support automation of data products.
Seniority
Senior, hands-on IC