Data Engineer - AWS, Snowflake
Core
Design, build, and maintain data structures, pipelines, and microservices to deliver operational and analytical data assets for business use cases.
Role type
Senior Data Engineer (Big Data/Cloud)
Builds
Enterprise data assets, data pipelines, and microservices for data consumers
Domain
Financial Services / Big Data Engineering
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Python, PySpark, Scala, SQL, Hadoop, Hive, Impala, Spark, Kafka, No-SQL databases, CI/CD, DevOps
Preferred skills
Financial services domain experience, cloud technologies and migrations, Agile Software Development
Technologies
Spark, Kafka, Hadoop, Hive, Impala, No-SQL
Responsibilities
Design and deploy frameworks and microservices to serve data assets; build robust programs for moving, transforming, and loading data; coordinate with Data Scientists and Data Modelers to construct strategic data stores; ensure data quality and integrity for business use cases; provide consultation on data opportunities and strategy.
Seniority
Senior, hands-on IC