Lead Data Engineer - Data Publication and Transformation
Core
Design, develop, test, implement, and support full-stack technical solutions and cloud-based data transformation pipelines for digital products serving millions of customers.
Role type
Lead Data Engineer (Data Publication and Transformation)
Builds
Robust cloud-based data solutions and transformation pipelines
Domain
Financial services, cloud data engineering, big data
Deliverable
production ML models | product features | infrastructure
Required skills
Java, Scala, Python, SQL, NoSQL, cloud data warehousing, unit testing, code reviews, performance tuning
Preferred skills
Golang, real-time data streaming, distributed computing (MapReduce, Flink, EMR, Kafka, Spark), UNIX/Linux shell scripting, interactive AI tooling
Technologies
Redshift, Snowflake, AWS, Microsoft Azure, Google Cloud, PostgreSQL, DynamoDB, Open Source RDBMS, NoSQL databases
Responsibilities
Collaborate with Agile teams to design and implement full-stack solutions; work with developers experienced in machine learning and microservices; mentor engineering community members; deliver cloud-based solutions with digital product managers; perform unit tests and code reviews
Seniority
Lead, hands-on IC with mentorship responsibilities
