Senior Data Pipeline Developer
Core
Building a modern multi-cloud data platform including pipelines, integrations, models, and reporting marts to serve business requirements and downstream consumers.
Role type
Senior IC data pipeline developer
Builds
Production data pipelines, data integrations, data preparation layers, data models, analytical/reporting marts, and data APIs
Domain
Fund administration and middle office solutions in the financial services industry
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Data warehousing and data modelling, Data lakes (AWS Lake Formation, Azure Data Lake), Cloud data warehouses (AWS Redshift, Azure Synapse, Snowflake), ETL/ELT/Pipeline tools (AWS Glue, Azure Data Factory, Fivetran, Stitch), Messaging systems (AWS SNS & SQS, Azure ASQ, Kafka, RabbitMQ), SQL, Python, Scala, Java, Cloud workflow services (AWS Step Functions, Azure Logic Apps, Camunda), Event and schedule management (AWS Lambda, Azure Functions), Microsoft BI Stack (SQL Server, SSIS, SSAS, SSRS), Reporting and visualization tools (Power BI, QuickSight, Mode), NoSQL and Graph Databases (AWS Neptune, Azure Cosmos DB, Neo4j)
Preferred skills
API Management
Technologies
AWS Redshift, Azure Synapse, Snowflake, AWS Glue, Azure Data Factory, Fivetran, Stitch, Kafka, RabbitMQ, AWS Step Functions, Azure Logic Apps, Camunda, AWS Lambda, Azure Functions, Power BI, QuickSight, Mode, AWS Neptune, Azure Cosmos DB, Neo4j
Responsibilities
Build modern data platform components based on business requirements and design patterns, Determine appropriate tools and design patterns for specific needs, Prepare data for exposure through APIs, Document, support, manage, and maintain the data platform, Provide guidance and training to downstream data consumers on best practices, Support and build new data APIs
Seniority
Senior, hands-on IC