Data Engineer

## About Noldor We are on a mission to revolutionize how insurance data powers the program and specialty insurance marketplace. Don't let the word "insurance" fool you. Insurance is a dynamic and rapidly evolving marketplace, and we are at the forefront of its transformation. At Noldor, we are building a groundbreaking platform that redefines data exchange, empowering MGAs, carriers, and reinsurers to harness data for more informed, strategic decision-making. Since our start in 2021 at the DESCOvery venture studio, we've been building an energetic, supportive, and driven team that is fearless about tackling some of the toughest challenges in this $5 trillion industry. We work hard, laugh harder, and care deeply about building something meaningful together. If you're excited by building in the open, solving real problems, and having true ownership, you'll fit right in. ## About This Role Cleaning, standardizing, and transforming data is a messy problem, especially when both the data and its structure evolve over time. In this role, you'll take on that challenge head-on, playing a critical part in turning raw data into actionable insights. You'll focus on building flexible, resilient pipelines that maintain backward compatibility, leveraging our internally developed ETL solution. We're looking for a skilled, proactive Data Engineer to join our team and help architect, build, and maintain these robust data pipelines. This role is a unique opportunity to sit at the intersection of technical infrastructure and product, ensuring our data products are reliable, performant, and fully automated, and that they continue to scale with the business's needs. ## What You'll Do - Pipeline Development & Maintenance: Architect and implement high-volume data transformation pipelines using our proprietary internal ETL solution. You will be responsible for defining logic using custom DSL to clean, enrich, and integrate disparate data sources - Cross-Functional Collaboration: Partner closely with the Product Team to translate business requirements into technical specifications. You must provide detailed, clear documentation and feedback regarding necessary data model changes or architectural adjustments - Full-Stack Automation: Ensure end-to-end automation of customer-facing functionality. When complex requirements fall outside the scope of the main ETL framework, you will be responsible for designing and deploying supporting scripts and microservices to ensure seamless operation - System Reliability: Monitor, troubleshoot, and optimize data pipelines to ensure data integrity, low latency, and high availability - Continuous Improvement: Proactively identify bottlenecks in our current ETL processes and propose improvements to our DSL or underlying infrastructure to enhance scalability and maintainability ## Who You Are - Proven experience designing and managing ETL pipelines in production environments - Expert-level SQL skills and experience working with both relational (PostgreSQL, MySQL) and potentially non-relational data stores - Demonstrated ability to write clean, maintainable, and highly automated code. You are comfortable writing "glue" code to fill gaps in existing frameworks - Exceptional ability to communicate technical data concepts to non-technical stakeholders (Product Managers, Business Analysts) - Familiarity with cloud environments (e.g., AWS, GCP, or Azure), CI/CD pipelines, and containerization (Docker/Kubernetes) is a plus - We love Ruby, so proficiency in Ruby is encouraged for building supporting scripts, automation tools, and internal tooling