Software Engineer Spec I
Core
Build and maintain data ingestion, transformation, and availability pipelines to ensure data quality and consistency for business consumption.
Role type
Data Engineer (ETL/ELT)
Builds
Data pipelines, ETL/ELT processes, Data Lake, and Data Warehouse solutions.
Domain
Banking / Data Engineering
Deliverable
production ML models | product features | dashboards & analysis
Required skills
SQL, Python, ETL/ELT concepts, relational databases (SQL Server, PostgreSQL, Oracle), data modeling, Git, cloud platforms (Azure, AWS, GCP), Data Lake/Warehouse concepts
Preferred skills
Databricks, Apache Spark (PySpark), Azure Data Factory/Synapse/Fabric, streaming platforms (Event Hub, Kafka), Delta Lake/Lakehouse, CI/CD tools (Azure DevOps, GitHub Actions), Docker, DataOps, observability
Technologies
SQL Server, PostgreSQL, Oracle, Azure, AWS, Google Cloud, Databricks, Apache Spark, Azure Data Factory, Synapse Analytics, Microsoft Fabric, Azure Event Hub, Kafka, Delta Lake, Docker, Git
Responsibilities
Develop, maintain, and evolve data ingestion and transformation pipelines; Support building and maintaining ETL/ELT processes; Monitor pipeline execution and resolve operational failures; Develop SQL queries for data extraction, transformation, and analysis; Support data modeling for Data Lake and Data Warehouse; Participate in technical documentation of data processes and solutions; Collaborate with multidisciplinary teams (Analytics, BI, Data Science) to understand business requirements; Support data governance, cataloging, quality, and security initiatives; Contribute to continuous improvement of data engineering processes and automation routines
