Software Engineer II (US)
Core
Develops components of solutions with a focus on analytics, support, testing, and proof of concepts aligned to business and technology objectives.
Role type
Software Engineer II (Data Engineering & Metadata)
Builds
Analytics solutions, data harvesting pipelines, and metadata management systems for a global financial institution.
Domain
Financial Services / Data Engineering / Metadata Management
Deliverable
production ML models | product features | infrastructure
Required skills
Python, PySpark, SQL, REST APIs, Git, CI/CD pipelines, automated testing, cloud data platforms (Azure), data lineage, metadata validation, incident management, code reviews
Preferred skills
Collibra, Microsoft Purview, Alation, Informatica EDC, OpenMetadata, Databricks, Unity Catalog, Delta Lake, Spark, Azure Data Factory, Oracle, SQL Server, DB2, Teradata, Postgres, data quality, secrets management, financial services domain experience
Technologies
Azure, ADLS Gen2, Azure SQL, Synapse, Azure Data Factory, Key Vault, Git, CI/CD, Collibra, Microsoft Purview, Alation, Informatica EDC, OpenMetadata, Databricks, Unity Catalog, Delta Lake, Spark, PySpark, SQL, Python, REST APIs, JSON, CSV, JDBC/ODBC
Responsibilities
Develops new solutions and features for engineering programs; performs unit/component testing; supports business enquiries via small enhancements and break/fix implementations; analyzes technical requirements to recommend engineering solutions; monitors product lifecycles and undertakes re-development; documents and verifies system components and architecture designs; participates in quality management reviews; creates and maintains quality code and provides support during testing cycles; provides technical expertise during incident management; troubleshoots harvesting failures and connector issues; creates and maintains technical documentation and runbooks.
Seniority
Mid-level IC (3-5 years experience)