Principal Software Engineer (Integrations)
Core
Design, develop, test, deploy, monitor, and support Big Data systems and processes in a Cloud environment, ensuring quality, security, and performance.
Role type
Principal Software Engineer (Integrations / Data Platform)
Builds
Enterprise CI/CD processes, data platform solutions, and automated workflows for wholesale/retail domains.
Domain
Cloud Data Engineering / Big Data
Deliverable
production ML models | product features | infrastructure
Required skills
SQL query optimization, Apache Spark with Python, Cloud environment Big Data systems design, modern programming/scripting languages, automation of repeatable tasks, SDLC and change management, logical flow diagram creation, data design concepts, data architecture concepts, privacy law/regulation understanding.
Preferred skills
Azure stack (Logic and Function apps), Data Factory, Databricks, Data Lake, Data Warehouse, SQLDB, Data Catalogs, business glossaries, data governance, metadata management, wholesale/retail solutions experience.
Technologies
Apache Spark, Python, SQL, Azure, Data Factory, Databricks, Data Lake, Data Warehouse, SQLDB
Responsibilities
Lead design and development of Big Data systems and CI/CD processes; partner with Solution Architects to define enterprise patterns; mentor teammates on technical delivery; establish and manage quality standards and code reviews; implement monitoring and proactive alerting mechanisms; troubleshoot bugs and security risks; influence vendor roadmaps and evaluate new solutions.
Seniority
Principal, hands-on IC with mentorship
