Senior Manager, Data Engineering
Core
Leads teams in designing, building, and overseeing the deployment and operation of technology architecture, solutions, and software to capture, manage, store, and utilize structured and unstructured data from internal and external sources.
Role type
Senior Manager, Data Engineering
Builds
Scalable data engineering solutions, big data systems, and machine learning pipelines
Domain
Payments technology / Big Data / Distributed Systems
Deliverable
production ML models | infrastructure
Required skills
Leading engineering teams, designing scalable data solutions, managing data pipelines, troubleshooting distributed systems, driving automation and CI/CD, coaching and mentoring, collaborating cross-functionally, ensuring data governance and security, implementing data reduction and aggregation techniques, maintaining technical documentation
Preferred skills
Experience with Hadoop, Spark, and distributed data systems, building ETL processes and data quality frameworks, Python and SQL programming, cloud platforms (AWS, Azure, GCP), machine learning and AI-powered data solutions, developing high-availability low-latency systems, leading in matrixed organizations
Technologies
Hadoop, Spark, Python, SQL, Git, AWS, Azure, GCP
Responsibilities
Lead the design, development, and deployment of scalable data engineering solutions and big data systems; Oversee the creation and maintenance of data pipelines; Guide teams in troubleshooting complex issues in distributed systems; Drive the adoption of automation, CI/CD, and quality engineering practices; Coach and mentor engineering teams; Collaborate with cross-functional partners to ensure solutions meet business priorities and regulatory requirements; Ensure adherence to data management principles, governance, and security protocols; Lead the implementation of advanced data protocols and aggregation approaches; Oversee the development and maintenance of technical and data documentation
Seniority
Senior Manager, hands-on leadership