Principal Data Engineer
Core
Design, build, and optimize scalable data infrastructure, pipelines, and storage systems to support analytics, business intelligence, and AI/ML workloads for the Talent Cloud platform.
Role type
Principal Data Engineer (Team Lead)
Builds
Scalable data pipelines, storage systems, and analytics infrastructure for the Talent Cloud platform.
Domain
SaaS / HR Tech / Data Engineering
Deliverable
production ML models | infrastructure
Required skills
Python, SQL, cloud platforms (AWS), streaming platforms (Kafka, AWS Kinesis), data warehousing, schema design, data transformation (dbt), API development, CI/CD pipelines, security principles.
Preferred skills
Java, user behaviour tracking platforms (Snowplow, Google Analytics).
Technologies
AWS, S3, Redshift, Kafka, AWS Kinesis, SQL Server, PostgreSQL, MySQL, MongoDB, dbt, Looker, Git, Snowplow, Google Analytics.
Responsibilities
Lead a team of data engineers providing technical direction, mentorship, and performance management; Design and maintain scalable data pipelines for multi-source data collection and storage; Implement event sourcing and streaming architectures for real-time processing; Apply data governance and security principles to ensure compliance; Collaborate with data scientists and product teams to deliver reliable data solutions; Drive improvements in data engineering practices and architecture.
Seniority
Principal, hands-on IC with team leadership