[C3T] Data Platform Engineer (Metadata, DQ)
Core
Build and maintain a cloud-native metadata management and data quality platform on AWS for a Media & Entertainment project.
Role type
Data Platform Engineer (Metadata, Data Quality)
Builds
Metadata management platform, Data Quality environment, integrations with lakehouse and data warehouse
Domain
Media & Entertainment, Cloud Data Infrastructure
Deliverable
production ML models | product features | infrastructure
Required skills
Python, SQL, Metadata Management tools, Data Quality tools, AWS, CI/CD, REST API, GraphQL, Event-driven architecture
Preferred skills
Data Governance, Master Data Management, Data Lineage, Data Catalog concepts
Technologies
AWS, DataHub, Apache Atlas, Amundsen, Great Expectations, Soda, Deequ, GitHub
Responsibilities
Implement and configure Metadata Management and Data Quality environments; Automate metadata ingestion, lineage, and DQ monitoring; Develop integrations between DQ and Metadata solutions; Monitor environment stability and security; Collaborate on data standards adoption; Produce technical documentation
Seniority
Mid-level (3–5 years experience)
