Data Engineer - Platform Engineering
Core
Designing and building Master Data Management (MDM) functionality and maintaining data quality standards in a cloud-based environment.
Role type
Data Engineer (Platform Engineering)
Builds
Data pipelines, web services, and Event Driven Architecture components for Gartner's internal systems and client-facing websites.
Domain
Enterprise Data Engineering, Cloud Infrastructure, Master Data Management
Deliverable
production ML models | product features | infrastructure
Required skills
AWS ETL, Python/PySpark, Node.js, SQL (Postgres), Terraform, CI/CD tools, Data Governance, Data Architecture
Preferred skills
Event Driven Architecture, Data Operations, Troubleshooting complex stored procedures
Technologies
AWS (Glue, Lambda, SNS, SQS, EventBridge, Step Functions), Python, Node.js, PySpark, Postgres, Terraform, Git, Jenkins, Cloudbees
Responsibilities
Analyze business requirements and design MDM solutions; Build and maintain data pipelines; Configure web services and pub-sub queues; Monitor and maintain job schedules; Troubleshoot data pipeline issues.
Seniority
Mid-level, hands-on IC
