Data Platform Engineer
Core
Designing, building, and maintaining scalable data platforms to support data processing and analytics needs.
Role type
Data Platform Engineer
Builds
Scalable data platforms, efficient data pipelines, and data infrastructure architecture.
Domain
Cloud data engineering and analytics
Deliverable
production ML models | product features | infrastructure
Required skills
Python (async pipelines, scripting), PostgreSQL (schema design, migrations, query optimization), SQL (advanced queries, window functions), dbt (transformation, testing), Apache Airflow or Azure Data Factory, Data quality frameworks (Great Expectations), Observability (logging, alerting), Microsoft Graph API, Redis (queue, caching), Docker
Preferred skills
Experience with cloud platforms (AWS, Azure, GCP), Data governance and security best practices
Technologies
Azure Data Lake Storage, Synapse Analytics, Alembic, Prometheus, Grafana, SharePoint, M365
Responsibilities
Develop and maintain data pipelines for ingestion, processing, and storage; Implement ETL/ELT processes to transform raw data; Collaborate with cross-functional teams to understand data requirements; Ensure data quality, consistency, and reliability; Optimize database performance and monitor platform health; Assist in design and implementation of data governance and security measures; Document data infrastructure and processes.
Seniority
Mid-level, hands-on IC
