Data Engineer
Core
Design, build, and maintain scalable data pipelines and infrastructure for efficient processing and analysis of large, complex data sets.
Role type
Data Engineer
Builds
Automated data processing pipelines, data models, and data storage solutions
Domain
Cloud data engineering, big data, ETL
Deliverable
production ML models | infrastructure
Required skills
Cloud platforms (GCP/AWS/Azure), SQL, Python, relational databases (MySQL/PostgreSQL/Oracle), big data technologies (Hadoop/Spark/Hive), data warehousing tools (Redshift/BigQuery/Airflow)
Preferred skills
Data governance, data quality monitoring, collaboration with data scientists
Technologies
Google Cloud Platform, AWS, SQL, Python, Hadoop, Spark, Hive, Amazon Redshift, Google BigQuery, Apache Airflow, MySQL, PostgreSQL, Oracle
Responsibilities
Design and build data pipelines for ingestion, ETL, and storage; monitor data quality and troubleshoot issues; develop and maintain data models for analytics and reporting; enforce data governance policies; collaborate with data scientists and analysts
Seniority
Mid-level to Senior, hands-on IC
