(Senior) Data Engineer
Core
Design, develop, and implement scalable, secure data ingestion frameworks and pipelines on Google Cloud Platform to support enterprise data management and business solutions.
Role type
Senior Data Engineer (GCP)
Builds
High-throughput data pipelines, ingestion frameworks, and enterprise data cataloging capabilities on Google Cloud Platform.
Domain
Automotive technology / Enterprise Data Management / Cloud Computing
Deliverable
production ML models | product features | dashboards & analysis | infrastructure
Required skills
SQL (subqueries, aggregations, optimization), Google Cloud Platform (BigQuery, Dataflow, Dataproc, Pub/Sub, Cloud Composer), Spark (Scala/Python/Java), Kafka, Data modeling, Data cataloging, Security & privacy design
Preferred skills
Tableau/Qlik/Power BI, Alteryx, Informatica Data Quality, Statistical methods, Agile and DataOps methodologies
Technologies
Google Cloud Platform (GCP), BigQuery, Dataproc, Dataplex, Looker, Cloud Data Fusion, Data Catalog, Dataflow, Cloud Composer, Analytics Hub, Pub/Sub, Dataprep, Cloud Bigtable, Cloud SQL, Cloud IAM, Google Kubernetes Engine, AutoML, Qlik, Spark, Kafka, Tableau, Power BI, Alteryx, Informatica
Responsibilities
Develop and deploy high-throughput data pipelines using GCP technologies; Translate business requirements into technical specifications and source-to-target mappings; Design data solutions with a focus on security and privacy; Develop capabilities to support enterprise-wide data cataloging; Utilize Agile and DataOps methodologies in project delivery.
Seniority
Senior, hands-on IC
