IT Softwaree Engineer - Data
Core
Design and maintain cloud-based data pipelines to transform complex client information into AI-ready data for GenAI solutions in higher education and public sectors.
Role type
Senior IC Data Engineer (GenAI/Cloud)
Builds
Cloud data pipelines, ELT/ETL processes, and data models for GenAI use cases
Domain
Higher education and public sector data engineering on Google Cloud
Deliverable
production ML models
Required skills
Data pipeline design, ELT/ETL development, Google Cloud Dataflow, Cloud Composer, Apache Airflow, BigQuery, SQL, Python, Data governance, Data classification, Cloud IAM, Relational database design
Preferred skills
Google Cloud Professional Data Engineer certification, SSIS, C#/.NET, PostgreSQL, Netezza, Jira, TFS
Technologies
BigQuery, Dataflow, Cloud Composer, Apache Airflow, Dataplex, Cloud DLP, Cloud Storage, Pub/Sub, SNS/SQS, IAM, SSIS, PostgreSQL, Netezza
Responsibilities
Design and build data pipelines for GenAI use cases; Develop ELT/ETL processes from source systems; Monitor pipeline reliability and optimize costs; Classify and tag sensitive data using governance tools; Define and enforce data access controls; Assess data readiness for AI applications; Design reusable data models and schemas; Partner with client teams on data extraction approaches; Maintain technical documentation for data flows and governance; Execute delivery work and identify data risks; Collaborate with cloud and AI teams on pipeline structure; Conduct data quality reviews and testing.
Seniority
Senior, hands-on IC