Data Engineer (middle) | AICoE
Core
Designing and maintaining scalable data infrastructure for AI/ML models and government services that enable Ukrainian language capabilities.
Role type
Middle Data Engineer
Builds
ETL pipelines, data warehouses, and data processing systems for AI/LLM projects
Domain
AI/ML, Government Services, Data Infrastructure
Deliverable
production ML models
Required skills
Python, SQL, ETL tools (Apache Airflow/Dagster), Data Warehousing (Snowflake/Redshift/BigQuery/Azure Synapse), Cloud Data Services (AWS Glue/Azure Data Factory/GCP Dataflow), Data Transformation Frameworks (Pandas/PySpark)
Preferred skills
Distributed systems, NLP data pipelines, Modern cloud data warehouses
Technologies
Kubernetes, AWS, Azure, GCP, Grafana, Apache Airflow, Dagster, Snowflake, Redshift, BigQuery, Azure Synapse, AWS Glue, Azure Data Factory, GCP Dataflow, Pandas, PySpark
Responsibilities
Design and develop ETL pipelines for data ingestion and loading into centralized warehouses; Implement reliable processes for structured, semi-structured, and unstructured data; Create and optimize data warehouses; Integrate data across environments and support CI/CD pipelines; Collaborate with data scientists and ML engineers to ensure clean and versioned datasets; Monitor ETL processes and develop tracking dashboards; Ensure data quality through automated cleaning, validation, and transformation solutions
Seniority
Middle, hands-on IC
