Data Engineer
Core
Senior Data Engineer responsible for integrating and processing large volumes of data in GCP and on-prem environments.
Role type
Senior Data Engineer (GCP / ETL / Big Data)
Builds
Data integration pipelines, high-performance data processing solutions, and data delivery services for enterprise clients.
Domain
Cloud Data Engineering, Big Data, ETL
Deliverable
production ML models | product features | dashboards & analysis | infrastructure
Required skills
GCP BigQuery, GCP BigTable, Scylla Cloud, Apache Airflow, GCP Dataflow, GCP Dataproc, Kafka, GCP Pub/Sub, Informatica PowerCenter, NiFi, Oracle, PostgreSQL, ScyllaDB, Automate Now, REST API, Python, PySpark, Rust
Preferred skills
Java microservices, Linux, handling 100 TB+ data volumes, Git, Grafana, Apache JMeter
Technologies
GCP, BigQuery, BigTable, Scylla Cloud, Apache Airflow, GCP Dataflow, GCP Dataproc, Kafka, GCP Pub/Sub, Informatica PowerCenter, NiFi, Oracle, PostgreSQL, ScyllaDB, Automate Now, Python, PySpark, Rust, Java, Linux, Git, Grafana, Apache JMeter
Responsibilities
Design, develop, and maintain data integration processes in GCP; Build and optimize data pipelines using BigQuery, BigTable, and Scylla Cloud; Work with orchestration tools like Apache Airflow, GCP Dataflow, and GCP Dataproc; Integrate systems using Kafka and GCP Pub/Sub; Develop and maintain ETL processes in on-prem environments using Informatica PowerCenter and NiFi; Design, develop, and tune relational databases (Oracle, PostgreSQL, ScyllaDB); Create and expose REST API services; Develop data integration and processing tools in Python, PySpark, and Rust; Gradually take ownership of a specific data processing and delivery area.
Seniority
Senior, hands-on IC
