Data Engineer
Core
Design and implement scalable ETL/ELT pipelines and modern lakehouse architectures for large-scale telecom and CPaaS datasets to enable real-time analytics.
Role type
Senior Data Engineer (Telecom/CPaaS)
Builds
Scalable data platforms, lakehouse architectures, and real-time analytics systems for telecom and CPaaS products.
Domain
Telecom / CPaaS / Big Data
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Advanced SQL, Apache Spark (PySpark), Hadoop, Kafka, Iceberg, Delta Lake, Hudi, Snowflake, ClickHouse, Dremio, Trino, Presto, Python, Scala, Airflow, Kestra, AWS, Azure, GCP, Object Storage (S3, ADLS, GCS), Parquet, ORC, Avro
Preferred skills
Telecom data systems experience, CDR processing experience
Technologies
Iceberg, Delta Lake, Hudi, Nessie, AWS Glue, Hive Metastore, Snowflake, ClickHouse, Dremio, Redshift, Trino, Presto, Airflow, Kestra, Kafka, Spark, Hadoop, Python, Scala, PySpark
Responsibilities
Design and implement scalable ETL/ELT pipelines for large-scale analytics and migration workloads; Build modern data lakehouse platforms using Iceberg, Delta Lake, or Hudi; Develop and optimize high-performance SQL queries and distributed data processing jobs; Design and manage data warehouses and analytical platforms; Build ingestion and transformation pipelines using object storage systems; Process and transform telecom datasets and Call Detail Records (CDR); Implement orchestration workflows; Ensure data quality, governance, lineage, observability, scalability, and cost optimization; Build reusable frameworks for bulk data movement and transformation.
Seniority
Senior, hands-on IC