Junior Data Engineer
Core
Develop, maintain, and monitor ETL/ELT data pipelines and Big Data solutions to ensure reliable data processing and quality.
Role type
Junior IC data engineer
Builds
Data pipelines, data workflows, and data processing solutions
Domain
Big Data, Data Engineering
Required skills
SQL, Linux, Shell/Bash scripting, Python, Apache Airflow, Hadoop ecosystem (HDFS, Hive), Spark, Presto/Trino, Kafka, Kubernetes, Git, ETL/ELT concepts, data quality checks, AI-assisted engineering tools
Preferred skills
Experience with structured/semi-structured data formats (Parquet, JSON, CSV, Avro), distributed data-processing concepts, code reviews, documentation
Technologies
Apache Airflow, Hadoop, HDFS, Hive, Spark, Presto/Trino, Kafka, HBase, Kubernetes, Python, Scala, Java, Git
Responsibilities
Develop and maintain ETL/ELT data pipelines; Write and optimize SQL queries; Support data workflows using Apache Airflow; Perform data validation and quality checks; Develop automation scripts using Shell/Bash and Python; Monitor data pipelines and troubleshoot failures; Analyze data to identify inconsistencies; Participate in code reviews and documentation; Collaborate with cross-functional teams
Seniority
Junior, hands-on IC