Senior Data Engineer
Core
Designing, building, and maintaining scalable data pipelines and infrastructure for structured and unstructured data.
Role type
Senior Data Engineer
Builds
Data pipelines, cloud data warehouses, and ETL/ELT processes
Domain
Cloud data engineering, Big Data
Deliverable
production ML models | infrastructure
Required skills
Advanced SQL, Python, Data profiling, Cloud platforms (Azure), Cloud Data Warehousing (Data Bricks), Workflow orchestration (Airflow, Control M), Big Data tools (Spark, Hive, Impala, HDFS, HBase), CI/CD processes (Bit Bucket, GitHub, Jenkins, Nexus)
Preferred skills
Cross-timezone collaboration, Stakeholder management
Technologies
Azure, Data Bricks, Airflow, Control M, Spark, Hive, Impala, HDFS, HBase, Bit Bucket, GitHub, Jenkins, Nexus
Responsibilities
Hands-on development of data pipelines using SQL and Python; Managing structured and unstructured data types; Implementing CI/CD processes for data infrastructure; Optimizing cloud-based data systems
Seniority
Senior, hands-on IC