Senior Data Engineer - Python, SQL
Core
Design and implement large-scale data ingestion systems and optimize the complete data lifecycle from ingestion to display within Big Data environments.
Role type
Senior Data Engineer (Big Data)
Builds
Large-scale data ingestion systems and ETL processes
Domain
Big Data, Data Engineering
Deliverable
production ML models | infrastructure
Required skills
Java, SQL, Linux, RESTful APIs, complex ETL development, data lifecycle management
Preferred skills
Hadoop, Hbase, MapReduce, Elasticsearch, NiFi, Kafka, Zookeeper, compliance automation
Technologies
Hadoop, ElasticSearch, Kafka, Linux, Java EE, ZooKeeper, NiFi
Responsibilities
Design and implement large-scale data ingestion systems, optimize all phases of the data lifecycle, develop ETL processes for data extraction and transformation, create tailored solutions to ingest varied data sources, maintain detailed documentation for system clarity.
Seniority
Senior, hands-on IC
