ETL Developer
Core
Design, develop, and optimize ETL workflows and data pipelines for a geospatial visualization platform, ensuring reliable data flow into a PostgreSQL database.
Role type
Senior ETL Developer (Geospatial Data Engineering)
Builds
Real-time geospatial data pipelines and visualization platform data layers
Domain
Geospatial intelligence, Data Engineering, Cloud Infrastructure
Deliverable
production ML models
Required skills
ETL workflow design, Apache NiFi, PostgreSQL, SQL, Python, API integration, Geospatial data handling, Containerized infrastructure, AWS architecture, Git version control
Preferred skills
Apache Airflow, Custom NiFi processor development (Java), Data science concepts, AI integration in development
Technologies
Apache NiFi, PostgreSQL, AWS, Python, Git, Apache Airflow, Java
Responsibilities
Design and manage ETL workflows using Apache NiFi; Monitor and troubleshoot real-time issues in NiFi, AWS, and PostgreSQL environments; Develop new NiFi flows adhering to best practices; Interface with analysts to refine data flow requirements; Programmatically manipulate and transform data from multiple sources; Query and analyze large datasets using SQL; Support data quality, integrity, and performance optimization efforts.
Seniority
Senior, hands-on IC
