Data Engineer Advisor
Core
Designing, building, and maintaining scalable data pipelines and analytics solutions to enable reliable data integration and support advanced analytics.
Role type
Data Engineer
Builds
Scalable data pipelines, ETL/ELT processes, data models, and data warehousing solutions
Domain
Cloud data engineering and data integration
Deliverable
production ML models | product features | dashboards & analysis
Required skills
SQL, Python, ETL/ELT tools, RDBMS (PostgreSQL, SQL Server, MySQL, Oracle), NoSQL (MongoDB, Neo4j), cloud platforms (AWS), data warehousing concepts, data quality and governance practices
Preferred skills
Java, C++, machine learning frameworks (TensorFlow, Pytorch, scikit-learn), DevOps tools (GitHub Actions, Terraform), containerization (Docker, Kubernetes), API development, big data technologies (Hadoop, Spark)
Technologies
AWS Glue, Qlik, TensorFlow, PyTorch, scikit-learn, GitHub Actions, Terraform, Docker, Kubernetes, Hadoop, Spark
Responsibilities
Design and develop data pipelines and ETL/ELT processes; Integrate data from multiple sources into centralized platforms; Ensure data quality, integrity, and consistency; Build and optimize data models and data warehousing solutions; Monitor and troubleshoot data workflows and pipeline performance
Seniority
Individual Contributor