Sr Analyst, Data Engineer
Core
Senior Data Engineer supporting data processing, integration, and pipeline optimization to enable data-driven initiatives and analytics.
Role type
Senior IC data engineer (ETL/Cloud)
Builds
Scalable data pipelines, optimized databases, and automated workflows for analytics and ML integration.
Domain
Agriculture technology / Cloud data engineering
Deliverable
production ML models | product features | dashboards & analysis
Required skills
ETL/ELT pipeline development, Python, Apache Spark, SQL, AWS cloud services, data modeling, process automation
Preferred skills
AWS Certified Data Engineer, machine learning pipeline integration
Technologies
Databricks, Python, Spark SQL, Airflow, AWS (S3, Glue, Athena, EMR, RDS, Lake Formation)
Responsibilities
Design and implement complex data transformation logic; manage and optimize databases for efficient storage and retrieval; support data analysts and scientists in creating reports and analytics solutions; collaborate with data scientists to integrate machine learning models into pipelines; identify and implement process automation opportunities; document data engineering processes and workflows.
Seniority
Senior, hands-on IC
