Data Engineer
Core
Design, build, and deploy large-scale data transformation platforms and pipelines using Databricks and AWS cloud infrastructure.
Role type
Senior Data Engineer
Builds
Mission-critical data platforms and end-to-end data solutions for enterprise environments.
Domain
Agriculture technology / Commercial data solutions (Sales, Marketing, Pricing, Customer Insights)
Deliverable
production ML models | product features | infrastructure
Required skills
Databricks (Spark, Delta Lake, MLflow, Unity Catalog), AWS (S3, Glue, Lambda), SQL, Python, PySpark, CI/CD, Terraform, Data modeling, Lakehouse architectures, NoSQL databases, Container management
Preferred skills
Azure or GCP, DevOps practices, Regulatory frameworks (GDPR, SOC2, PCI-DSS), AWS Redshift, Scala, Prompt engineering, AI/ML agentic workflows
Technologies
Databricks, AWS, Terraform, S3, Glue, Lambda, Redshift, Delta Lake, Unity Catalog, MLflow, Iceberg, Delta Live Tables
Responsibilities
Design and deploy data pipelines and platforms; Lead or contribute to end-to-end implementation of data solutions; Collaborate with architects and stakeholders to define technical requirements; Optimize data systems for performance, scalability, and security; Ensure data governance, quality, and compliance.
Seniority
Senior, hands-on IC
