Data Engineer
Core
Design, develop, and maintain data infrastructure and pipelines to support AI, machine learning, and analytical workloads.
Role type
Senior Data Engineer (AI/ML infrastructure)
Builds
Production data pipelines, APIs, feature stores, and data transformation workflows for AI and analytics systems.
Domain
Data Engineering / Artificial Intelligence / Machine Learning
Deliverable
production ML models
Required skills
Python, SQL, DuckDB, Apache Iceberg, AWS (S3, Glue), ETL/ELT, data modeling, CI/CD, automated testing, agentic workflows, LLMs
Preferred skills
LangChain, LangGraph, Kafka, MSK, CDC, Salesforce, ServiceNow, Microsoft Dataverse, OpenSearch, vector stores, GeoParquet, PostGIS, US Federal Government experience, regulatory/land management datasets
Technologies
Python, SQL, DuckDB, Apache Iceberg, AWS S3, AWS Glue, LangChain, LangGraph, Kafka, MSK, OpenSearch, PostGIS
Responsibilities
Develop and maintain data ingestion and transformation pipelines; Implement bronze/silver/gold data processing patterns; Build metadata-driven ingestion capabilities; Develop agentic and AI-enabled workflows for data engineering tasks; Implement automated data validation, reconciliation, and monitoring; Support incremental processing, schema evolution, and backfills; Integrate structured data with document and geospatial datasets; Participate in code reviews, CI/CD, and operational support.