Senior Big Data Engineer - Chicago Hybrid
Core
Design, develop, and maintain scalable Big Data solutions and AI-enabled data foundations for clients.
Role type
Senior IC Big Data Engineer (AI/ML support)
Builds
Large-scale data systems, batch/streaming pipelines, and data services for agentic and machine learning solutions.
Domain
Cloud data platforms, Big Data, AI Engineering
Deliverable
production ML models
Required skills
Python, Cloud data platforms (AWS/Azure/GCP), Databricks, Streaming/Batch processing (Spark, Dataflow, Glue), Data modeling (Lakehouse/Mesh), MLOps, Vector databases, Agent architectures
Preferred skills
AI engineering patterns (RAG, context engineering), Agentic platforms (Vertex AI, Azure AI), Snowflake zero-copy, Developer certifications, Retail/Financial services domain experience
Technologies
Databricks, Delta Lake, Spark, AWS, Azure, GCP, BigQuery, Redshift, DynamoDB, Snowflake, Vertex AI, Azure AI
Responsibilities
Design and deliver large-scale data systems and platform modernization; Build and optimize batch and streaming data pipelines; Support AI-enabled use cases by designing data foundations and retrieval patterns; Automate data platform operations and manage observability; Mentor junior team members.
Seniority
Senior, hands-on IC