Software Developer - Managing Consultant
Core
Design, develop, and maintain enterprise data ingestion pipelines, onboarding workflows, and API-based data services to enable standardized data intake into the Data Platform.
Role type
Senior IC data engineering consultant
Builds
Enterprise data ingestion pipelines, onboarding workflows, and API-driven data services
Domain
Data Engineering & Architecture Consulting
Deliverable
production ML models | product features | infrastructure
Required skills
Java, ETL platforms (Informatica), AWS services (S3, IAM, networking), Databricks lakehouse architecture, API development, legacy system integration, logging and auditing, compliance patterns
Preferred skills
Databricks Delta Lake, streaming architectures (Kafka, Kinesis, EventBridge), DevSecOps practices, enterprise metadata and lineage tooling
Technologies
Java, Informatica, AWS, Databricks, Kafka, Kinesis, EventBridge
Responsibilities
Design and develop enterprise data ingestion pipelines and onboarding workflows; Modernize legacy data ingestion pipelines with AWS and Databricks lakehouse architecture; Develop and expose API-driven data services for secure data exchange; Implement robust logging, auditability, and monitoring capabilities; Collaborate with cloud engineering teams to integrate pipelines with AWS services; Contribute to governance and compliance practices including data classification and access control
Seniority
Senior, hands-on IC
