Databricks/Informatica Data Engineer
Core
Design, develop, and maintain enterprise ETL/ELT pipelines and data integration solutions using Informatica and Databricks for large-scale data processing.
Role type
Senior Data Engineer (ETL/Cloud Data Platform)
Builds
Scalable ETL/ELT pipelines, data ingestion frameworks, and cloud-based data platforms
Domain
Enterprise Data Engineering, Cloud Data Warehousing, Data Integration
Deliverable
production ML models | product features | dashboards & analysis
Required skills
ETL/ELT development, Databricks, Apache Spark, Informatica PowerCenter, Informatica IICS, SQL development, dimensional modeling, data warehousing, master data management
Preferred skills
Snowflake, Microsoft Fabric, Azure Synapse, Redshift, AWS, Azure, Google Cloud, Delta Lake, Medallion Architecture, CI/CD pipelines, Git, Azure DevOps, GitHub, regulated environment support, security clearance
Technologies
Databricks, Informatica PowerCenter, Informatica IICS, PySpark, Spark SQL, Delta Lake, AWS, Azure, Google Cloud, Snowflake, Microsoft Fabric, Azure Synapse, Redshift, Git, GitHub, Azure DevOps
Responsibilities
Design and develop enterprise ETL/ELT pipelines using Informatica PowerCenter and/or IICS, build and tune Databricks notebooks and workflows, develop data ingestion frameworks for structured and unstructured sources, implement data transformations and validation routines, collaborate with stakeholders to define data needs, troubleshoot data integration and performance issues, support migration to modern cloud architectures, develop technical documentation and operational runbooks
Seniority
Senior, hands-on IC
