Data Engineer II (AWS, Databricks, AI)
Core
Design, build, and deploy data solutions to contextualize and provide easy access to data for the entire enterprise, supporting Artificial Intelligence, Machine Learning, and business intelligence.
Role type
Senior Data Engineer (AWS, Databricks, AI/ML)
Builds
Complex data pipelines, data solutions, and analytical environments
Domain
Insurance / Cloud Data Engineering
Deliverable
production ML models | product features
Required skills
AWS, Databricks, PySpark, ETL, Data Governance, Data Security, Data Quality, Data Cleansing, System Analysis, Data Movement, Transformation Code
Preferred skills
Insurance industry experience, Snowflake, Azure, Bedrock
Technologies
AWS, Databricks, Unity Catalog, PySpark, Bedrock, Snowflake, Azure
Responsibilities
Build and operationalize complex data solutions; Design complex data solutions; Perform analysis of complex sources to determine value and use; Incorporate core data management competencies including data governance, data security and data quality; Collaborate within and across teams to support delivery and educate end users; Perform data and system analysis, assessment and resolution for complex defects and incidents; Test data movement, transformation code, and data components
Seniority
Senior, hands-on IC