Data Engineer
Core
Implementing complex data projects to collect, parse, manage, analyze, and visualize large datasets to turn information into value for customers.
Role type
Senior Data Engineer (Azure/Big Data)
Builds
Big data pipelines, architectures, and data sets on Microsoft Azure platforms.
Domain
Aerospace & Defense / Big Data Engineering
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Azure Databricks, PySpark, MS SQL Server, Python scripting, Azure Data Factory, CI/CD pipelines, Data Modeling, Infrastructure management
Preferred skills
Cluster capacity planning, Workload optimization, Agile methodology
Technologies
Azure Databricks, PySpark, MS SQL Server, Azure Data Factory, Azure DevOps, Linux, Microsoft Windows
Responsibilities
Secure the data supply chain and ingest data from different sources; Analyze, cleanse, join, and transform data; Implement designed solutions into the chosen platform; Plan, design, and conduct tests of implementations; Manage data including security, archiving, structure, and storage.
Seniority
Senior, hands-on IC with technical lead experience
