Sightline Data Engineer I (Sightline Information Technology)
Core
Design, build, and maintain data pipelines to extract, transform, and load data from diverse sources for visualization, web applications, and policy analysis.
Role type
Junior to Mid-level Data Engineer
Builds
Data pipelines, ETL/ELT processes, data scraping systems, and data quality monitoring tools
Domain
Public policy research and data analytics
Required skills
ETL/ELT development, data pipeline design, database I/O and querying, data cleaning and transformation, data quality assurance, Python scripting, web data scraping, data warehousing
Preferred skills
Microsoft Fabric, cloud data engineering, Python-based solutions, DevOps/CI/CD, Infrastructure as Code, data lake/lakehouse architecture, Microsoft Azure, data governance
Technologies
Microsoft Fabric, Azure, Python, CI/CD, IaC, Data Warehousing
Responsibilities
Design and maintain data pipelines for data acquisition and transformation; Develop and maintain web data scraping systems; Create scripts to clean, transform, and analyze data; Monitor data quality and detect anomalies; Support data architecture design; Collaborate with developers, analysts, and researchers
Seniority
Junior to Mid-level, hands-on IC