Data Engineer (Python, PySpark & Databricks)
Core
Design, build, modernize, and operate scalable data pipelines for Tax technology platforms using Python, Apache Spark, and Databricks.
Role type
Senior IC Data Engineer
Builds
Production ETL/ELT pipelines, data ingestion workflows, and document processing automation
Domain
Tax technology / Cloud data engineering
Required skills
Python, Apache Spark, PySpark, Databricks, SQL, Data Modeling, REST API integration, CI/CD, Automated Testing, Data Quality, Git
Preferred skills
Azure cloud services, Document processing, AI-assisted development tools, Streaming data pipelines
Technologies
Python, Apache Spark, PySpark, Databricks, Git, REST APIs, Azure
Responsibilities
Design and build scalable data pipelines; Modernize legacy data workloads to cloud-native platforms; Build batch data ingestion pipelines; Integrate data from APIs and repositories; Implement data quality and monitoring controls; Optimize data workloads for performance and cost; Develop document extraction and automation pipelines; Apply software engineering practices including testing and code reviews.
Seniority
Mid-Senior, hands-on IC