Distributed Systems Engineer
Core
Build scalable data processing infrastructure and distributed computing resources for a next-generation transistor-level electromigration and IR drop analysis tool.
Role type
Distributed Systems Engineer
Builds
Core distributed infrastructure for a Python-based platform orchestrating high-performance C++ solvers, including data pipelines, I/O management, and job orchestration.
Domain
Semiconductor EDA (Electronic Design Automation), VLSI, Circuit Simulation
Deliverable
infrastructure
Required skills
Python, Distributed Systems, Data Engineering, High-performance I/O, Fault-tolerant scheduling, Resource management, Python/C++ interop
Preferred skills
EDA/VLSI background, HPC job schedulers (Slurm, PBS, LSF), GPU acceleration, Go, Cloud platforms (AWS, GCP, Azure)
Technologies
Dask, Spark, Ray, Celery, HDF5, Parquet, Arrow, pybind11, nanobind, Plotly, Bokeh, Holoviews, Datashader
Responsibilities
Build ingestion pipelines for large-scale netlists, implement high-performance I/O for multi-TB databases, develop serialization layers, design streaming interfaces, implement task distribution and load balancing, build monitoring and observability.
Seniority
Mid-level, hands-on IC (3+ years experience)