dgxspark-3node-ring branch), which has proven most reliable for
Grace-Blackwell unified memory and fabric (RoCE / 400G switch) topologies.
We are grateful to eugr and the broader vLLM / Ray / Spark community whose
hard work on real hardware made this project possible.
Key dependencies
| Project | Role |
|---|---|
| eugr/spark-vllm-docker | GB10-patched vLLM containers, NCCL 3-node ring fix, cluster recipes |
| vLLM | High-performance inference engine |
| Ray | Cross-node distributed orchestration |
| NCCL | GPU-to-GPU collective communication |
| Hugging Face | Model hub, Transformers, PEFT, Datasets |
| aiohttp | Async HTTP server for the API + web UI |