Skip to main content

Endpoints

MethodPathDescription
GET/api/nodesAll discovered nodes
GET/api/cluster/resourcesAggregated VRAM + GPU counts
GET/api/cluster/infoCluster topology
GET/api/statusThis node’s status
POST/api/cluster/roleSet distributed role

Node status

curl http://localhost:3000/api/nodes
{
  "nodes": [
    {
      "node_id": "spark1-head",
      "node_name": "spark-dgx-1",
      "status": "online",
      "engine_ready": true,
      "model": "Qwen/Qwen2.5-7B-Instruct",
      "gpu_name": "NVIDIA GB10",
      "gpu_memory_gb": 121.7
    }
  ]
}

Cluster resources

curl http://localhost:3000/api/cluster/resources
{
  "total_nodes": 4,
  "total_gpus": 4,
  "total_vram_gb": 487
}