Multi-Node DGX Spark: Tensor-Parallel Sizing for 2x and 4x Clusters
A 135 GB model against a 128 GB box forces a cluster. Here is the decision order, the parallelism maths, and what the interconnect really costs per token.
Tag archive
Coverage tagged nvidia dgx spark.
A 135 GB model against a 128 GB box forces a cluster. Here is the decision order, the parallelism maths, and what the interconnect really costs per token.
From one Spark to four: the open-weight model to serve at each node count, with measured decode, prefill and context figures from Mia's AI Lab recipes.