First-pass technical fit
Use the AI Server Sizing Tool by Workload
Choose a memory band, active demand and location. The result narrows what to test next; it is not a benchmark or promise that a model will fit.
Next hardware evaluation
-
- Still requiredExact workload test
- Still requiredPower and site pre-flight
- Still requiredSupplier and warranty check
Calculation record
See what sits behind the result.
The controls are deliberately editable. Record the values used, the date and the source before relying on an output in a buying decision.
Method
- The first branch is the likely minimum memory required on one GPU.
- Active generations alter queue and cache demand; named users do not.
- Location changes the viable acoustic, power, cooling and service boundary.
Worked reading
- A 24GB target with modest concurrent demand may justify testing a compact system.
- A model needing more than 48GB on one GPU points to a 96GB-class test, not two unrelated 24GB cards.
- Any office result still needs a noise and facilities check.
Do not infer
- The tool does not prove that a model, context or runtime will fit.
- Aggregate VRAM is not automatically one shared memory pool.
- Only a representative benchmark can establish useful latency, throughput and quality.
Why the tool stops at a hardware class
Model weights, context, KV cache, batching, runtime overhead and inter-GPU behaviour change the result. User count alone cannot produce a safe server recommendation. The result narrows the hardware that should be tested next.
Learn how local LLM memory works.
Already own a multi-GPU or former mining system? Use the £495 + VAT per-rig readiness assessment to review its topology, condition and likely AI workload fit.
Decision check
AI Server Sizing Tool: Fit, Evidence & Next Steps
Use the AI server sizing tool with current workload, cost and operating inputs, then test how the result changes when the important inputs move.
Relevant supporting considerations include AI server requirements, GPU server sizing and LLM server sizing. The AI server sizing tool result is a planning aid; retain the inputs, evidence date, downside case and any checks still required before purchase.
Management access belongs in the specification.
A useful handover records software versions, credentials, recovery, monitoring and update ownership alongside the physical server.
