Model memory planning: establish a scoped floor

Start with a trustworthy logical parameter count and a specified numerical format. A weight-memory calculation is a lower-bound planning input; the operator must qualify the complete runtime under the intended workload.

Updated

Computraq is preparing for launch. These guides explain readiness and the proposed framework; they do not establish a live service, integration or partnership.

Prepare these inputs

  • Exact model revision, architecture and evidence for parameter count.
  • Native or proposed quantization format and supported runtime.
  • Context length, concurrent sequences, multimodal inputs and GPU topology.

Decisions and sequence

  • Compute decimal GB = parameters × bytes per parameter / 1,000,000,000; GiB uses 1,073,741,824 instead. For an uncompressed BF16/FP16 assumption use 2 bytes.
  • Account separately for quantization metadata, KV cache, activations, runtime allocations and temporary load buffers.
  • Measure peak memory during load, prefill and generation on the proposed configuration before making a capacity commitment.

The first useful deliverable

A memory budget separating weight estimates, runtime measurements, workload assumptions and a safe operating envelope.

Failure modes to catch

Do not derive logical parameters from compressed file size or multiply an MoE active-parameter count as if it described all resident weights. Ideal bit-width arithmetic is not a measured quantized deployment.

How this follows the paper

Read The Independent Institution, sections 5. The role and sequence above are practical preparation derived from those sections; any newly proposed commercial arrangement still needs its own confirmed terms.

Computraq participation status

Computraq is in prelaunch. This guide interprets the proposed operating model in The Independent Institution; it does not establish current hosting, paid booking, provider integration, partnership or a guarantee of service. Use the paper, original slides and expression-of-interest form to prepare a concrete contribution.

Sources and verification