Qwen3
Qwen3-8B
Qwen3 checkpoint with sourced BF16 weights and full-attention cache configuration. Memory estimates exclude unverified runtime overhead.
Profile checked · Official model page ↗
Find rentals for this model →- Parameters
- 8.2B
- Context
- 40960
- BF16 weights + cacheOverhead additional
- 16.38 GiB
Workload memory estimate
Parallel active users means one simultaneous request per user. Include input and expected output in the token allowance; idle users do not count. This sizes memory, with response speed still unverified.
- Checkpoint weights
- 15.26 GiB
- KV cache
- 1.13 GiB
- Weights + cache
- 16.38 GiB
BF16 weights / BF16 cache · 8192 cached tokens per sequence · 1 resident sequence.
Pinned checkpoint ↗ · b968826d9c46dd6066d109eabc6255188de91218 · huggingface.co: config.json ↗ · huggingface.co: model.safetensors.index.json ↗
This is a single-GPU model-and-cache scenario. Distributed model sizing is not evaluated here. Runtime and allocator overhead are additional. This subtotal does not guarantee GPU compatibility. Input and output both contribute to cached tokens. No offloading, shared prefixes or cache quantization is assumed.
Find rentals for this model →Supported deployment evidence
The finder evaluates exact, freshly documented rental configurations. Original BF16 is the default; quantized alternatives require opt-in. A profile describes sourced compatibility and memory allocation, with response speed and live stock assessed separately.
Qwen3-8B · original BF16 · BF16
Pinned checkpoint ↗ · 16381470720 resident tensor bytes · BF16 cache.
BF16 original checkpoint; BF16 cache. All resident weights are counted, including every MoE expert. Matrix allocation is sourced from the pinned engine; norms are replicated. Runtime reserve remains an assumption.
9 curated deployment profiles. Profiles alone do not establish that an observed rental is eligible; the finder checks exact GPU count, instance topology, freshness and per-GPU memory.
Hardware evidence
Benchmarked GPU profiles
| Benchmark GPU / count | Architecture | VRAM per GPU | Matching on-demand instance |
|---|---|---|---|
| No benchmarked GPU profiles are available yet. | |||
Measured performance
Inference benchmarks
| Model | GPU setup | Engine | Quant. | Workload | Reported tok/s | Evidence | Max-load capacity scenarioUSD / million output tokens |
|---|---|---|---|---|---|---|---|
| No benchmark records have been supplied yet. | |||||||