Gemma 4
Gemma 4 26B A4B IT
Publisher-labelled 26B-total/4B-active vision-language MoE; the checkpoint contains 25,805,936,206 BF16 parameters. Its 30 text layers combine 25 sliding-attention and five full-attention layers, with 128 experts and top-eight routing. The official serving guide lists 64 GB BF16 guidance but its one-A100/H100 launch caps context at 32,768 tokens. GPU fit and aggregate output capacity remain unverified.
Profile checked · Official model page ↗
Find rentals for this model →- Parameters
- 25.8B
- Context
- 262144
- BF16 weights + cacheOverhead additional
- Estimate unavailable
Workload memory estimate
Parallel active users means one simultaneous request per user. Include input and expected output in the token allowance; idle users do not count. This sizes memory, with response speed still unverified.
Pinned checkpoint and cache configuration have not been supplied.
This is a single-GPU model-and-cache scenario. Distributed model sizing is not evaluated here. Runtime and allocator overhead are additional. This subtotal does not guarantee GPU compatibility. Input and output both contribute to cached tokens. No offloading, shared prefixes or cache quantization is assumed.
Find rentals for this model →Supported deployment evidence
The finder evaluates exact, freshly documented rental configurations. Original BF16 is the default; quantized alternatives require opt-in. A profile describes sourced compatibility and memory allocation, with response speed and live stock assessed separately.
Sizing evidence is missing for deployment-aware search. An empty result does not establish that this model cannot run.
Hardware evidence
Benchmarked GPU profiles
| Benchmark GPU / count | Architecture | VRAM per GPU | Matching on-demand instance |
|---|---|---|---|
| No benchmarked GPU profiles are available yet. | |||
Measured performance
Inference benchmarks
| Model | GPU setup | Engine | Quant. | Workload | Reported tok/s | Evidence | Max-load capacity scenarioUSD / million output tokens |
|---|---|---|---|---|---|---|---|
| No benchmark records have been supplied yet. | |||||||