VRAM Calculator
Estimate GPU Memory
Calculate VRAM requirements for inference. Adjust model parameters, quantization, and batch size to find the right GPU.
Configuration
512131K
1128
VRAM Breakdown
Weights
7.00 GB
KV Cache
1.07 GB
Overhead
0.64 GB
Total VRAM Required
8.71 GB