Stars
⚡ Accurate LLM VRAM Calculator (Weights + Dynamic KV-Cache + Activations) and Inference Speedtest (TTFT & TPS) for vLLM, llama.cpp, and Ollama.
A Comprehensive Panel for Managing Servers, Matches, and Tournaments.
{{ message }}
⚡ Accurate LLM VRAM Calculator (Weights + Dynamic KV-Cache + Activations) and Inference Speedtest (TTFT & TPS) for vLLM, llama.cpp, and Ollama.
A Comprehensive Panel for Managing Servers, Matches, and Tournaments.