8000 vllm/benchmarks/README.md at minimal-gptq · tongyx361/vllm · GitHub
[go: up one dir, main page]

Skip to content

Latest commit

 

History

History
8 lines (6 loc) · 245 Bytes

README.md

File metadata and controls

8 lines (6 loc) · 245 Bytes

Benchmarking vLLM

Downloading the ShareGPT dataset

You can download the dataset by running:

wget https://huggingface.co/datasets/anon8231489123/ShareGPT_Vicuna_unfiltered/resolve/main/ShareGPT_V3_unfiltered_cleaned_split.json
0