Update README.md
Browse files
README.md
CHANGED
@@ -319,6 +319,8 @@ python benchmarks/benchmark_latency.py --input-len 256 --output-len 256 --model
|
|
319 |
We also benchmarked the throughput in a serving environment.
|
320 |
|
321 |
Download sharegpt dataset: `wget https://huggingface.co/datasets/anon8231489123/ShareGPT_Vicuna_unfiltered/resolve/main/ShareGPT_V3_unfiltered_cleaned_split.json`
|
|
|
|
|
322 |
Other datasets can be found in: https://github.com/vllm-project/vllm/tree/main/benchmarks
|
323 |
|
324 |
Get vllm source code:
|
|
|
319 |
We also benchmarked the throughput in a serving environment.
|
320 |
|
321 |
Download sharegpt dataset: `wget https://huggingface.co/datasets/anon8231489123/ShareGPT_Vicuna_unfiltered/resolve/main/ShareGPT_V3_unfiltered_cleaned_split.json`
|
322 |
+
|
323 |
+
|
324 |
Other datasets can be found in: https://github.com/vllm-project/vllm/tree/main/benchmarks
|
325 |
|
326 |
Get vllm source code:
|