Update README.md

README.md

@@ -13,6 +13,8 @@ Please follow the license of the original model.
 
 ## How To Use
 
+For vllm, this pr is required https://github.com/vllm-project/vllm/pull/24818
+
 ### INT4 Inference
 ```python
 from transformers import AutoModelForCausalLM, AutoTokenizer