Thanks for you model open to us ,but i had try with tansformer to run it well ,and what if with batch process would better ,so have you ever try with vllm to run it ? what kind of version it suit for
· Sign up or log in to comment
