When will the vLLM implementation with the Talker module be available?
#26
by
mifanbushipeicai
- opened
We have waited for a month, and there has been no progress during this time.
+1
transformers is too slow
We have waited for a month, and there has been no progress during this time.
+1
transformers is too slow