unable to load model on google collab notebook
#8
by
jit7duke
- opened
when running the google collab demo code i'm seeing this error,
Could you try to load the model from this section
!pip install lmdeploy>=0.6.4
from lmdeploy import pipeline, TurbomindEngineConfig
from lmdeploy.vl import load_image
model = 'OpenGVLab/InternVL2_5-1B'
image = load_image('https://raw.githubusercontent.com/open-mmlab/mmdeploy/main/tests/data/tiger.jpeg')
pipe = pipeline(model, backend_config=TurbomindEngineConfig(session_len=8192))
response = pipe(('describe this image', image))
print(response.text)