Encountering issues while deploying Jina-CLIP v2 on AWS using jina-sagemaker.

#49
by YanaKnudsen - opened

Hi everyone,

I'm attempting to deploy Jina-CLIP v2 for real-time inference on AWS using jina-sagemaker, as outlined in this notebook: https://github.com/jina-ai/jina-sagemaker/blob/main/notebooks/Real-time%20embedding.ipynb

The model I'm using is "jina-clip-v2" with the model ID "jina-clip-v1-e0aa7ada4c493ae4896cd249e7330158", and my region is "eu-north-1". The full ARN is:
arn:aws:sagemaker:eu-north-1:136758871317:model-package/{model_name}.

However, I am encountering the following error:
ClientError: An error occurred (ValidationException) when calling the DescribeModelPackage operation: ModelPackage arn:aws:sagemaker:eu-north-1:136758871317:model-package/jina-clip-v1-e0aa7ada4c493ae4896cd249e7330158 does not exist.

Does anyone know how to resolve this? What could be the issue? Am I missing something in the setup?

Thanks in advance!

Jina AI org

Hello there!

Could you go to AWS console and check the ARN of the model package given after subscribing? That should be the source of truth and should be the one used in your integration, I wonder if it's a different value.

Thank you for your response. I’ve already found the issue—it was indeed a different ARN.

YanaKnudsen changed discussion status to closed
YanaKnudsen changed discussion status to open

Thank you for the previous answer!

I’m trying to run a batch transform job using the jina-clip-v2 model from AWS Marketplace, and I noticed that the Jina Sagemaker GitHub documentation mentions it's possible to configure the model with a VPC to enable internet access — including using public image URLs (e.g., starting with https://). An example using public image URLs is also provided (https://github.com/jina-ai/jina-sagemaker/blob/main/examples/sample-clip-batch-input.csv).

I’ve successfully configured my VPC with proper subnets and a NAT gateway to allow outbound internet access. However, the batch transform job fails when trying to access external URLs.

After contacting AWS support, I was informed that in order to access the internet from a SageMaker model container, network isolation must be disabled. But when I attempt to create the model, I receive the error:

"EnableNetworkIsolation must be set to true for using a product from AWS Marketplace."
This seems to contradict the expectation that VPC + NAT would enable external access.

Question:

Is it possible to bypass this limitation or am I misunderstanding the documentation?

Is there any supported way to run a batch transform job using public image URLs with the jina-clip-v2 model from AWS Marketplace?
Or is it required to pre-download the images externally and serve them via S3?

Any clarification would be greatly appreciated!

Jina AI org

Hello,

However, the batch transform job fails when trying to access external URLs.
What error did you see?

I was able to retrieve results using an input like the one below (note: the example at sample-clip-batch-input.csv is a bit outdated for CLIP-V2—apologies for that):

286076113143433cb5f2655c5f70a30e,the cat is in my house,,,,
386076113143433cb5f2655c5f70a40e,,https://dummyimage.com/333/000/fff.jpg&text=embed+this,,,
286076113143433cb5f2655c5f70a50e,,,R0lGODlhEAAQAMQAAORHHOVSKudfOulrSOp3WOyDZu6QdvCchPGolfO0o/XBs/fNwfjZ0frl3/zy7////wAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACH5BAkAABAALAAAAAAQABAAAAVVICSOZGlCQAosJ6mu7fiyZeKqNKToQGDsM8hBADgUXoGAiqhSvp5QAnQKGIgUhwFUYLCVDFCrKUE1lBavAViFIDlTImbKC5Gm2hB0SlBCBMQiB0UjIQA7,,

I didn’t encounter any network-related errors, so I’m curious why you’re seeing failures. I’ll investigate further—apologies for the inconvenience.

Sign up or log in to comment