File size: 1,688 Bytes
c7f800f b335dec ae1f9f9 c7f800f c87cddd c7f800f c87cddd c7f800f c87cddd c7f800f c87cddd c7f800f 2d0bec4 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 |
---
license: apache-2.0
pipeline_tag: text-generation
tags:
- executorch
---
# Introduction
This repository hosts the **Qwen 2.5** models for the [React Native ExecuTorch](https://www.npmjs.com/package/react-native-executorch) library. It includes **unquantized** and **quantized** versions of the Qwen model in `.pte` format, ready for use in the **ExecuTorch** runtime.
If you'd like to run these models in your own ExecuTorch runtime, refer to the [official documentation](https://pytorch.org/executorch/stable/index.html) for setup instructions.
## Compatibility
If you intend to use this model outside of React Native ExecuTorch, make sure your runtime is compatible with the **ExecuTorch** version used to export the `.pte` files. For more details, see the compatibility note in the [ExecuTorch GitHub repository](https://github.com/pytorch/executorch/blob/11d1742fdeddcf05bc30a6cfac321d2a2e3b6768/runtime/COMPATIBILITY.md?plain=1#L4). If you work with React Native ExecuTorch, the constants from the library will guarantee compatibility with runtime used behind the scenes.
These models were exported using `v0.6.0` version and **no forward compatibility** is guaranteed. Older versions of the runtime may not work with these files.
### Repository Structure
The repository is organized into three main directories:
- `qwen-2.5-0.5B`
- `qwen-2.5-1.5B`
- `qwen-2.5-3B`
Each directory contains different versions of the model, including **quantized**, and the **original** models.
- The `.pte` file should be passed to the `modelSource` parameter.
- The tokenizer for the models is available within the repo root, under `tokenizer.json` and `tokenizer_config.json` |