Intel
/

Qwen3-Next-80B-A3B-Instruct-int4-mixed-AutoRound

Text Generation

4-bit precision

Model card Files Files and versions

wenhuach commited on Sep 16

Commit

e41eeac

·

verified ·

1 Parent(s): 1569f13

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -55,7 +55,7 @@ content: A large language model (LLM) is a type of artificial intelligence syste
 ```
 ### Generate the model
-Mian branch is required if the model is fp8 and the device supports fp8  https://github.com/intel/auto-round
 ```python
 import torch
 from transformers import AutoModelForCausalLM, AutoTokenizer

 ```
 ### Generate the model
 ```python
 import torch
 from transformers import AutoModelForCausalLM, AutoTokenizer