A collection of models that are able to be run using onnxruntime-genai and can be served through embeddedllm library.
AI & ML interests
None defined yet.
Model Powered by Onnxruntime CPU GenAI
-
EmbeddedLLM/Phi-3-mini-4k-instruct-onnx-cpu-int4-rtn-block-32
Text Generation • Updated • 6 -
EmbeddedLLM/Phi-3-mini-4k-instruct-onnx-cpu-int4-rtn-block-32-acc-level-4
Text Generation • Updated • 3 -
EmbeddedLLM/Phi-3-mini-128k-instruct-onnx-cpu-int4-rtn-block-32
Text Generation • Updated • 4 -
EmbeddedLLM/Phi-3-mini-128k-instruct-onnx-cpu-int4-rtn-block-32-acc-level-4
Text Generation • Updated • 3
-
microsoft/Phi-3-mini-4k-instruct
Text Generation • 4B • Updated • 538k • 1.27k -
microsoft/Phi-3-mini-128k-instruct
Text Generation • 4B • Updated • 1.06M • 1.67k -
microsoft/Phi-3-medium-4k-instruct
Text Generation • 14B • Updated • 15k • 220 -
microsoft/Phi-3-medium-128k-instruct
Text Generation • 14B • Updated • 9.09k • 383
A collection of model that can be hosted using OpenVINO Model Server
Model Powered by Onnxruntime DirectML GenAI
-
EmbeddedLLM/Phi-3-mini-4k-instruct-onnx-directml
Text Generation • Updated • 3 -
EmbeddedLLM/Phi-3-mini-128k-instruct-onnx-directml
Text Generation • Updated • 4 -
EmbeddedLLM/Phi-3-medium-4k-instruct-onnx-directml
Text Generation • Updated • 6 -
EmbeddedLLM/Phi-3-medium-128k-instruct-onnx-directml
Text Generation • Updated • 4
-
microsoft/Phi-3-mini-4k-instruct
Text Generation • 4B • Updated • 538k • 1.27k -
microsoft/Phi-3-mini-128k-instruct
Text Generation • 4B • Updated • 1.06M • 1.67k -
microsoft/Phi-3-medium-4k-instruct
Text Generation • 14B • Updated • 15k • 220 -
microsoft/Phi-3-medium-128k-instruct
Text Generation • 14B • Updated • 9.09k • 383
A collection of models that are able to be run using onnxruntime-genai and can be served through embeddedllm library.
Model Powered by Onnxruntime DirectML GenAI
-
EmbeddedLLM/Phi-3-mini-4k-instruct-onnx-directml
Text Generation • Updated • 3 -
EmbeddedLLM/Phi-3-mini-128k-instruct-onnx-directml
Text Generation • Updated • 4 -
EmbeddedLLM/Phi-3-medium-4k-instruct-onnx-directml
Text Generation • Updated • 6 -
EmbeddedLLM/Phi-3-medium-128k-instruct-onnx-directml
Text Generation • Updated • 4
Model Powered by Onnxruntime CPU GenAI
-
EmbeddedLLM/Phi-3-mini-4k-instruct-onnx-cpu-int4-rtn-block-32
Text Generation • Updated • 6 -
EmbeddedLLM/Phi-3-mini-4k-instruct-onnx-cpu-int4-rtn-block-32-acc-level-4
Text Generation • Updated • 3 -
EmbeddedLLM/Phi-3-mini-128k-instruct-onnx-cpu-int4-rtn-block-32
Text Generation • Updated • 4 -
EmbeddedLLM/Phi-3-mini-128k-instruct-onnx-cpu-int4-rtn-block-32-acc-level-4
Text Generation • Updated • 3
-
microsoft/Phi-3-mini-4k-instruct
Text Generation • 4B • Updated • 538k • 1.27k -
microsoft/Phi-3-mini-128k-instruct
Text Generation • 4B • Updated • 1.06M • 1.67k -
microsoft/Phi-3-medium-4k-instruct
Text Generation • 14B • Updated • 15k • 220 -
microsoft/Phi-3-medium-128k-instruct
Text Generation • 14B • Updated • 9.09k • 383
-
microsoft/Phi-3-mini-4k-instruct
Text Generation • 4B • Updated • 538k • 1.27k -
microsoft/Phi-3-mini-128k-instruct
Text Generation • 4B • Updated • 1.06M • 1.67k -
microsoft/Phi-3-medium-4k-instruct
Text Generation • 14B • Updated • 15k • 220 -
microsoft/Phi-3-medium-128k-instruct
Text Generation • 14B • Updated • 9.09k • 383
A collection of model that can be hosted using OpenVINO Model Server