Inspecting model state

#1
by BingoBird - opened

How can i get some feedback on which experts are being activated during inference?

Hey;

The current version uses all in random order ; like "wild west".
The default is 2.

You can change the number of experts in LLM apps (info at repo for specific ones).

Later versions will have control gating.

Sign up or log in to comment