wyldecat's picture
feat(muon): add test for muon
3261444
# Muon Optimizer Test
This directory contains a test script for the **Muon optimizer**.
To execute the test, simply run:
```bash
# By default, the test will use 8 GPUs.
./run_test.sh
```
The number of GPUs can be controlled with the NGPU environment variable.
For example, to run with 4 GPUs:
```bash
NGPU=4 ./run_test.sh
```
## Limitations:
- Multi-node execution is not supported yet.
- Ensure that the specified number of GPUs is available on your machine before running.