Spaces:
Running
Running
Update README.md
Browse files
README.md
CHANGED
@@ -29,4 +29,4 @@ More info soon
|
|
29 |
We are working on complete Reactive Neural Networks development framework - [RxNN github](https://github.com/RxAI-dev/RxNN)
|
30 |
|
31 |
## Additional Research
|
32 |
-
- **Sparse Query Attention** - the most cost-effective GQA variant, reducing training time/cost by ~10
|
|
|
29 |
We are working on complete Reactive Neural Networks development framework - [RxNN github](https://github.com/RxAI-dev/RxNN)
|
30 |
|
31 |
## Additional Research
|
32 |
+
- **Sparse Query Attention** - the most cost-effective GQA variant, reducing training time/cost by ~3-10% with similar performance. Research in progress
|