Update README.md

README.md

@@ -11,9 +11,17 @@ license_link: https://ai.google.dev/gemma/terms
 </p>
 
 
+# ⚠️ REPO DEPRECATED ⚠️
 
-Note: If you wish to use GemMoE while it is in beta, you must flag (trust_remote_code=True) in your training/inference config.
-FlashAttention is currently required - so ensure you have the most up to date version if you're using anything other than an A100/H100
+> **NOTE:** This repo is deprecated in favor of the models found [here](https://huggingface.co/Crystalcareai/GemMoE-Base-Random/blob/main/howto.md).
+
+## Purpose of this Repo
+
+This repo purely serves to host the remote files needed to make GemMoE run with transformers. 
+
+## ❌ Training and Inference
+
+If you try to run training or inference from here, it will not work. Please refer to the new location of the models mentioned above.
 
 
 # GemMoE: An 8x8 Mixture Of Experts based on Gemma.