Updated `hidden_act` to `silu` (#74)

- Updated `hidden_act` to `silu` (2bb8ca365d155185e097ac9051e40e57bb0ee7cd)


Co-authored-by: Sergio Paniego <sergiopaniego@users.noreply.huggingface.co>

config.json

@@ -30,7 +30,7 @@
   "vision_config": {
     "attention_dropout": 0.0,
     "head_dim": 64,
-    "hidden_act": "gelu",
+    "hidden_act": "silu",
     "hidden_size": 1024,
     "image_size": 1540,
     "initializer_range": 0.02,