explosion-testing
/

falcon-test

Text Generation

text-generation-inference

Model card Files Files and versions

Daniël de Kok commited on Jul 14, 2023

Commit

24ff3d5

·

1 Parent(s): 67ecc3a

Disable new decoder architecture

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -22,7 +22,7 @@
   "initializer_range": 0.02,
   "layer_norm_epsilon": 1e-05,
   "model_type": "falcon",
-  "new_decoder_architecture": true,
   "multi_query": true,
   "num_attention_heads": 4,
   "num_hidden_layers": 5,

   "initializer_range": 0.02,
   "layer_norm_epsilon": 1e-05,
   "model_type": "falcon",
+  "new_decoder_architecture": false,
   "multi_query": true,
   "num_attention_heads": 4,
   "num_hidden_layers": 5,