KomeijiForce commited on
Commit
42859f1
·
verified ·
1 Parent(s): 9950d4e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -0
README.md CHANGED
@@ -6,6 +6,8 @@ license: apache-2.0
6
 
7
  # Cuckoo 🐦 [[Github]](https://github.com/KomeijiForce/Cuckoo)
8
 
 
 
9
  [Cuckoo: An IE Free Rider Hatched by Massive Nutrition in LLM's Nest](https://huggingface.co/papers/2502.11275) is a small (300M) information extraction (IE) model that imitates the next token prediction paradigm of large language models. Instead of retrieving from the vocabulary, Cuckoo predicts the next tokens by tagging them in the given input context as shown below:
10
 
11
  ![cuckoo](https://github.com/user-attachments/assets/d000f275-82a7-4939-aca8-341c61a774dc)
 
6
 
7
  # Cuckoo 🐦 [[Github]](https://github.com/KomeijiForce/Cuckoo)
8
 
9
+ *(This is a DeBERTaV3-Large based Cuckoo, which removes the context window limitation of the original RoBERTa based Cuckoo)*
10
+
11
  [Cuckoo: An IE Free Rider Hatched by Massive Nutrition in LLM's Nest](https://huggingface.co/papers/2502.11275) is a small (300M) information extraction (IE) model that imitates the next token prediction paradigm of large language models. Instead of retrieving from the vocabulary, Cuckoo predicts the next tokens by tagging them in the given input context as shown below:
12
 
13
  ![cuckoo](https://github.com/user-attachments/assets/d000f275-82a7-4939-aca8-341c61a774dc)