Update README.md
Browse files
README.md
CHANGED
|
@@ -1481,7 +1481,7 @@ language:
|
|
| 1481 |
|
| 1482 |
# [bilingual-embedding-large](https://huggingface.co/Lajavaness/bilingual-embedding-large)
|
| 1483 |
|
| 1484 |
-
|
| 1485 |
|
| 1486 |
|
| 1487 |
## Full Model Architecture
|
|
@@ -1501,7 +1501,7 @@ SentenceTransformer(
|
|
| 1501 |
- Dataset: [STSB-fr and en]
|
| 1502 |
- Method: Fine-tuning specifically for the semantic textual similarity benchmark using Siamese BERT-Networks configured with the 'sentence-transformers' library.
|
| 1503 |
### Stage 4: Advanced Augmentation Fine-tuning
|
| 1504 |
-
- Dataset: STSB
|
| 1505 |
- Method: Employed an advanced strategy using [Augmented SBERT](https://arxiv.org/abs/2010.08240) with Pair Sampling Strategies, integrating both Cross-Encoder and Bi-Encoder models. This stage further refined the embeddings by enriching the training data dynamically, enhancing the model's robustness and accuracy.
|
| 1506 |
|
| 1507 |
|
|
@@ -1517,7 +1517,6 @@ Then you can use the model like this:
|
|
| 1517 |
|
| 1518 |
```python
|
| 1519 |
from sentence_transformers import SentenceTransformer
|
| 1520 |
-
from pyvi.ViTokenizer import tokenize
|
| 1521 |
|
| 1522 |
sentences = ["Paris est une capitale de la France", "Paris is a capital of France"]
|
| 1523 |
|
|
|
|
| 1481 |
|
| 1482 |
# [bilingual-embedding-large](https://huggingface.co/Lajavaness/bilingual-embedding-large)
|
| 1483 |
|
| 1484 |
+
Bilingual-embedding is the Embedding Model for bilingual language: french and english. This model is a specialized sentence-embedding trained specifically for the bilingual language, leveraging the robust capabilities of [XLM-RoBERTa](https://huggingface.co/FacebookAI/xlm-roberta-large), a pre-trained language model based on the [XLM-RoBERTa](https://huggingface.co/FacebookAI/xlm-roberta-large) architecture. The model utilizes xlm-roberta to encode english-french sentences into a 1024-dimensional vector space, facilitating a wide range of applications from semantic search to text clustering. The embeddings capture the nuanced meanings of english-french sentences, reflecting both the lexical and contextual layers of the language.
|
| 1485 |
|
| 1486 |
|
| 1487 |
## Full Model Architecture
|
|
|
|
| 1501 |
- Dataset: [STSB-fr and en]
|
| 1502 |
- Method: Fine-tuning specifically for the semantic textual similarity benchmark using Siamese BERT-Networks configured with the 'sentence-transformers' library.
|
| 1503 |
### Stage 4: Advanced Augmentation Fine-tuning
|
| 1504 |
+
- Dataset: STSB with generate [silver sample from gold sample](https://www.sbert.net/examples/training/data_augmentation/README.html)
|
| 1505 |
- Method: Employed an advanced strategy using [Augmented SBERT](https://arxiv.org/abs/2010.08240) with Pair Sampling Strategies, integrating both Cross-Encoder and Bi-Encoder models. This stage further refined the embeddings by enriching the training data dynamically, enhancing the model's robustness and accuracy.
|
| 1506 |
|
| 1507 |
|
|
|
|
| 1517 |
|
| 1518 |
```python
|
| 1519 |
from sentence_transformers import SentenceTransformer
|
|
|
|
| 1520 |
|
| 1521 |
sentences = ["Paris est une capitale de la France", "Paris is a capital of France"]
|
| 1522 |
|