File size: 1,542 Bytes
41437af
 
 
 
 
 
 
 
 
 
 
ec9bb93
41437af
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44

---
pipeline_tag: sentence-similarity
language: nl
license: mit
tags:
- passage-retrieval
- sentence-similarity
- pruned
library_name: sentence-transformers
base_model: intfloat/multilingual-e5-large-instruct
base_model_relation: finetune
---
# 🇳🇱 dutch-english-multilingual-e5-large-instruct

This model is a 37.2% smaller version of [intfloat/multilingual-e5-large-instruct](https://huggingface.co/intfloat/multilingual-e5-large-instruct) 
for the Dutch language, created using the [mtem-pruner](https://huggingface.co/spaces/antoinelouis/mtem-pruner) space.

This pruned model should perform similarly to the original model for Dutch language tasks with a much smaller 
memory footprint. However, it may not perform well for other languages present in the original multilingual model as tokens not 
commonly used in Dutch were removed from the original multilingual model's vocabulary.

## Usage

You can use this model with the Transformers library:

```python
from transformers import AutoModel, AutoTokenizer

model_name = "denniscraandijk/dutch-english-multilingual-e5-large-instruct"
model = AutoModel.from_pretrained(model_name, trust_remote_code=True)
tokenizer = AutoTokenizer.from_pretrained(model_name, trust_remote_code=True, use_fast=True)
```

Or with the sentence-transformers library:

```python
from sentence_transformers import SentenceTransformer

model = SentenceTransformer("denniscraandijk/dutch-english-multilingual-e5-large-instruct")
```

**Credits**: cc [@antoinelouis](https://huggingface.co/antoinelouis)