Feature Extraction
sentence-transformers
PyTorch
Safetensors
Transformers
multilingual
llama_bidirec
text
text-embeddings
retrieval
semantic-search
custom_code
text-embeddings-inference
Instructions to use nvidia/llama-nemotron-embed-1b-v2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- sentence-transformers
How to use nvidia/llama-nemotron-embed-1b-v2 with sentence-transformers:
from sentence_transformers import SentenceTransformer model = SentenceTransformer("nvidia/llama-nemotron-embed-1b-v2", trust_remote_code=True) sentences = [ "The weather is lovely today.", "It's so sunny outside!", "He drove to the stadium." ] embeddings = model.encode(sentences) similarities = model.similarity(embeddings, embeddings) print(similarities.shape) # [3, 3] - Transformers
How to use nvidia/llama-nemotron-embed-1b-v2 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="nvidia/llama-nemotron-embed-1b-v2", trust_remote_code=True)# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("nvidia/llama-nemotron-embed-1b-v2", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
Oliver Holworthy commited on
Use positional bidirectional mask helper call
Browse filesCall transformers.masking_utils.create_bidirectional_mask positionally so the custom model does not depend on either the deprecated input_embeds keyword or the newer inputs_embeds spelling.
llama_bidirectional_model.py
CHANGED
|
@@ -118,9 +118,9 @@ class LlamaBidirectionalModel(LlamaModel):
|
|
| 118 |
|
| 119 |
if _HAS_NATIVE_BIDIRECTIONAL_MASK:
|
| 120 |
return create_bidirectional_mask(
|
| 121 |
-
|
| 122 |
-
|
| 123 |
-
attention_mask
|
| 124 |
)
|
| 125 |
|
| 126 |
# Fallback for transformers < 5.0 without create_bidirectional_mask
|
|
|
|
| 118 |
|
| 119 |
if _HAS_NATIVE_BIDIRECTIONAL_MASK:
|
| 120 |
return create_bidirectional_mask(
|
| 121 |
+
self.config,
|
| 122 |
+
input_embeds,
|
| 123 |
+
attention_mask,
|
| 124 |
)
|
| 125 |
|
| 126 |
# Fallback for transformers < 5.0 without create_bidirectional_mask
|