Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -8,13 +8,13 @@ tags:
|
|
| 8 |
license: apache-2.0
|
| 9 |
---
|
| 10 |
|
| 11 |
-
# Qwen2-7B-embed-base
|
| 12 |
|
| 13 |
-
This is a base model derived from Qwen2.5-7B
|
| 14 |
It's intended to be used as a base for embedding tasks and further fine-tuning.
|
| 15 |
|
| 16 |
## Model Details
|
| 17 |
-
- Base model: Qwen2.5-7B
|
| 18 |
- The 'lm_head' layer has been removed
|
| 19 |
- Maintains the original model's norm layers
|
| 20 |
- Suitable for embedding tasks and custom head additions
|
|
|
|
| 8 |
license: apache-2.0
|
| 9 |
---
|
| 10 |
|
| 11 |
+
# Qwen2.5-7B-embed-base
|
| 12 |
|
| 13 |
+
This is a base model derived from Qwen2.5-7B with the language modeling head removed.
|
| 14 |
It's intended to be used as a base for embedding tasks and further fine-tuning.
|
| 15 |
|
| 16 |
## Model Details
|
| 17 |
+
- Base model: Qwen2.5-7B
|
| 18 |
- The 'lm_head' layer has been removed
|
| 19 |
- Maintains the original model's norm layers
|
| 20 |
- Suitable for embedding tasks and custom head additions
|