File size: 1,860 Bytes
43b6fa7
57f0eee
 
4934fbc
 
 
 
 
 
43b6fa7
57f0eee
43b6fa7
 
 
 
57f0eee
 
 
43b6fa7
4934fbc
57f0eee
4934fbc
43b6fa7
 
 
4934fbc
5792244
4934fbc
 
57f0eee
 
 
 
101fcdd
4934fbc
57f0eee
 
 
 
4934fbc
57f0eee
 
1010d28
57f0eee
 
f9870c4
4934fbc
57f0eee
 
d9c1cc1
f12e4a9
57f0eee
1010d28
57f0eee
 
 
 
4934fbc
57f0eee
1010d28
57f0eee
 
4934fbc
 
f42d00c
4934fbc
 
f42d00c
4934fbc
57f0eee
d9c1cc1
57f0eee
 
2e85601
083a169
57f0eee
4934fbc
 
 
 
 
 
fc4cbf8
 
 
 
37e4bae
 
 
57f0eee
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
---
language:
- en
- fr
- es
- de
- it
- pt
- ru
library_name: transformers
pipeline_tag: text-generation
---

# Model Card for Model ID

![image/png](https://cdn-uploads.huggingface.co/production/uploads/6320e992beec1969845be447/25pTrbjySoblu8cuiHASu.png)
  
  Introducing Pixie Zehir Nano.

  Excelling in creative writing.
  
  A fine tune of excellent LFM2-2.6B on HQ DATA™ from Pixie Zehir.

## Model Details

- **Developed by:** [Maani x BLNKBLK x Liquid AI]
- **Language(s) (NLP):** [English, French, Spanish, German, Italian, Portugese, Russian]
- **License:** [LFM 1.0]
- **Finetuned from model :** [LiquidAI/LFM2-2.6B]


## Agreements

Model is created for research purposes.
For licensed purposes follow LFM 1.0 licensing agreement.

## Usage

```python
pip install -qqq transformers
import torch
from transformers import pipeline

pipe = pipeline(
    "text-generation",
    model="Maani/PXZNNO",
    dtype=torch.bfloat16,
    device_map="auto",
)

prompt = "Write a haiku."
messages = [
    {"role": "user", "content": prompt},
]
prompt = pipe.tokenizer.apply_chat_template(
    messages,
    tokenize=False,
    add_generation_prompt=True
)

res = pipe(
    prompt,
    do_sample=True,
    repetition_penalty=1.05,
    max_new_tokens=4096,
    temperature=0.7,
    min_p=0.15,
    top_p=0.95,
    top_k=40 
)

print(res[0]["generated_text"])
```

```bash
#sample of output
<|startoftext|><|im_start|>user
Write a haiku.<|im_end|>
<|im_start|>assistant
Moonlight whispers low  
Stars blink like secrets told  
Silence holds the night

<|startoftext|><|im_start|>user
Write a haiku.<|im_end|>
<|im_start|>assistant
Beneath the cypher moon’s gaze
Your laugh spills through the static
I am both dream and dreamer
```

Thanks to mradermacher, You can find the GGUF quantized versions of earlier 1.8B Zehir nano at: mradermacher/PixieZehirNano-GGUF