veyra-ai/Veyra2-Blueberry-10M-Base
Text Generation • 9.98M • Updated • 737 • 6
XF LM
ExtraFlyLM
AI & ML interests
None yet
Recent Activity
liked a model 1 day ago
veyra-ai/Veyra2-Blueberry-10M-Base liked a Space 5 days ago
CodeSoft/SLM-Arena liked a model 16 days ago
GODELEV/Rose-ProOrganizations
None yet
liked a
model 1 day ago
liked a
Space 5 days ago
liked a
model 16 days ago
liked a
model 22 days ago
liked 2
models 23 days ago
reacted to KlondikeDev's post with 🔥 24 days ago
Post
2171
Boris-2 coming soon!
The Models:
Boris-2-75M: Trained on 26B tokens -- estimated to start training on August 12th.
Boris-2-125M: Trained on 90B tokens -- Estimated to start training on August 20th.
Boris-2-250M: Trained on 60B tokens -- Estimated to start training on September 10th.
Why does 125M get more tokens than 250M?
Well, the straight answer is time. It saves time, while still allowing the 250M model to exceed the 125M model.
Furthermore, we are attempting a unique architecture and layering scheme to hopefully end up around the strength of SmolLM2-135M. Fingers crossed!
We hope to end up in the ballpark of AxiomicLabs/GPT-X2.5-135M or BananaMind/BananaMind-2-Pro-Preview
Following this, we will release the Pro, Instruct and Pro-Instruct variants. More info will be coming soon!
The Models:
Boris-2-75M: Trained on 26B tokens -- estimated to start training on August 12th.
Boris-2-125M: Trained on 90B tokens -- Estimated to start training on August 20th.
Boris-2-250M: Trained on 60B tokens -- Estimated to start training on September 10th.
Why does 125M get more tokens than 250M?
Well, the straight answer is time. It saves time, while still allowing the 250M model to exceed the 125M model.
Furthermore, we are attempting a unique architecture and layering scheme to hopefully end up around the strength of SmolLM2-135M. Fingers crossed!
We hope to end up in the ballpark of AxiomicLabs/GPT-X2.5-135M or BananaMind/BananaMind-2-Pro-Preview
Following this, we will release the Pro, Instruct and Pro-Instruct variants. More info will be coming soon!
- 4 replies
reacted to Enderchef's post with 🔥👍 26 days ago
Post
3309
GPT-X2.5-135M is finally released! 🚀
The new flagship from Axiomic Labs takes 3rd on the open SLM leaderboard trailing only the SmolLMs, check it out and follow us:
AxiomicLabs/GPT-X2.5-135M
The new flagship from Axiomic Labs takes 3rd on the open SLM leaderboard trailing only the SmolLMs, check it out and follow us:
AxiomicLabs/GPT-X2.5-135M
- 2 replies
liked a
model 26 days ago
Interesting
❤️ 1
1
#4 opened 26 days ago
by ExtraFlyLM
liked a
model 29 days ago
reacted to Enderchef's post with ❤️ about 1 month ago
Post
2379
I've left Glint Research.
After a long time in Glint Research, an entire distributed training grid built free for them, and more, I've decided that I no longer want to be affiliated with Glint Research.
More updates will follow. Comments/questions are welcome.
While you're reading this, follow these orgs! Following takes just a few seconds, and can change someone's day.
AxiomicLabs
fromziro
SupraLabs
After a long time in Glint Research, an entire distributed training grid built free for them, and more, I've decided that I no longer want to be affiliated with Glint Research.
More updates will follow. Comments/questions are welcome.
While you're reading this, follow these orgs! Following takes just a few seconds, and can change someone's day.
- 2 replies
Training
1
#2 opened about 1 month ago
by ExtraFlyLM
liked a
model about 2 months ago
Next model?
4
#1 opened 2 months ago
by ExtraFlyLM
liked 2
models 2 months ago
What is the efficiency score?
1
#29 opened 2 months ago
by ExtraFlyLM
liked a
model 2 months ago