Bill Psomas
commited on
Commit
·
21de5b7
1
Parent(s):
0842eeb
update readme
Browse files
README.md
CHANGED
|
@@ -18,6 +18,7 @@ tags:
|
|
| 18 |
# Self-supervised ViT-S/16 (small-sized Vision Transformer with patch size 16) model with SimPool
|
| 19 |
|
| 20 |
ViT-S model with SimPool (gamma=1.25) trained on ImageNet-1k for 100 epochs. Self-supervision with DINO.
|
|
|
|
| 21 |
SimPool is a simple attention-based pooling method at the end of network, introduced on this ICCV 2023 [paper](https://arxiv.org/pdf/2309.06891.pdf) and released in this [repository](https://github.com/billpsomas/simpool/).
|
| 22 |
Disclaimer: This model card is written by the author of SimPool, i.e. [Bill Psomas](http://users.ntua.gr/psomasbill/).
|
| 23 |
|
|
@@ -32,6 +33,9 @@ SimPool is a simple attention-based pooling mechanism as a replacement of the de
|
|
| 32 |
Interestingly, we find that, whether supervised or self-supervised, SimPool improves performance on pre-training and downstream tasks and provides attention maps delineating object boundaries in all cases.
|
| 33 |
One could thus call SimPool universal.
|
| 34 |
|
|
|
|
|
|
|
|
|
|
| 35 |
## BibTeX entry and citation info
|
| 36 |
|
| 37 |
```
|
|
|
|
| 18 |
# Self-supervised ViT-S/16 (small-sized Vision Transformer with patch size 16) model with SimPool
|
| 19 |
|
| 20 |
ViT-S model with SimPool (gamma=1.25) trained on ImageNet-1k for 100 epochs. Self-supervision with DINO.
|
| 21 |
+
|
| 22 |
SimPool is a simple attention-based pooling method at the end of network, introduced on this ICCV 2023 [paper](https://arxiv.org/pdf/2309.06891.pdf) and released in this [repository](https://github.com/billpsomas/simpool/).
|
| 23 |
Disclaimer: This model card is written by the author of SimPool, i.e. [Bill Psomas](http://users.ntua.gr/psomasbill/).
|
| 24 |
|
|
|
|
| 33 |
Interestingly, we find that, whether supervised or self-supervised, SimPool improves performance on pre-training and downstream tasks and provides attention maps delineating object boundaries in all cases.
|
| 34 |
One could thus call SimPool universal.
|
| 35 |
|
| 36 |
+
> :loudspeaker: **NOTE: Considering integrating SimPool into your workflow?**
|
| 37 |
+
> Use SimPool when you need attention maps of the highest quality, delineating object boundaries.
|
| 38 |
+
|
| 39 |
## BibTeX entry and citation info
|
| 40 |
|
| 41 |
```
|