Bill Psomas commited on
Commit
21de5b7
·
1 Parent(s): 0842eeb

update readme

Browse files
Files changed (1) hide show
  1. README.md +4 -0
README.md CHANGED
@@ -18,6 +18,7 @@ tags:
18
  # Self-supervised ViT-S/16 (small-sized Vision Transformer with patch size 16) model with SimPool
19
 
20
  ViT-S model with SimPool (gamma=1.25) trained on ImageNet-1k for 100 epochs. Self-supervision with DINO.
 
21
  SimPool is a simple attention-based pooling method at the end of network, introduced on this ICCV 2023 [paper](https://arxiv.org/pdf/2309.06891.pdf) and released in this [repository](https://github.com/billpsomas/simpool/).
22
  Disclaimer: This model card is written by the author of SimPool, i.e. [Bill Psomas](http://users.ntua.gr/psomasbill/).
23
 
@@ -32,6 +33,9 @@ SimPool is a simple attention-based pooling mechanism as a replacement of the de
32
  Interestingly, we find that, whether supervised or self-supervised, SimPool improves performance on pre-training and downstream tasks and provides attention maps delineating object boundaries in all cases.
33
  One could thus call SimPool universal.
34
 
 
 
 
35
  ## BibTeX entry and citation info
36
 
37
  ```
 
18
  # Self-supervised ViT-S/16 (small-sized Vision Transformer with patch size 16) model with SimPool
19
 
20
  ViT-S model with SimPool (gamma=1.25) trained on ImageNet-1k for 100 epochs. Self-supervision with DINO.
21
+
22
  SimPool is a simple attention-based pooling method at the end of network, introduced on this ICCV 2023 [paper](https://arxiv.org/pdf/2309.06891.pdf) and released in this [repository](https://github.com/billpsomas/simpool/).
23
  Disclaimer: This model card is written by the author of SimPool, i.e. [Bill Psomas](http://users.ntua.gr/psomasbill/).
24
 
 
33
  Interestingly, we find that, whether supervised or self-supervised, SimPool improves performance on pre-training and downstream tasks and provides attention maps delineating object boundaries in all cases.
34
  One could thus call SimPool universal.
35
 
36
+ > :loudspeaker: **NOTE: Considering integrating SimPool into your workflow?**
37
+ > Use SimPool when you need attention maps of the highest quality, delineating object boundaries.
38
+
39
  ## BibTeX entry and citation info
40
 
41
  ```