Instructions to use UCSC-VLAA/openvision2-vit-huge-patch14-336-vision-only with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- OpenCLIP
How to use UCSC-VLAA/openvision2-vit-huge-patch14-336-vision-only with OpenCLIP:
import open_clip model, preprocess_train, preprocess_val = open_clip.create_model_and_transforms('hf-hub:UCSC-VLAA/openvision2-vit-huge-patch14-336-vision-only') tokenizer = open_clip.get_tokenizer('hf-hub:UCSC-VLAA/openvision2-vit-huge-patch14-336-vision-only') - Notebooks
- Google Colab
- Kaggle
Add model card for OpenVision 2
#1
by nielsr HF Staff - opened
This PR adds a comprehensive model card for the OpenVision 2 model.
It includes:
- The
pipeline_tag: image-text-to-textto ensure proper discoverability on the Hugging Face Hub. - A clear description of the model based on its abstract.
- A link to its associated paper OpenVision 2: A Family of Generative Pretrained Visual Encoders for Multimodal Learning.
- Links to the project page (https://ucsc-vlaa.github.io/OpenVision2/) and the GitHub repository (https://github.com/UCSC-VLAA/OpenVision/blob/main/src/main_openvision2.py) for further details and code.
Please review and merge this PR if everything looks good!