How to use neilmehta24/janus-pro-7b-4bit with Transformers:
# Load model directly from transformers import MultiModalityCausalLM model = MultiModalityCausalLM.from_pretrained("neilmehta24/janus-pro-7b-4bit", dtype="auto")
