Spaces:

OmniSVG
/

OmniSVG-3B

Running on Zero

OmniSVG commited on 21 days ago

Commit

dbc468c

verified ·

1 Parent(s): 64db0c1

Update decoder.py

Files changed (1) hide show

decoder.py CHANGED Viewed

@@ -26,8 +26,8 @@ class SketchDecoder(nn.Module):
     self.transformer = Qwen2_5_VLForConditionalGeneration.from_pretrained(
         "Qwen/Qwen2.5-VL-3B-Instruct",
         config=config,
-        #torch_dtype=torch.bfloat16, attn_implementation="flash_attention_2",
-        #device_map ="cuda",
         ignore_mismatched_sizes=True
     )

     self.transformer = Qwen2_5_VLForConditionalGeneration.from_pretrained(
         "Qwen/Qwen2.5-VL-3B-Instruct",
         config=config,
+        torch_dtype=torch.bfloat16, attn_implementation="flash_attention_2",
+        device_map ="cuda",
         ignore_mismatched_sizes=True
     )