HelloMy GPU is A6000 Ada 48GB VRAM and it cannot support FP8 or AWQ-8bit varent. so I ask you to release FP6. Its accuracy is better than AWQ-4bit . Thank you.
· Sign up or log in to comment
