Hey, sorry if it's a dumb question but I'm new to this, does this model support NF4 quant for inference too or only training?
· Sign up or log in to comment
