bartowski
/

Llama-3.1-Nemotron-70B-Instruct-HF-GGUF

Text Generation

Model card Files Files and versions

Resources

View closed (1)

Compatible small models for speculative decoding?

#9 opened 12 months ago by

How many GPU ram needed?

#8 opened about 1 year ago by

q8 with 8 part

#7 opened about 1 year ago by

Q6_K vs. Q5_K_L

#6 opened about 1 year ago by

IQ2_S

#4 opened about 1 year ago by

Unable to pull in from Ollama

#3 opened about 1 year ago by

Observation: 4-bit quantization can't answer the Strawberry prompt

#2 opened about 1 year ago by

Nemotron 51B too please

#1 opened about 1 year ago by