Can't use prebuild wheels on docker hub's images
Docker image: pytorch/pytorch:2.6.0-cuda12.6-cudnn9-runtime
Wheel installs fine, but when trying to use it:
from nunchaku import NunchakuFluxTransformer2dModel
Traceback (most recent call last):
File "", line 1, in
File "/opt/conda/lib/python3.11/site-packages/nunchaku/init.py", line 1, in
from .models import NunchakuFluxTransformer2dModel, NunchakuSanaTransformer2DModel, NunchakuT5EncoderModel
File "/opt/conda/lib/python3.11/site-packages/nunchaku/models/init.py", line 1, in
from .text_encoders.t5_encoder import NunchakuT5EncoderModel
File "/opt/conda/lib/python3.11/site-packages/nunchaku/models/text_encoders/t5_encoder.py", line 12, in
from .linear import W4Linear
File "/opt/conda/lib/python3.11/site-packages/nunchaku/models/text_encoders/linear.py", line 7, in
from ..._C.ops import gemm_awq, gemv_awq
ImportError: /opt/conda/lib/python3.11/site-packages/nunchaku/_C.cpython-311-x86_64-linux-gnu.so: undefined symbol: _ZN3c106detail23torchInternalAssertFailEPKcS2_jS2_RKSs
It works fine when I build the wheel from nuchanku's sources at the container but this is inconvenient.