runtime error

Exit code: 1. Reason: 95s/it] Downloading shards: 67%|██████▋ | 2/3 [00:21<00:10, 10.45s/it] Downloading shards: 100%|██████████| 3/3 [00:23<00:00, 6.77s/it] Downloading shards: 100%|██████████| 3/3 [00:23<00:00, 7.81s/it] Loading checkpoint shards: 0%| | 0/3 [00:00<?, ?it/s] Loading checkpoint shards: 33%|███▎ | 1/3 [00:01<00:03, 1.50s/it] Loading checkpoint shards: 67%|██████▋ | 2/3 [00:04<00:02, 2.13s/it] Loading checkpoint shards: 100%|██████████| 3/3 [00:04<00:00, 1.51s/it] Traceback (most recent call last): File "/home/user/app/app.py", line 571, in <module> main() File "/home/user/app/app.py", line 396, in main text_encoder, tokenizer, vae, model = model_main(args, master_port, 0) File "/usr/local/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context return func(*args, **kwargs) File "/home/user/app/app.py", line 121, in model_main ).eval().to("cuda") File "/usr/local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 3142, in to return super().to(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1152, in to return self._apply(convert) File "/usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 802, in _apply module._apply(fn) File "/usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 825, in _apply param_applied = fn(param) File "/usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1150, in convert return t.to(device, dtype if t.is_floating_point() or t.is_complex() else None, non_blocking) File "/usr/local/lib/python3.10/site-packages/torch/cuda/__init__.py", line 302, in _lazy_init torch._C._cuda_init() RuntimeError: Found no NVIDIA driver on your system. Please check that you have an NVIDIA GPU and installed a driver from http://www.nvidia.com/Download/index.aspx

Container logs: