runtime error
Exit code: 1. Reason: benchmarker() File "/usr/local/lib/python3.10/site-packages/triton/runtime/driver.py", line 23, in __getattr__ self._initialize_obj() File "/usr/local/lib/python3.10/site-packages/triton/runtime/driver.py", line 20, in _initialize_obj self._obj = self._init_fn() File "/usr/local/lib/python3.10/site-packages/triton/runtime/driver.py", line 8, in _create_driver raise RuntimeError(f"{len(actives)} active drivers ({actives}). There should only be one.") RuntimeError: 0 active drivers ([]). There should only be one. The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/user/app/app.py", line 4, in <module> pipeline = pipeline(task="image-classification", model="unsloth/Llama-3.2-11B-Vision-Instruct-unsloth-bnb-4bit") File "/usr/local/lib/python3.10/site-packages/transformers/pipelines/__init__.py", line 940, in pipeline framework, model = infer_framework_load_model( File "/usr/local/lib/python3.10/site-packages/transformers/pipelines/base.py", line 289, in infer_framework_load_model model = model_class.from_pretrained(model, **kwargs) File "/usr/local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 3620, in from_pretrained hf_quantizer.validate_environment( File "/usr/local/lib/python3.10/site-packages/transformers/quantizers/quantizer_bnb_4bit.py", line 79, in validate_environment from ..integrations import validate_bnb_backend_availability File "<frozen importlib._bootstrap>", line 1075, in _handle_fromlist File "/usr/local/lib/python3.10/site-packages/transformers/utils/import_utils.py", line 1805, in __getattr__ module = self._get_module(self._class_to_module[name]) File "/usr/local/lib/python3.10/site-packages/transformers/utils/import_utils.py", line 1819, in _get_module raise RuntimeError( RuntimeError: Failed to import transformers.integrations.bitsandbytes because of the following error (look up to see its traceback): 0 active drivers ([]). There should only be one.
Container logs:
Fetching error logs...