Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[BUG] pip install ... Running setup.py install for gptqmodel ... error #1330

Open
git9875 opened this issue Feb 22, 2025 · 1 comment
Open

[BUG] pip install ... Running setup.py install for gptqmodel ... error #1330

git9875 opened this issue Feb 22, 2025 · 1 comment
Labels
bug Something isn't working

Comments

@git9875
Copy link

git9875 commented Feb 22, 2025

Describe the bug
Trying to install gptqmodel with pip.

python -m venv .venv_cuda
. .\.venv_cuda\Scripts\activate
pip3 install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu124
pip install -v gptqmodel --no-build-isolation

Using pip 23.0.1 from D:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\lib\site-packages\pip (python 3.10)
Collecting gptqmodel
  Using cached gptqmodel-1.9.0.tar.gz (213 kB)
  Running command python setup.py egg_info
  Both latest setuptools and wheel package are not found.  Please upgrade to latest setuptools: `pip install -U setuptools`
  error: subprocess-exited-with-error

  × python setup.py egg_info did not run successfully.
  │ exit code: 1

  note: This error originates from a subprocess, and is likely not a problem with pip.
  full command: 'D:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\Scripts\python.exe' -c '
  exec(compile('"'"''"'"''"'"'
  # This is <pip-setuptools-caller> -- a caller that pip uses to run setup.py
  #
  # - It imports setuptools before invoking setup.py, to enable projects that directly
  #   import from `distutils.core` to work with newer packaging standards.
  # - It provides a clear error message when setuptools is not installed.
  # - It sets `sys.argv[0]` to the underlying `setup.py`, when invoking `setup.py` so
  #   setuptools doesn'"'"'t think the script is `-c`. This avoids the following warning:
  #     manifest_maker: standard file '"'"'-c'"'"' not found".
  # - It generates a shim setup.py, for handling setup.cfg-only projects.
  import os, sys, tokenize

  try:
      import setuptools
  except ImportError as error:
      print(
          "ERROR: Can not execute `setup.py` since setuptools is not available in "
          "the build environment.",
          file=sys.stderr,
      )
      sys.exit(1)

  __file__ = %r
  sys.argv[0] = __file__

  if os.path.exists(__file__):
      filename = __file__
      with tokenize.open(__file__) as f:
          setup_py_code = f.read()
  else:
      filename = "<auto-generated setuptools caller>"
      setup_py_code = "from setuptools import setup; setup()"

  exec(compile(setup_py_code, filename, "exec"))
  '"'"''"'"''"'"' % ('"'"'C:\\Users\\searo\\AppData\\Local\\Temp\\pip-install-7ld4v3ne\\gptqmodel_9e777b9bf79c4d66aabef0ec3d2c004c\\setup.py'"'"',), "<pip-setuptools-caller>", "exec"))' egg_info --egg-base 'C:\Users\searo\AppData\Local\Temp\pip-pip-egg-info-l2qvb9j8'
  cwd: C:\Users\searo\AppData\Local\Temp\pip-install-7ld4v3ne\gptqmodel_9e777b9bf79c4d66aabef0ec3d2c004c\
  Preparing metadata (setup.py) ... error
error: metadata-generation-failed

× Encountered error while generating package metadata.
╰─> See above for output.

note: This is an issue with the package mentioned above, not pip.
hint: See above for details.

Second attempt:

pip install -U setuptools

Requirement already satisfied: setuptools in d:\dev_projects\test_storyboard_tools\story_cowriter.venv_cuda\lib\site-packages (65.5.0)
Collecting setuptools
Using cached setuptools-75.8.0-py3-none-any.whl (1.2 MB)
Installing collected packages: setuptools
Attempting uninstall: setuptools
Found existing installation: setuptools 65.5.0
Uninstalling setuptools-65.5.0:
Successfully uninstalled setuptools-65.5.0
Successfully installed setuptools-75.8.0

pip install -v gptqmodel --no-build-isolation

Using pip 23.0.1 from D:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\lib\site-packages\pip (python 3.10)
Collecting gptqmodel
  Using cached gptqmodel-1.9.0.tar.gz (213 kB)
  Running command python setup.py egg_info
  conda_cuda_include_dir D:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\Lib\site-packages\nvidia/cuda_runtime/include
  running egg_info
  creating C:\Users\searo\AppData\Local\Temp\pip-pip-egg-info-71o_r41m\gptqmodel.egg-info
  writing C:\Users\searo\AppData\Local\Temp\pip-pip-egg-info-71o_r41m\gptqmodel.egg-info\PKG-INFO
  writing dependency_links to C:\Users\searo\AppData\Local\Temp\pip-pip-egg-info-71o_r41m\gptqmodel.egg-info\dependency_links.txt
  writing requirements to C:\Users\searo\AppData\Local\Temp\pip-pip-egg-info-71o_r41m\gptqmodel.egg-info\requires.txt
  writing top-level names to C:\Users\searo\AppData\Local\Temp\pip-pip-egg-info-71o_r41m\gptqmodel.egg-info\top_level.txt
  writing manifest file 'C:\Users\searo\AppData\Local\Temp\pip-pip-egg-info-71o_r41m\gptqmodel.egg-info\SOURCES.txt'
  D:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\lib\site-packages\torch\utils\cpp_extension.py:497: UserWarning: Attempted to use ninja as the BuildExtension backend but we could not find ninja.. Falling back to using the slow distutils backend.
    warnings.warn(msg.format('we could not find ninja.'))
  reading manifest file 'C:\Users\searo\AppData\Local\Temp\pip-pip-egg-info-71o_r41m\gptqmodel.egg-info\SOURCES.txt'
  reading manifest template 'MANIFEST.in'
  warning: no files found matching 'gptqmodel_ext\**\*.py' anywhere in distribution
  adding license file 'LICENSE'
  writing manifest file 'C:\Users\searo\AppData\Local\Temp\pip-pip-egg-info-71o_r41m\gptqmodel.egg-info\SOURCES.txt'
  Preparing metadata (setup.py) ... done
Collecting accelerate>=1.3.0
  Using cached accelerate-1.4.0-py3-none-any.whl (342 kB)
Collecting datasets>=3.2.0
  Using cached datasets-3.3.2-py3-none-any.whl (485 kB)
Collecting numpy>=2.2.2
  Using cached numpy-2.2.3-cp310-cp310-win_amd64.whl (12.9 MB)
Requirement already satisfied: torch>=2.2.0 in d:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\lib\site-packages (from gptqmodel) (2.5.1+cu124)
Collecting safetensors>=0.5.2
  Using cached safetensors-0.5.2-cp38-abi3-win_amd64.whl (303 kB)
Collecting transformers>=4.48.3
  Using cached transformers-4.49.0-py3-none-any.whl (10.0 MB)
Collecting threadpoolctl>=3.5.0
  Using cached threadpoolctl-3.5.0-py3-none-any.whl (18 kB)
Collecting packaging>=24.2
  Using cached packaging-24.2-py3-none-any.whl (65 kB)
Collecting device-smi==0.3.3
  Using cached device_smi-0.3.3.tar.gz (15 kB)
  Running command python setup.py egg_info
  D:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\lib\site-packages\setuptools\_distutils\dist.py:270: UserWarning: Unknown distribution option: 'platform'
    warnings.warn(msg)
  running egg_info
  creating C:\Users\searo\AppData\Local\Temp\pip-pip-egg-info-dha3uvgx\device_smi.egg-info
  writing C:\Users\searo\AppData\Local\Temp\pip-pip-egg-info-dha3uvgx\device_smi.egg-info\PKG-INFO
  writing dependency_links to C:\Users\searo\AppData\Local\Temp\pip-pip-egg-info-dha3uvgx\device_smi.egg-info\dependency_links.txt
  writing top-level names to C:\Users\searo\AppData\Local\Temp\pip-pip-egg-info-dha3uvgx\device_smi.egg-info\top_level.txt
  writing manifest file 'C:\Users\searo\AppData\Local\Temp\pip-pip-egg-info-dha3uvgx\device_smi.egg-info\SOURCES.txt'
  reading manifest file 'C:\Users\searo\AppData\Local\Temp\pip-pip-egg-info-dha3uvgx\device_smi.egg-info\SOURCES.txt'
  adding license file 'LICENSE'
  writing manifest file 'C:\Users\searo\AppData\Local\Temp\pip-pip-egg-info-dha3uvgx\device_smi.egg-info\SOURCES.txt'
  Preparing metadata (setup.py) ... done
Collecting protobuf>=5.29.3
  Using cached protobuf-5.29.3-cp310-abi3-win_amd64.whl (434 kB)
Collecting pillow>=11.1.0
  Using cached pillow-11.1.0-cp310-cp310-win_amd64.whl (2.6 MB)
Collecting hf_transfer>=0.1.9
  Using cached hf_transfer-0.1.9-cp38-abi3-win_amd64.whl (1.2 MB)
Collecting huggingface_hub>=0.28.1
  Using cached huggingface_hub-0.29.1-py3-none-any.whl (468 kB)
Collecting tokenicer>=0.0.2
  Using cached tokenicer-0.0.4.tar.gz (10 kB)
  Running command python setup.py egg_info
  D:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\lib\site-packages\setuptools\_distutils\dist.py:270: UserWarning: Unknown distribution option: 'platform'
    warnings.warn(msg)
  running egg_info
  creating C:\Users\searo\AppData\Local\Temp\pip-pip-egg-info-e4qfczq1\tokenicer.egg-info
  writing C:\Users\searo\AppData\Local\Temp\pip-pip-egg-info-e4qfczq1\tokenicer.egg-info\PKG-INFO
  writing dependency_links to C:\Users\searo\AppData\Local\Temp\pip-pip-egg-info-e4qfczq1\tokenicer.egg-info\dependency_links.txt
  writing requirements to C:\Users\searo\AppData\Local\Temp\pip-pip-egg-info-e4qfczq1\tokenicer.egg-info\requires.txt
  writing top-level names to C:\Users\searo\AppData\Local\Temp\pip-pip-egg-info-e4qfczq1\tokenicer.egg-info\top_level.txt
  writing manifest file 'C:\Users\searo\AppData\Local\Temp\pip-pip-egg-info-e4qfczq1\tokenicer.egg-info\SOURCES.txt'
  reading manifest file 'C:\Users\searo\AppData\Local\Temp\pip-pip-egg-info-e4qfczq1\tokenicer.egg-info\SOURCES.txt'
  reading manifest template 'MANIFEST.in'
  no previously-included directories found matching 'tests'
  adding license file 'LICENSE'
  writing manifest file 'C:\Users\searo\AppData\Local\Temp\pip-pip-egg-info-e4qfczq1\tokenicer.egg-info\SOURCES.txt'
  Preparing metadata (setup.py) ... done
Collecting pyyaml
  Using cached PyYAML-6.0.2-cp310-cp310-win_amd64.whl (161 kB)
Collecting psutil
  Using cached psutil-7.0.0-cp37-abi3-win_amd64.whl (244 kB)
Requirement already satisfied: filelock in d:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\lib\site-packages (from datasets>=3.2.0->gptqmodel) (3.13.1)
Collecting dill<0.3.9,>=0.3.0
  Using cached dill-0.3.8-py3-none-any.whl (116 kB)
Requirement already satisfied: fsspec[http]<=2024.12.0,>=2023.1.0 in d:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\lib\site-packages (from datasets>=3.2.0->gptqmodel) (2024.6.1)
Collecting multiprocess<0.70.17
  Using cached multiprocess-0.70.16-py310-none-any.whl (134 kB)
Collecting pandas
  Using cached pandas-2.2.3-cp310-cp310-win_amd64.whl (11.6 MB)
Collecting pyarrow>=15.0.0
  Using cached pyarrow-19.0.1-cp310-cp310-win_amd64.whl (25.3 MB)
Collecting aiohttp
  Using cached aiohttp-3.11.12-cp310-cp310-win_amd64.whl (442 kB)
Collecting requests>=2.32.2
  Using cached requests-2.32.3-py3-none-any.whl (64 kB)
Collecting tqdm>=4.66.3
  Using cached tqdm-4.67.1-py3-none-any.whl (78 kB)
Collecting xxhash
  Using cached xxhash-3.5.0-cp310-cp310-win_amd64.whl (30 kB)
Requirement already satisfied: typing-extensions>=3.7.4.3 in d:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\lib\site-packages (from huggingface_hub>=0.28.1->gptqmodel) (4.9.0)
Requirement already satisfied: networkx in d:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\lib\site-packages (from torch>=2.2.0->gptqmodel) (3.3)
Requirement already satisfied: sympy==1.13.1 in d:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\lib\site-packages (from torch>=2.2.0->gptqmodel) (1.13.1)
Requirement already satisfied: jinja2 in d:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\lib\site-packages (from torch>=2.2.0->gptqmodel) (3.1.3)
Requirement already satisfied: mpmath<1.4,>=1.1.0 in d:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\lib\site-packages (from sympy==1.13.1->torch>=2.2.0->gptqmodel) (1.3.0)
Collecting regex!=2019.12.17
  Using cached regex-2024.11.6-cp310-cp310-win_amd64.whl (274 kB)
Collecting tokenizers<0.22,>=0.21
  Using cached tokenizers-0.21.0-cp39-abi3-win_amd64.whl (2.4 MB)
Collecting multidict<7.0,>=4.5
  Using cached multidict-6.1.0-cp310-cp310-win_amd64.whl (28 kB)
Collecting aiohappyeyeballs>=2.3.0
  Using cached aiohappyeyeballs-2.4.6-py3-none-any.whl (14 kB)
Collecting async-timeout<6.0,>=4.0
  Using cached async_timeout-5.0.1-py3-none-any.whl (6.2 kB)
Collecting propcache>=0.2.0
  Using cached propcache-0.3.0-cp310-cp310-win_amd64.whl (44 kB)
Collecting yarl<2.0,>=1.17.0
  Using cached yarl-1.18.3-cp310-cp310-win_amd64.whl (90 kB)
Collecting aiosignal>=1.1.2
  Using cached aiosignal-1.3.2-py2.py3-none-any.whl (7.6 kB)
Collecting frozenlist>=1.1.1
  Using cached frozenlist-1.5.0-cp310-cp310-win_amd64.whl (51 kB)
Collecting attrs>=17.3.0
  Using cached attrs-25.1.0-py3-none-any.whl (63 kB)
Collecting idna<4,>=2.5
  Using cached idna-3.10-py3-none-any.whl (70 kB)
Collecting urllib3<3,>=1.21.1
  Using cached urllib3-2.3.0-py3-none-any.whl (128 kB)
Collecting certifi>=2017.4.17
  Using cached certifi-2025.1.31-py3-none-any.whl (166 kB)
Collecting charset-normalizer<4,>=2
  Using cached charset_normalizer-3.4.1-cp310-cp310-win_amd64.whl (102 kB)
Collecting colorama
  Using cached colorama-0.4.6-py2.py3-none-any.whl (25 kB)
Requirement already satisfied: MarkupSafe>=2.0 in d:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\lib\site-packages (from jinja2->torch>=2.2.0->gptqmodel) (2.1.5)
Collecting tzdata>=2022.7
  Using cached tzdata-2025.1-py2.py3-none-any.whl (346 kB)
Collecting pytz>=2020.1
  Using cached pytz-2025.1-py2.py3-none-any.whl (507 kB)
Collecting python-dateutil>=2.8.2
  Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB)
Collecting six>=1.5
  Using cached six-1.17.0-py2.py3-none-any.whl (11 kB)
Installing collected packages: pytz, xxhash, urllib3, tzdata, threadpoolctl, six, safetensors, regex, pyyaml, pyarrow, psutil, protobuf, propcache, pillow, packaging, numpy, multidict, idna, hf_transfer, frozenlist, dill, device-smi, colorama, charset-normalizer, certifi, attrs, async-timeout, aiohappyeyeballs, yarl, tqdm, requests, python-dateutil, multiprocess, aiosignal, pandas, huggingface_hub, aiohttp, tokenizers, accelerate, transformers, datasets, tokenicer, gptqmodel
  Attempting uninstall: pillow
    Found existing installation: pillow 11.0.0
    Uninstalling pillow-11.0.0:
      Removing file or directory d:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\lib\site-packages\pil\
      Removing file or directory d:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\lib\site-packages\pillow-11.0.0.dist-info\
      Successfully uninstalled pillow-11.0.0
  Attempting uninstall: numpy
    Found existing installation: numpy 2.1.2
    Uninstalling numpy-2.1.2:
      Removing file or directory d:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\lib\site-packages\numpy-2.1.2-cp310-cp310-win_amd64.whl
      Removing file or directory d:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\lib\site-packages\numpy-2.1.2.dist-info\
      Removing file or directory d:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\lib\site-packages\numpy.libs\
      Removing file or directory d:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\lib\site-packages\numpy\
      Removing file or directory d:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\scripts\f2py.exe
      Removing file or directory d:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\scripts\numpy-config.exe
      Successfully uninstalled numpy-2.1.2
  DEPRECATION: device-smi is being installed using the legacy 'setup.py install' method, because it does not have a 'pyproject.toml' and the 'wheel' package is not installed. pip 23.1 will enforce this behaviour change. A possible replacement is to enable the '--use-pep517' option. Discussion can be found at https://github.com/pypa/pip/issues/8559
  Running command Running setup.py install for device-smi
  D:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\lib\site-packages\setuptools\_distutils\dist.py:270: UserWarning: Unknown distribution option: 'platform'
    warnings.warn(msg)
  running install
  D:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\lib\site-packages\setuptools\_distutils\cmd.py:79: SetuptoolsDeprecationWarning: setup.py install is deprecated.
  !!

          ********************************************************************************
          Please avoid running ``setup.py`` directly.
          Instead, use pypa/build, pypa/installer or other
          standards-based tools.

          See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
          ********************************************************************************

  !!
    self.initialize_options()
  running build
  running build_py
  creating build\lib\device_smi
  copying device_smi\apple.py -> build\lib\device_smi
  copying device_smi\base.py -> build\lib\device_smi
  copying device_smi\cpu.py -> build\lib\device_smi
  copying device_smi\device.py -> build\lib\device_smi
  copying device_smi\intel.py -> build\lib\device_smi
  copying device_smi\nvidia.py -> build\lib\device_smi
  copying device_smi\os.py -> build\lib\device_smi
  copying device_smi\__init__.py -> build\lib\device_smi
  running install_lib
  creating D:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\Lib\site-packages\device_smi
  copying build\lib\device_smi\apple.py -> D:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\Lib\site-packages\device_smi
  copying build\lib\device_smi\base.py -> D:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\Lib\site-packages\device_smi
  copying build\lib\device_smi\cpu.py -> D:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\Lib\site-packages\device_smi
  copying build\lib\device_smi\device.py -> D:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\Lib\site-packages\device_smi
  copying build\lib\device_smi\intel.py -> D:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\Lib\site-packages\device_smi
  copying build\lib\device_smi\nvidia.py -> D:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\Lib\site-packages\device_smi
  copying build\lib\device_smi\os.py -> D:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\Lib\site-packages\device_smi
  copying build\lib\device_smi\__init__.py -> D:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\Lib\site-packages\device_smi
  byte-compiling D:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\Lib\site-packages\device_smi\apple.py to apple.cpython-310.pyc
  byte-compiling D:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\Lib\site-packages\device_smi\base.py to base.cpython-310.pyc
  byte-compiling D:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\Lib\site-packages\device_smi\cpu.py to cpu.cpython-310.pyc
  byte-compiling D:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\Lib\site-packages\device_smi\device.py to device.cpython-310.pyc
  byte-compiling D:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\Lib\site-packages\device_smi\intel.py to intel.cpython-310.pyc
  byte-compiling D:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\Lib\site-packages\device_smi\nvidia.py to nvidia.cpython-310.pyc
  byte-compiling D:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\Lib\site-packages\device_smi\os.py to os.cpython-310.pyc
  byte-compiling D:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\Lib\site-packages\device_smi\__init__.py to __init__.cpython-310.pyc
  running install_egg_info
  running egg_info
  writing device_smi.egg-info\PKG-INFO
  writing dependency_links to device_smi.egg-info\dependency_links.txt
  writing top-level names to device_smi.egg-info\top_level.txt
  reading manifest file 'device_smi.egg-info\SOURCES.txt'
  adding license file 'LICENSE'
  writing manifest file 'device_smi.egg-info\SOURCES.txt'
  Copying device_smi.egg-info to D:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\Lib\site-packages\device_smi-0.3.3-py3.10.egg-info
  running install_scripts
  writing list of installed files to 'C:\Users\searo\AppData\Local\Temp\pip-record-phfd4kc5\install-record.txt'
  Running setup.py install for device-smi ... done
  DEPRECATION: tokenicer is being installed using the legacy 'setup.py install' method, because it does not have a 'pyproject.toml' and the 'wheel' package is not installed. pip 23.1 will enforce this behaviour change. A possible replacement is to enable the '--use-pep517' option. Discussion can be found at https://github.com/pypa/pip/issues/8559
  Running command Running setup.py install for tokenicer
  D:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\lib\site-packages\setuptools\_distutils\dist.py:270: UserWarning: Unknown distribution option: 'platform'
    warnings.warn(msg)
  running install
  D:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\lib\site-packages\setuptools\_distutils\cmd.py:79: SetuptoolsDeprecationWarning: setup.py install is deprecated.
  !!

          ********************************************************************************
          Please avoid running ``setup.py`` directly.
          Instead, use pypa/build, pypa/installer or other
          standards-based tools.

          See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
          ********************************************************************************

  !!
    self.initialize_options()
  running build
  running build_py
  creating build\lib\tokenicer
  copying tokenicer\const.py -> build\lib\tokenicer
  copying tokenicer\tokenicer.py -> build\lib\tokenicer
  copying tokenicer\util.py -> build\lib\tokenicer
  copying tokenicer\__init__.py -> build\lib\tokenicer
  running install_lib
  creating D:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\Lib\site-packages\tokenicer
  copying build\lib\tokenicer\const.py -> D:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\Lib\site-packages\tokenicer
  copying build\lib\tokenicer\tokenicer.py -> D:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\Lib\site-packages\tokenicer
  copying build\lib\tokenicer\util.py -> D:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\Lib\site-packages\tokenicer
  copying build\lib\tokenicer\__init__.py -> D:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\Lib\site-packages\tokenicer
  byte-compiling D:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\Lib\site-packages\tokenicer\const.py to const.cpython-310.pyc
  byte-compiling D:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\Lib\site-packages\tokenicer\tokenicer.py to tokenicer.cpython-310.pyc
  byte-compiling D:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\Lib\site-packages\tokenicer\util.py to util.cpython-310.pyc
  byte-compiling D:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\Lib\site-packages\tokenicer\__init__.py to __init__.cpython-310.pyc
  running install_egg_info
  running egg_info
  writing tokenicer.egg-info\PKG-INFO
  writing dependency_links to tokenicer.egg-info\dependency_links.txt
  writing requirements to tokenicer.egg-info\requires.txt
  writing top-level names to tokenicer.egg-info\top_level.txt
  reading manifest file 'tokenicer.egg-info\SOURCES.txt'
  reading manifest template 'MANIFEST.in'
  no previously-included directories found matching 'tests'
  adding license file 'LICENSE'
  writing manifest file 'tokenicer.egg-info\SOURCES.txt'
  Copying tokenicer.egg-info to D:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\Lib\site-packages\tokenicer-0.0.4-py3.10.egg-info
  running install_scripts
  writing list of installed files to 'C:\Users\searo\AppData\Local\Temp\pip-record-hx4b4kfm\install-record.txt'
  Running setup.py install for tokenicer ... done
  DEPRECATION: gptqmodel is being installed using the legacy 'setup.py install' method, because it does not have a 'pyproject.toml' and the 'wheel' package is not installed. pip 23.1 will enforce this behaviour change. A possible replacement is to enable the '--use-pep517' option. Discussion can be found at https://github.com/pypa/pip/issues/8559
  Running command Running setup.py install for gptqmodel
  conda_cuda_include_dir D:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\Lib\site-packages\nvidia/cuda_runtime/include
  running install
  D:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\lib\site-packages\setuptools\_distutils\cmd.py:79: SetuptoolsDeprecationWarning: setup.py install is deprecated.
  !!

          ********************************************************************************
          Please avoid running ``setup.py`` directly.
          Instead, use pypa/build, pypa/installer or other
          standards-based tools.

          See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
          ********************************************************************************

  !!
    self.initialize_options()
  running build
  running build_py
  creating build\lib.win-amd64-cpython-310\gptqmodel
  copying gptqmodel\version.py -> build\lib.win-amd64-cpython-310\gptqmodel
  copying gptqmodel\__init__.py -> build\lib.win-amd64-cpython-310\gptqmodel
  creating build\lib.win-amd64-cpython-310\gptqmodel\integration
  copying gptqmodel\integration\integration_vllm.py -> build\lib.win-amd64-cpython-310\gptqmodel\integration
  copying gptqmodel\integration\__init__.py -> build\lib.win-amd64-cpython-310\gptqmodel\integration
  creating build\lib.win-amd64-cpython-310\gptqmodel\models
  copying gptqmodel\models\auto.py -> build\lib.win-amd64-cpython-310\gptqmodel\models
  copying gptqmodel\models\base.py -> build\lib.win-amd64-cpython-310\gptqmodel\models
  copying gptqmodel\models\loader.py -> build\lib.win-amd64-cpython-310\gptqmodel\models
  copying gptqmodel\models\writer.py -> build\lib.win-amd64-cpython-310\gptqmodel\models
  copying gptqmodel\models\_const.py -> build\lib.win-amd64-cpython-310\gptqmodel\models
  copying gptqmodel\models\__init__.py -> build\lib.win-amd64-cpython-310\gptqmodel\models
  creating build\lib.win-amd64-cpython-310\gptqmodel\nn_modules
  copying gptqmodel\nn_modules\hooked_linear.py -> build\lib.win-amd64-cpython-310\gptqmodel\nn_modules
  copying gptqmodel\nn_modules\__init__.py -> build\lib.win-amd64-cpython-310\gptqmodel\nn_modules
  creating build\lib.win-amd64-cpython-310\gptqmodel\quantization
  copying gptqmodel\quantization\config.py -> build\lib.win-amd64-cpython-310\gptqmodel\quantization
  copying gptqmodel\quantization\gptq.py -> build\lib.win-amd64-cpython-310\gptqmodel\quantization
  copying gptqmodel\quantization\quantizer.py -> build\lib.win-amd64-cpython-310\gptqmodel\quantization
  copying gptqmodel\quantization\__init__.py -> build\lib.win-amd64-cpython-310\gptqmodel\quantization
  creating build\lib.win-amd64-cpython-310\gptqmodel\utils
  copying gptqmodel\utils\backend.py -> build\lib.win-amd64-cpython-310\gptqmodel\utils
  copying gptqmodel\utils\bitblas.py -> build\lib.win-amd64-cpython-310\gptqmodel\utils
  copying gptqmodel\utils\calibration.py -> build\lib.win-amd64-cpython-310\gptqmodel\utils
  copying gptqmodel\utils\data.py -> build\lib.win-amd64-cpython-310\gptqmodel\utils
  copying gptqmodel\utils\device.py -> build\lib.win-amd64-cpython-310\gptqmodel\utils
  copying gptqmodel\utils\eval.py -> build\lib.win-amd64-cpython-310\gptqmodel\utils
  copying gptqmodel\utils\exllama.py -> build\lib.win-amd64-cpython-310\gptqmodel\utils
  copying gptqmodel\utils\image.py -> build\lib.win-amd64-cpython-310\gptqmodel\utils
  copying gptqmodel\utils\importer.py -> build\lib.win-amd64-cpython-310\gptqmodel\utils
  copying gptqmodel\utils\logger.py -> build\lib.win-amd64-cpython-310\gptqmodel\utils
  copying gptqmodel\utils\marlin.py -> build\lib.win-amd64-cpython-310\gptqmodel\utils
  copying gptqmodel\utils\mlx.py -> build\lib.win-amd64-cpython-310\gptqmodel\utils
  copying gptqmodel\utils\model.py -> build\lib.win-amd64-cpython-310\gptqmodel\utils
  copying gptqmodel\utils\openai_server.py -> build\lib.win-amd64-cpython-310\gptqmodel\utils
  copying gptqmodel\utils\perplexity.py -> build\lib.win-amd64-cpython-310\gptqmodel\utils
  copying gptqmodel\utils\plotly.py -> build\lib.win-amd64-cpython-310\gptqmodel\utils
  copying gptqmodel\utils\progress.py -> build\lib.win-amd64-cpython-310\gptqmodel\utils
  copying gptqmodel\utils\rocm.py -> build\lib.win-amd64-cpython-310\gptqmodel\utils
  copying gptqmodel\utils\safetensor.py -> build\lib.win-amd64-cpython-310\gptqmodel\utils
  copying gptqmodel\utils\sglang.py -> build\lib.win-amd64-cpython-310\gptqmodel\utils
  copying gptqmodel\utils\tensor.py -> build\lib.win-amd64-cpython-310\gptqmodel\utils
  copying gptqmodel\utils\torch.py -> build\lib.win-amd64-cpython-310\gptqmodel\utils
  copying gptqmodel\utils\vllm.py -> build\lib.win-amd64-cpython-310\gptqmodel\utils
  copying gptqmodel\utils\vram.py -> build\lib.win-amd64-cpython-310\gptqmodel\utils
  copying gptqmodel\utils\__init__.py -> build\lib.win-amd64-cpython-310\gptqmodel\utils
  creating build\lib.win-amd64-cpython-310\gptqmodel\integration\src
  copying gptqmodel\integration\src\__init__.py -> build\lib.win-amd64-cpython-310\gptqmodel\integration\src
  creating build\lib.win-amd64-cpython-310\gptqmodel\integration\src\vllm
  copying gptqmodel\integration\src\vllm\gptq_marlin.py -> build\lib.win-amd64-cpython-310\gptqmodel\integration\src\vllm
  copying gptqmodel\integration\src\vllm\__init__.py -> build\lib.win-amd64-cpython-310\gptqmodel\integration\src\vllm
  creating build\lib.win-amd64-cpython-310\gptqmodel\models\definitions
  copying gptqmodel\models\definitions\baichuan.py -> build\lib.win-amd64-cpython-310\gptqmodel\models\definitions
  copying gptqmodel\models\definitions\bloom.py -> build\lib.win-amd64-cpython-310\gptqmodel\models\definitions
  copying gptqmodel\models\definitions\chatglm.py -> build\lib.win-amd64-cpython-310\gptqmodel\models\definitions
  copying gptqmodel\models\definitions\codegen.py -> build\lib.win-amd64-cpython-310\gptqmodel\models\definitions
  copying gptqmodel\models\definitions\cohere.py -> build\lib.win-amd64-cpython-310\gptqmodel\models\definitions
  copying gptqmodel\models\definitions\cohere2.py -> build\lib.win-amd64-cpython-310\gptqmodel\models\definitions
  copying gptqmodel\models\definitions\dbrx.py -> build\lib.win-amd64-cpython-310\gptqmodel\models\definitions
  copying gptqmodel\models\definitions\dbrx_converted.py -> build\lib.win-amd64-cpython-310\gptqmodel\models\definitions
  copying gptqmodel\models\definitions\decilm.py -> build\lib.win-amd64-cpython-310\gptqmodel\models\definitions
  copying gptqmodel\models\definitions\deepseek_v2.py -> build\lib.win-amd64-cpython-310\gptqmodel\models\definitions
  copying gptqmodel\models\definitions\deepseek_v3.py -> build\lib.win-amd64-cpython-310\gptqmodel\models\definitions
  copying gptqmodel\models\definitions\exaone.py -> build\lib.win-amd64-cpython-310\gptqmodel\models\definitions
  copying gptqmodel\models\definitions\gemma.py -> build\lib.win-amd64-cpython-310\gptqmodel\models\definitions
  copying gptqmodel\models\definitions\gemma2.py -> build\lib.win-amd64-cpython-310\gptqmodel\models\definitions
  copying gptqmodel\models\definitions\glm.py -> build\lib.win-amd64-cpython-310\gptqmodel\models\definitions
  copying gptqmodel\models\definitions\gpt2.py -> build\lib.win-amd64-cpython-310\gptqmodel\models\definitions
  copying gptqmodel\models\definitions\gptj.py -> build\lib.win-amd64-cpython-310\gptqmodel\models\definitions
  copying gptqmodel\models\definitions\gpt_bigcode.py -> build\lib.win-amd64-cpython-310\gptqmodel\models\definitions
  copying gptqmodel\models\definitions\gpt_neox.py -> build\lib.win-amd64-cpython-310\gptqmodel\models\definitions
  copying gptqmodel\models\definitions\granite.py -> build\lib.win-amd64-cpython-310\gptqmodel\models\definitions
  copying gptqmodel\models\definitions\grinmoe.py -> build\lib.win-amd64-cpython-310\gptqmodel\models\definitions
  copying gptqmodel\models\definitions\hymba.py -> build\lib.win-amd64-cpython-310\gptqmodel\models\definitions
  copying gptqmodel\models\definitions\internlm.py -> build\lib.win-amd64-cpython-310\gptqmodel\models\definitions
  copying gptqmodel\models\definitions\internlm2.py -> build\lib.win-amd64-cpython-310\gptqmodel\models\definitions
  copying gptqmodel\models\definitions\llama.py -> build\lib.win-amd64-cpython-310\gptqmodel\models\definitions
  copying gptqmodel\models\definitions\longllama.py -> build\lib.win-amd64-cpython-310\gptqmodel\models\definitions
  copying gptqmodel\models\definitions\minicpm.py -> build\lib.win-amd64-cpython-310\gptqmodel\models\definitions
  copying gptqmodel\models\definitions\minicpm3.py -> build\lib.win-amd64-cpython-310\gptqmodel\models\definitions
  copying gptqmodel\models\definitions\mistral.py -> build\lib.win-amd64-cpython-310\gptqmodel\models\definitions
  copying gptqmodel\models\definitions\mixtral.py -> build\lib.win-amd64-cpython-310\gptqmodel\models\definitions
  copying gptqmodel\models\definitions\mllama.py -> build\lib.win-amd64-cpython-310\gptqmodel\models\definitions
  copying gptqmodel\models\definitions\mobilellm.py -> build\lib.win-amd64-cpython-310\gptqmodel\models\definitions
  copying gptqmodel\models\definitions\moss.py -> build\lib.win-amd64-cpython-310\gptqmodel\models\definitions
  copying gptqmodel\models\definitions\mpt.py -> build\lib.win-amd64-cpython-310\gptqmodel\models\definitions
  copying gptqmodel\models\definitions\olmo2.py -> build\lib.win-amd64-cpython-310\gptqmodel\models\definitions
  copying gptqmodel\models\definitions\opt.py -> build\lib.win-amd64-cpython-310\gptqmodel\models\definitions
  copying gptqmodel\models\definitions\ovis.py -> build\lib.win-amd64-cpython-310\gptqmodel\models\definitions
  copying gptqmodel\models\definitions\phi.py -> build\lib.win-amd64-cpython-310\gptqmodel\models\definitions
  copying gptqmodel\models\definitions\phi3.py -> build\lib.win-amd64-cpython-310\gptqmodel\models\definitions
  copying gptqmodel\models\definitions\qwen.py -> build\lib.win-amd64-cpython-310\gptqmodel\models\definitions
  copying gptqmodel\models\definitions\qwen2.py -> build\lib.win-amd64-cpython-310\gptqmodel\models\definitions
  copying gptqmodel\models\definitions\qwen2_moe.py -> build\lib.win-amd64-cpython-310\gptqmodel\models\definitions
  copying gptqmodel\models\definitions\qwen2_vl.py -> build\lib.win-amd64-cpython-310\gptqmodel\models\definitions
  copying gptqmodel\models\definitions\rw.py -> build\lib.win-amd64-cpython-310\gptqmodel\models\definitions
  copying gptqmodel\models\definitions\stablelmepoch.py -> build\lib.win-amd64-cpython-310\gptqmodel\models\definitions
  copying gptqmodel\models\definitions\starcoder2.py -> build\lib.win-amd64-cpython-310\gptqmodel\models\definitions
  copying gptqmodel\models\definitions\telechat2.py -> build\lib.win-amd64-cpython-310\gptqmodel\models\definitions
  copying gptqmodel\models\definitions\xverse.py -> build\lib.win-amd64-cpython-310\gptqmodel\models\definitions
  copying gptqmodel\models\definitions\yi.py -> build\lib.win-amd64-cpython-310\gptqmodel\models\definitions
  copying gptqmodel\models\definitions\__init__.py -> build\lib.win-amd64-cpython-310\gptqmodel\models\definitions
  creating build\lib.win-amd64-cpython-310\gptqmodel\nn_modules\qlinear
  copying gptqmodel\nn_modules\qlinear\bitblas.py -> build\lib.win-amd64-cpython-310\gptqmodel\nn_modules\qlinear
  copying gptqmodel\nn_modules\qlinear\bitblas_target_detector.py -> build\lib.win-amd64-cpython-310\gptqmodel\nn_modules\qlinear
  copying gptqmodel\nn_modules\qlinear\dynamic_cuda.py -> build\lib.win-amd64-cpython-310\gptqmodel\nn_modules\qlinear
  copying gptqmodel\nn_modules\qlinear\exllama.py -> build\lib.win-amd64-cpython-310\gptqmodel\nn_modules\qlinear
  copying gptqmodel\nn_modules\qlinear\exllamav2.py -> build\lib.win-amd64-cpython-310\gptqmodel\nn_modules\qlinear
  copying gptqmodel\nn_modules\qlinear\ipex.py -> build\lib.win-amd64-cpython-310\gptqmodel\nn_modules\qlinear
  copying gptqmodel\nn_modules\qlinear\marlin.py -> build\lib.win-amd64-cpython-310\gptqmodel\nn_modules\qlinear
  copying gptqmodel\nn_modules\qlinear\torch.py -> build\lib.win-amd64-cpython-310\gptqmodel\nn_modules\qlinear
  copying gptqmodel\nn_modules\qlinear\tritonv2.py -> build\lib.win-amd64-cpython-310\gptqmodel\nn_modules\qlinear
  copying gptqmodel\nn_modules\qlinear\utils.py -> build\lib.win-amd64-cpython-310\gptqmodel\nn_modules\qlinear
  copying gptqmodel\nn_modules\qlinear\__init__.py -> build\lib.win-amd64-cpython-310\gptqmodel\nn_modules\qlinear
  creating build\lib.win-amd64-cpython-310\gptqmodel\nn_modules\triton_utils
  copying gptqmodel\nn_modules\triton_utils\custom_autotune.py -> build\lib.win-amd64-cpython-310\gptqmodel\nn_modules\triton_utils
  copying gptqmodel\nn_modules\triton_utils\dequant.py -> build\lib.win-amd64-cpython-310\gptqmodel\nn_modules\triton_utils
  copying gptqmodel\nn_modules\triton_utils\kernels.py -> build\lib.win-amd64-cpython-310\gptqmodel\nn_modules\triton_utils
  copying gptqmodel\nn_modules\triton_utils\mixin.py -> build\lib.win-amd64-cpython-310\gptqmodel\nn_modules\triton_utils
  copying gptqmodel\nn_modules\triton_utils\__init__.py -> build\lib.win-amd64-cpython-310\gptqmodel\nn_modules\triton_utils
  running build_ext
  D:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\lib\site-packages\torch\utils\cpp_extension.py:497: UserWarning: Attempted to use ninja as the BuildExtension backend but we could not find ninja.. Falling back to using the slow distutils backend.
    warnings.warn(msg.format('we could not find ninja.'))
  D:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\lib\site-packages\torch\utils\cpp_extension.py:382: UserWarning: Error checking compiler version for cl: [WinError 2] The system cannot find the file specified
    warnings.warn(f'Error checking compiler version for {compiler}: {error}')
  D:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\lib\site-packages\torch\utils\cpp_extension.py:416: UserWarning: The detected CUDA version (12.8) has a minor version mismatch with the version that was used to compile PyTorch (12.4). Most likely this shouldn't be a problem.
    warnings.warn(CUDA_MISMATCH_WARN.format(cuda_str_version, torch.version.cuda))
  building 'gptqmodel_cuda_64' extension
  creating build\temp.win-amd64-cpython-310\Release\gptqmodel_ext\cuda_64
  "C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\VC\Tools\MSVC\14.42.34433\bin\HostX86\x64\cl.exe" /c /nologo /O2 /W3 /GL /DNDEBUG /MD -ID:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\lib\site-packages\torch\include -ID:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\lib\site-packages\torch\include\torch\csrc\api\include -ID:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\lib\site-packages\torch\include\TH -ID:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\lib\site-packages\torch\include\THC -IC:\Programs\miniconda3\envs\fb-nougat\Library\include -Igptqmodel_cuda -ID:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\include -IC:\Programs\miniconda3\envs\fb-nougat\include -IC:\Programs\miniconda3\envs\fb-nougat\Include "-IC:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\VC\Tools\MSVC\14.42.34433\include" "-IC:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\VC\Auxiliary\VS\include" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.22621.0\ucrt" "-IC:\Program Files (x86)\Windows Kits\10\\include\10.0.22621.0\\um" "-IC:\Program Files (x86)\Windows Kits\10\\include\10.0.22621.0\\shared" "-IC:\Program Files (x86)\Windows Kits\10\\include\10.0.22621.0\\winrt" "-IC:\Program Files (x86)\Windows Kits\10\\include\10.0.22621.0\\cppwinrt" /EHsc /Tpgptqmodel_ext/cuda_64/gptqmodel_cuda_64.cpp /Fobuild\temp.win-amd64-cpython-310\Release\gptqmodel_ext\cuda_64\gptqmodel_cuda_64.obj /MD /wd4819 /wd4251 /wd4244 /wd4267 /wd4275 /wd4018 /wd4190 /wd4624 /wd4067 /wd4068 /EHsc -O3 -std=c++17 -fopenmp -lgomp -DENABLE_BF16 -D_GLIBCXX_USE_CXX11_ABI=0 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=gptqmodel_cuda_64 -D_GLIBCXX_USE_CXX11_ABI=0 /std:c++17
  cl : Command line warning D9002 : ignoring unknown option '-O3'
  cl : Command line warning D9002 : ignoring unknown option '-std=c++17'
  cl : Command line warning D9002 : ignoring unknown option '-fopenmp'
  cl : Command line warning D9002 : ignoring unknown option '-lgomp'
  gptqmodel_cuda_64.cpp
  D:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\lib\site-packages\torch\utils\cpp_extension.py:1964: UserWarning: TORCH_CUDA_ARCH_LIST is not set, all archs for visible cards are included for compilation.
  If this is not desired, please set os.environ['TORCH_CUDA_ARCH_LIST'].
    warnings.warn(
  C:\Programs\miniconda3\envs\fb-nougat\Library\bin\nvcc -c gptqmodel_ext/cuda_64/gptqmodel_cuda_kernel_64.cu -o build\temp.win-amd64-cpython-310\Release\gptqmodel_ext\cuda_64\gptqmodel_cuda_kernel_64.obj -ID:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\lib\site-packages\torch\include -ID:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\lib\site-packages\torch\include\torch\csrc\api\include -ID:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\lib\site-packages\torch\include\TH -ID:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\lib\site-packages\torch\include\THC -IC:\Programs\miniconda3\envs\fb-nougat\Library\include -Igptqmodel_cuda -ID:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\include -IC:\Programs\miniconda3\envs\fb-nougat\include -IC:\Programs\miniconda3\envs\fb-nougat\Include "-IC:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\VC\Tools\MSVC\14.42.34433\include" "-IC:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\VC\Auxiliary\VS\include" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.22621.0\ucrt" "-IC:\Program Files (x86)\Windows Kits\10\\include\10.0.22621.0\\um" "-IC:\Program Files (x86)\Windows Kits\10\\include\10.0.22621.0\\shared" "-IC:\Program Files (x86)\Windows Kits\10\\include\10.0.22621.0\\winrt" "-IC:\Program Files (x86)\Windows Kits\10\\include\10.0.22621.0\\cppwinrt" -Xcudafe --diag_suppress=dll_interface_conflict_dllexport_assumed -Xcudafe --diag_suppress=dll_interface_conflict_none_assumed -Xcudafe --diag_suppress=field_without_dll_interface -Xcudafe --diag_suppress=base_class_has_different_dll_interface -Xcompiler /EHsc -Xcompiler /wd4068 -Xcompiler /wd4067 -Xcompiler /wd4624 -Xcompiler /wd4190 -Xcompiler /wd4018 -Xcompiler /wd4275 -Xcompiler /wd4267 -Xcompiler /wd4244 -Xcompiler /wd4251 -Xcompiler /wd4819 -Xcompiler /MD -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr -O3 -std=c++17 -DENABLE_BF16 -U__CUDA_NO_HALF_OPERATORS__ -U__CUDA_NO_HALF_CONVERSIONS__ -U__CUDA_NO_BFLOAT16_OPERATORS__ -U__CUDA_NO_BFLOAT16_CONVERSIONS__ -U__CUDA_NO_BFLOAT162_OPERATORS__ -U__CUDA_NO_BFLOAT162_CONVERSIONS__ -diag-suppress=179,39,186 -D_GLIBCXX_USE_CXX11_ABI=0 --threads 4 -Xfatbin -compress-all --expt-relaxed-constexpr --expt-extended-lambda --use_fast_math -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=gptqmodel_cuda_64 -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_89,code=compute_89 -gencode=arch=compute_89,code=sm_89 -std=c++17 --use-local-env
  gptqmodel_cuda_kernel_64.cu
  cl : Command line warning D9025 : overriding '/D__CUDA_NO_HALF_OPERATORS__' with '/U__CUDA_NO_HALF_OPERATORS__'
  cl : Command line warning D9025 : overriding '/D__CUDA_NO_HALF_CONVERSIONS__' with '/U__CUDA_NO_HALF_CONVERSIONS__'
  cl : Command line warning D9025 : overriding '/D__CUDA_NO_BFLOAT16_CONVERSIONS__' with '/U__CUDA_NO_BFLOAT16_CONVERSIONS__'
  gptqmodel_cuda_kernel_64.cu
  cl : Command line warning D9025 : overriding '/D__CUDA_NO_HALF_OPERATORS__' with '/U__CUDA_NO_HALF_OPERATORS__'
  cl : Command line warning D9025 : overriding '/D__CUDA_NO_HALF_CONVERSIONS__' with '/U__CUDA_NO_HALF_CONVERSIONS__'
  cl : Command line warning D9025 : overriding '/D__CUDA_NO_BFLOAT16_CONVERSIONS__' with '/U__CUDA_NO_BFLOAT16_CONVERSIONS__'
  gptqmodel_cuda_kernel_64.cu
  tmpxft_0000f538_00000000-7_gptqmodel_cuda_kernel_64.cudafe1.cpp
  "C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\VC\Tools\MSVC\14.42.34433\bin\HostX86\x64\link.exe" /nologo /INCREMENTAL:NO /LTCG /DLL /MANIFEST:EMBED,ID=2 /MANIFESTUAC:NO /LIBPATH:D:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\lib\site-packages\torch\lib /LIBPATH:C:\Programs\miniconda3\envs\fb-nougat\Library\lib\x64 /LIBPATH:D:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\libs /LIBPATH:C:\Programs\miniconda3\envs\fb-nougat\libs /LIBPATH:C:\Programs\miniconda3\envs\fb-nougat /LIBPATH:D:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\PCbuild\amd64 "/LIBPATH:C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\VC\Tools\MSVC\14.42.34433\lib\x64" "/LIBPATH:C:\Program Files (x86)\Windows Kits\10\lib\10.0.22621.0\ucrt\x64" "/LIBPATH:C:\Program Files (x86)\Windows Kits\10\\lib\10.0.22621.0\\um\x64" c10.lib torch.lib torch_cpu.lib torch_python.lib cudart.lib c10_cuda.lib torch_cuda.lib /EXPORT:PyInit_gptqmodel_cuda_64 build\temp.win-amd64-cpython-310\Release\gptqmodel_ext\cuda_64\gptqmodel_cuda_64.obj build\temp.win-amd64-cpython-310\Release\gptqmodel_ext\cuda_64\gptqmodel_cuda_kernel_64.obj /OUT:build\lib.win-amd64-cpython-310\gptqmodel_cuda_64.cp310-win_amd64.pyd /IMPLIB:build\temp.win-amd64-cpython-310\Release\gptqmodel_ext\cuda_64\gptqmodel_cuda_64.cp310-win_amd64.lib
  LINK : fatal error LNK1181: cannot open input file 'cudart.lib'
  error: command 'C:\\Program Files (x86)\\Microsoft Visual Studio\\2022\\BuildTools\\VC\\Tools\\MSVC\\14.42.34433\\bin\\HostX86\\x64\\link.exe' failed with exit code 1181 
  error: subprocess-exited-with-error
  
  × Running setup.py install for gptqmodel did not run successfully.
  │ exit code: 1
  ╰─> See above for output.

  note: This error originates from a subprocess, and is likely not a problem with pip.
  full command: 'D:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\Scripts\python.exe' -u -c '
  exec(compile('"'"''"'"''"'"'
  # This is <pip-setuptools-caller> -- a caller that pip uses to run setup.py
  #
  # - It imports setuptools before invoking setup.py, to enable projects that directly
  #   import from `distutils.core` to work with newer packaging standards.
  # - It provides a clear error message when setuptools is not installed.
  # - It sets `sys.argv[0]` to the underlying `setup.py`, when invoking `setup.py` so
  #   setuptools doesn'"'"'t think the script is `-c`. This avoids the following warning:
  #     manifest_maker: standard file '"'"'-c'"'"' not found".
  # - It generates a shim setup.py, for handling setup.cfg-only projects.
  import os, sys, tokenize

  try:
      import setuptools
  except ImportError as error:
      print(
          "ERROR: Can not execute `setup.py` since setuptools is not available in "
          "the build environment.",
          file=sys.stderr,
      )
      sys.exit(1)

  __file__ = %r
  sys.argv[0] = __file__

  if os.path.exists(__file__):
      filename = __file__
      with tokenize.open(__file__) as f:
          setup_py_code = f.read()
  else:
      filename = "<auto-generated setuptools caller>"
      setup_py_code = "from setuptools import setup; setup()"

  exec(compile(setup_py_code, filename, "exec"))
  '"'"''"'"''"'"' % ('"'"'C:\\Users\\searo\\AppData\\Local\\Temp\\pip-install-uau4q2pn\\gptqmodel_fca8ff591c074b59bfda18552ed98e55\\setup.py'"'"',), "<pip-setuptools-caller>", "exec"))' install --record 'C:\Users\searo\AppData\Local\Temp\pip-record-3t0gnnpz\install-record.txt' --single-version-externally-managed --compile --install-headers 'D:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\include\site\python3.10\gptqmodel'
  cwd: C:\Users\searo\AppData\Local\Temp\pip-install-uau4q2pn\gptqmodel_fca8ff591c074b59bfda18552ed98e55\
  Running setup.py install for gptqmodel ... error
error: legacy-install-failure

× Encountered error while trying to install package.
╰─> gptqmodel

note: This is an issue with the package mentioned above, not pip.
hint: See above for output from the failure.

GPU Info

Show output of:

nvidia-smi

+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 560.94                 Driver Version: 560.94         CUDA Version: 12.6     |
|-----------------------------------------+------------------------+----------------------+
| GPU  Name                  Driver-Model | Bus-Id          Disp.A | Volatile Uncorr. ECC |
| Fan  Temp   Perf          Pwr:Usage/Cap |           Memory-Usage | GPU-Util  Compute M. |
|                                         |                        |               MIG M. |
|=========================================+========================+======================|
|   0  NVIDIA GeForce RTX 4090      WDDM  |   00000000:01:00.0  On |                  Off |
|  0%   41C    P8             18W /  450W |    1129MiB /  24564MiB |      1%      Default |
|                                         |                        |                  N/A |
+-----------------------------------------+------------------------+----------------------+

+-----------------------------------------------------------------------------------------+
| Processes:                                                                              |
|  GPU   GI   CI        PID   Type   Process name                              GPU Memory |
|        ID   ID                                                               Usage      |
|=========================================================================================|
|    0   N/A  N/A      4452    C+G   ...s\System32\ApplicationFrameHost.exe      N/A      |
|    0   N/A  N/A      9528    C+G   ...__8wekyb3d8bbwe\WindowsTerminal.exe      N/A      |
|    0   N/A  N/A      9580    C+G   ...pp_cw5n1h2txyewy\CHXSmartScreen.exe      N/A      |
|    0   N/A  N/A     11344    C+G   ...2txyewy\StartMenuExperienceHost.exe      N/A      |
|    0   N/A  N/A     11596    C+G   ...crosoft\Edge\Application\msedge.exe      N/A      |
|    0   N/A  N/A     11892    C+G   ...nt.CBS_cw5n1h2txyewy\SearchHost.exe      N/A      |
|    0   N/A  N/A     11904    C+G   C:\Windows\explorer.exe                     N/A      |
|    0   N/A  N/A     14588    C+G   ...siveControlPanel\SystemSettings.exe      N/A      |
|    0   N/A  N/A     16992    C+G   ...ekyb3d8bbwe\PhoneExperienceHost.exe      N/A      |
|    0   N/A  N/A     20352    C+G   ...air\Corsair iCUE5 Software\iCUE.exe      N/A      |
|    0   N/A  N/A     20388    C+G   ...CBS_cw5n1h2txyewy\TextInputHost.exe      N/A      |
|    0   N/A  N/A     20856    C+G   ...crosoft\Edge\Application\msedge.exe      N/A      |
|    0   N/A  N/A     21168    C+G   ...on\133.0.3065.69\msedgewebview2.exe      N/A      |
|    0   N/A  N/A     21496    C+G   ....0_x64__8she8kybcnzg4\app\Slack.exe      N/A      |
|    0   N/A  N/A     21936    C+G   ...B\system_tray\lghub_system_tray.exe      N/A      |
|    0   N/A  N/A     23204    C+G   ...ne\Binaries\Win64\EpicWebHelper.exe      N/A      |
|    0   N/A  N/A     23272    C+G   ...inaries\Win64\EpicGamesLauncher.exe      N/A      |
|    0   N/A  N/A     23888    C+G   ...1.0_x64__8wekyb3d8bbwe\Video.UI.exe      N/A      |
|    0   N/A  N/A     24036    C+G   ...\cef\cef.win7x64\steamwebhelper.exe      N/A      |
|    0   N/A  N/A     26184    C+G   ...cks-services\BlueStacksServices.exe      N/A      |
|    0   N/A  N/A     28080    C+G   ...n\132.0.2957.140\msedgewebview2.exe      N/A      |
|    0   N/A  N/A     29312    C+G   ....0_x64__8she8kybcnzg4\app\Slack.exe      N/A      |
|    0   N/A  N/A     31996    C+G   ...Programs\Microsoft VS Code\Code.exe      N/A      |
|    0   N/A  N/A     34056    C+G   ...5n1h2txyewy\ShellExperienceHost.exe      N/A      |
|    0   N/A  N/A     34768    C+G   ...ta\Local\Programs\Joplin\Joplin.exe      N/A      |
|    0   N/A  N/A     37764    C+G   ...n\132.0.2957.140\msedgewebview2.exe      N/A      |
|    0   N/A  N/A     45928    C+G   C:\Windows\System32\ShellHost.exe           N/A      |
|    0   N/A  N/A     49720    C+G   ...\Docker\frontend\Docker Desktop.exe      N/A      |
|    0   N/A  N/A     73524    C+G   ...t.LockApp_cw5n1h2txyewy\LockApp.exe      N/A      |
|    0   N/A  N/A     73916    C+G   ...les\Microsoft OneDrive\OneDrive.exe      N/A      |
+-----------------------------------------------------------------------------------------+

Software Info

Operation System/Version + Python Version

Windows 11 Pro 24H2
Python 3.10.16

Show output of:

pip show gptqmodel torch transformers accelerate triton

WARNING: Package(s) not found: gptqmodel, triton
Name: torch
Version: 2.5.1+cu124
Summary: Tensors and Dynamic neural networks in Python with strong GPU acceleration
Home-page: https://pytorch.org/
Author: PyTorch Team
Author-email: [email protected]
License: BSD-3-Clause
Location: d:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\lib\site-packages
Requires: filelock, fsspec, jinja2, networkx, sympy, typing-extensions
Required-by: accelerate, torchaudio, torchvision
---
Name: transformers
Version: 4.49.0
Summary: State-of-the-art Machine Learning for JAX, PyTorch and TensorFlow
Home-page: https://github.com/huggingface/transformers
Author: The Hugging Face team (past and future) with the help of all our contributors (https://github.com/huggingface/transformers/graphs/contributors)
Author-email: [email protected]
License: Apache 2.0 License
Location: d:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\lib\site-packages
Requires: filelock, huggingface-hub, numpy, packaging, pyyaml, regex, requests, safetensors, tokenizers, tqdm
Required-by: tokenicer
---
Name: accelerate
Version: 1.4.0
Summary: Accelerate
Home-page: https://github.com/huggingface/accelerate
Author: The HuggingFace team
Author-email: [email protected]
License: Apache
Location: d:\dev_projects\test_storyboard_tools\story_cowriter\.venv_cuda\lib\site-packages
Requires: huggingface-hub, numpy, packaging, psutil, pyyaml, safetensors, torch
Required-by:

If you are reporting an inference bug of a post-quantized model, please post the content of config.json and quantize_config.json.

To Reproduce

How to reproduce this bug if possible.
Attempt to install using pip in PowerShell on Windows.

Expected behavior

A clear and concise description of what you expected to happen.
Installation to run successfully.

Model/Datasets

Make sure your model/dataset is downloadable (on HF for example) so we can reproduce your issue.

Screenshots

If applicable, add screenshots to help explain your problem.

Additional context

Add any other context about the problem here.
I ran a test script to ensure that CUDA is installed and available.

import torch
print(torch.cuda.is_available())
True
@git9875 git9875 added the bug Something isn't working label Feb 22, 2025
@Qubitium
Copy link
Collaborator

Qubitium commented Feb 22, 2025 •
edited
Loading

Actual error is following:

LINK : fatal error LNK1181: cannot open input file 'cudart.lib' error: command 'C:\\Program Files (x86)\\Microsoft Visual Studio\\2022\\BuildTools\\VC\\Tools\\MSVC\\14.42.34433\\bin\\HostX86\\x64\\link.exe' failed with exit code 1181 error: subprocess-exited-with-error

This this strange as it can find compiler nvcc but not the cudart.lib on win11.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@Qubitium @git9875