pywhispercpp doesn't use GPU

[amitli1]

I'm running on NVIDA GPU.
I installed this package via:
WHISPER_CUDA=1 pip install git+https://github.com/abdeladim-s/pywhispercpp

I run the following code:

from pywhispercpp.model import Model
model = Model("small.en")
segments = model.transcribe(r"common_voice_en_2925.wav")

and it doesn't use the GPU.

How can we run pywhispercpp on GPU ?

[absadiki]

please use the following:

NO_REPAIR=1 GGML_CUDA=1 pip install git+https://github.com/absadiki/pywhispercpp

[amitli1]

I tried and got error while installing:
Building wheels for collected packages: pywhispercpp
Building wheel for pywhispercpp (pyproject.toml) ... error
error: subprocess-exited-with-error

× Building wheel for pywhispercpp (pyproject.toml) did not run successfully.
│ exit code: 1
╰─> [330 lines of output]
running bdist_wheel
running build
running build_py
creating build/lib.linux-x86_64-cpython-310/pywhispercpp
copying ./pywhispercpp/utils.py -> build/lib.linux-x86_64-cpython-310/pywhispercpp
copying ./pywhispercpp/constants.py -> build/lib.linux-x86_64-cpython-310/pywhispercpp
copying ./pywhispercpp/init.py -> build/lib.linux-x86_64-cpython-310/pywhispercpp
copying ./pywhispercpp/model.py -> build/lib.linux-x86_64-cpython-310/pywhispercpp
creating build/lib.linux-x86_64-cpython-310/pywhispercpp/examples
copying ./pywhispercpp/examples/recording.py -> build/lib.linux-x86_64-cpython-310/pywhispercpp/examples
copying ./pywhispercpp/examples/livestream.py -> build/lib.linux-x86_64-cpython-310/pywhispercpp/examples
copying ./pywhispercpp/examples/init.py -> build/lib.linux-x86_64-cpython-310/pywhispercpp/examples
copying ./pywhispercpp/examples/gui.py -> build/lib.linux-x86_64-cpython-310/pywhispercpp/examples
copying ./pywhispercpp/examples/assistant.py -> build/lib.linux-x86_64-cpython-310/pywhispercpp/examples
copying ./pywhispercpp/examples/main.py -> build/lib.linux-x86_64-cpython-310/pywhispercpp/examples
running egg_info
writing pywhispercpp.egg-info/PKG-INFO
writing dependency_links to pywhispercpp.egg-info/dependency_links.txt
writing entry points to pywhispercpp.egg-info/entry_points.txt
writing requirements to pywhispercpp.egg-info/requires.txt
writing top-level names to pywhispercpp.egg-info/top_level.txt
reading manifest template 'MANIFEST.in'
warning: no files found matching 'version.txt'
warning: no previously-included files found matching 'whisper.cpp//*.o'
warning: no previously-included files found matching 'whisper.cpp//.so'
warning: no previously-included files found matching 'whisper.cpp/**/.a'
warning: no previously-included files found matching 'whisper.cpp//*.dylib'
warning: no previously-included files found matching 'whisper.cpp//.dll'
warning: no previously-included files found matching 'whisper.cpp/**/.lib'
adding license file 'LICENSE'
writing manifest file 'pywhispercpp.egg-info/SOURCES.txt'
running build_ext
-- The C compiler identification is GNU 11.4.0
-- The CXX compiler identification is GNU 11.4.0
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Check for working C compiler: /usr/bin/cc - skipped
-- Detecting C compile features
-- Detecting C compile features - done
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Check for working CXX compiler: /usr/bin/c++ - skipped
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- pybind11 v3.0.0 dev1
-- Found Python: /home/amitli/python_venvs/venvWhisperCPP/bin/python3.10 (found suitable version "3.10.12", minimum required is "3.8") found components: Interpreter Development.Module Development.Embed
Using compatibility mode for Python, set PYBIND11_FINDPYTHON to NEW/OLD to silence this message
-- Performing Test HAS_FLTO
-- Performing Test HAS_FLTO - Success
CMake Deprecation Warning at whisper.cpp/CMakeLists.txt:1 (cmake_minimum_required):
Compatibility with CMake < 3.10 will be removed from a future version of
CMake.

    Update the VERSION argument <min> value.  Or, use the <min>...<max> syntax
    to tell CMake that the project requires at least <min> but has been updated
    to work with policies introduced by <max> or earlier.
  
  
  -- Found Git: /usr/bin/git (found version "2.34.1")
  -- Performing Test CMAKE_HAVE_LIBC_PTHREAD
  -- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Success
  -- Found Threads: TRUE
  -- Warning: ccache not found - consider installing it for faster compilation or disable this warning with GGML_CCACHE=OFF
  -- CMAKE_SYSTEM_PROCESSOR: x86_64
  -- Including CPU backend
  -- Found OpenMP_C: -fopenmp (found version "4.5")
  -- Found OpenMP_CXX: -fopenmp (found version "4.5")
  -- Found OpenMP: TRUE (found version "4.5")
  -- x86 detected
  -- Adding CPU backend variant ggml-cpu: -march=native
  -- Found CUDAToolkit: /usr/include (found version "11.5.119")
  -- CUDA Toolkit found
  -- Using CUDA architectures: 52;61;70;75
  -- The CUDA compiler identification is NVIDIA 11.5.119 with host compiler GNU 11.4.0
  -- Detecting CUDA compiler ABI info
  -- Detecting CUDA compiler ABI info - done
  -- Check for working CUDA compiler: /usr/bin/nvcc - skipped
  -- Detecting CUDA compile features
  -- Detecting CUDA compile features - done
  -- CUDA host compiler is GNU 11.4.0
  
  -- Including CUDA backend
  -- Configuring done (5.5s)
  -- Generating done (0.0s)
  CMake Warning:
    Manually-specified variables were not used by the project:
  
      CDC_JOINED_DC
      CDC_JOINED_DOMAIN
      CDC_JOINED_SITE
      CDC_JOINED_ZONE
      CDC_LOCALHOST
      CDC_PREW2KHOST
      COLORTERM
      DA_SESSION_ID_AUTH
      DBUS_SESSION_BUS_ADDRESS
      DESKTOP_SESSION
      DISPLAY
      EXAMPLE_VERSION_INFO
      GDMSESSION
      GNOME_DESKTOP_SESSION_ID
      GNOME_SHELL_SESSION_MODE
      GNOME_TERMINAL_SCREEN
      GNOME_TERMINAL_SERVICE
      GPG_AGENT_INFO
      GTK_IM_MODULE
      GTK_MODULES
      HOME
      IM_CONFIG_PHASE
      LANGUAGE
      LESSCLOSE
      LESSOPEN
      LOGNAME
      LS_COLORS
      NO_REPAIR
      PATH
      PIP_BUILD_TRACKER
      PLAT
      PS1
      PWD
      PYTHONNOUSERSITE
      PYTHONPATH
      QT_ACCESSIBILITY
      QT_IM_MODULE
      SESSION_MANAGER
      SHELL
      SHLVL
      SSH_AGENT_LAUNCHER
      SSH_AUTH_SOCK
      SYSTEMD_EXEC_PID
      TERM
      USER
      USERNAME
      USER_PRINCIPAL_NAME
      VIRTUAL_ENV
      VIRTUAL_ENV_PROMPT
      VTE_VERSION
      WINDOWPATH
      XAUTHORITY
      XDG_CONFIG_DIRS
      XDG_CURRENT_DESKTOP
      XDG_DATA_DIRS
      XDG_MENU_PREFIX
      XDG_RUNTIME_DIR
      XDG_SESSION_CLASS
      XDG_SESSION_DESKTOP
      XDG_SESSION_TYPE
      XMODIFIERS
      _
      _PYPROJECT_HOOKS_BUILD_BACKEND
  
  
  -- Build files have been written to: /tmp/pip-req-build-00vpxnnx/build/temp.linux-x86_64-cpython-310/_pywhispercpp
  [1/94] Building CXX object whisper.cpp/ggml/src/CMakeFiles/ggml-cpu.dir/ggml-cpu/ggml-cpu-hbm.cpp.o
  [2/94] Building CXX object whisper.cpp/ggml/src/CMakeFiles/ggml-base.dir/ggml-threading.cpp.o
  [3/94] Building C object whisper.cpp/ggml/src/CMakeFiles/ggml-base.dir/ggml-alloc.c.o
  [4/94] Building CXX object whisper.cpp/ggml/src/CMakeFiles/ggml-cpu.dir/ggml-cpu/ggml-cpu-traits.cpp.o
  [5/94] Building CXX object whisper.cpp/ggml/src/CMakeFiles/ggml-cpu.dir/ggml-cpu/amx/mmq.cpp.o
  [6/94] Building CXX object whisper.cpp/ggml/src/CMakeFiles/ggml-cpu.dir/ggml-cpu/amx/amx.cpp.o
  [7/94] Building CXX object whisper.cpp/ggml/src/CMakeFiles/ggml-cpu.dir/ggml-cpu/ggml-cpu.cpp.o
  [8/94] Building CXX object whisper.cpp/ggml/src/CMakeFiles/ggml-base.dir/ggml-backend.cpp.o
  [9/94] Building C object whisper.cpp/ggml/src/CMakeFiles/ggml-cpu.dir/ggml-cpu/ggml-cpu-quants.c.o
  [10/94] Building CXX object whisper.cpp/ggml/src/CMakeFiles/ggml-base.dir/ggml-opt.cpp.o
  [11/94] Building CXX object whisper.cpp/ggml/src/CMakeFiles/ggml.dir/ggml-backend-reg.cpp.o
  [12/94] Building CXX object whisper.cpp/ggml/src/CMakeFiles/ggml-cpu.dir/ggml-cpu/ggml-cpu-aarch64.cpp.o
  [13/94] Building C object whisper.cpp/ggml/src/CMakeFiles/ggml-base.dir/ggml.c.o
  [14/94] Building CUDA object whisper.cpp/ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/arange.cu.o
  [15/94] Building CUDA object whisper.cpp/ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/acc.cu.o
  [16/94] Building CUDA object whisper.cpp/ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/diagmask.cu.o
  [17/94] Building CUDA object whisper.cpp/ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/conv-transpose-1d.cu.o
  [18/94] Building CUDA object whisper.cpp/ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/clamp.cu.o
  [19/94] Building CUDA object whisper.cpp/ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/count-equal.cu.o
  [20/94] Building CUDA object whisper.cpp/ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/im2col.cu.o
  [21/94] Building CUDA object whisper.cpp/ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/argsort.cu.o
  [22/94] Building CUDA object whisper.cpp/ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/mmq.cu.o
  [23/94] Building CUDA object whisper.cpp/ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/concat.cu.o
  [24/94] Building CUDA object whisper.cpp/ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/getrows.cu.o
  [25/94] Building CUDA object whisper.cpp/ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/cross-entropy-loss.cu.o
  [26/94] Building CUDA object whisper.cpp/ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/argmax.cu.o
  FAILED: whisper.cpp/ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/argmax.cu.o
  /usr/bin/nvcc -forward-unknown-to-host-compiler -DGGML_BACKEND_BUILD -DGGML_BACKEND_SHARED -DGGML_CUDA_PEER_MAX_BATCH_SIZE=128 -DGGML_SCHED_MAX_COPIES=4 -DGGML_SHARED -D_GNU_SOURCE -D_XOPEN_SOURCE=600 -Dggml_cuda_EXPORTS -I/tmp/pip-req-build-00vpxnnx/whisper.cpp/ggml/src/ggml-cuda/.. -I/tmp/pip-req-build-00vpxnnx/whisper.cpp/ggml/src/../include -O3 -DNDEBUG -std=c++17 "--generate-code=arch=compute_52,code=[compute_52,sm_52]" "--generate-code=arch=compute_61,code=[compute_61,sm_61]" "--generate-code=arch=compute_70,code=[compute_70,sm_70]" "--generate-code=arch=compute_75,code=[compute_75,sm_75]" -Xcompiler=-fPIC -use_fast_math -Xcompiler "-Wmissing-declarations -Wmissing-noreturn -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wno-array-bounds -Wextra-semi -Wno-pedantic" -MD -MT whisper.cpp/ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/argmax.cu.o -MF whisper.cpp/ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/argmax.cu.o.d -x cu -c /tmp/pip-req-build-00vpxnnx/whisper.cpp/ggml/src/ggml-cuda/argmax.cu -o whisper.cpp/ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/argmax.cu.o
  /usr/include/c++/11/bits/std_function.h:435:145: error: parameter packs not expanded with ‘...’:
    435 |         function(_Functor&& __f)
        |                                                                                                                                                 ^
  /usr/include/c++/11/bits/std_function.h:435:145: note:         ‘_ArgTypes’
  /usr/include/c++/11/bits/std_function.h:530:146: error: parameter packs not expanded with ‘...’:
    530 |         operator=(_Functor&& __f)
        |                                                                                                                                                  ^
  /usr/include/c++/11/bits/std_function.h:530:146: note:         ‘_ArgTypes’
  [27/94] Building CUDA object whisper.cpp/ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/out-prod.cu.o
  [28/94] Building CUDA object whisper.cpp/ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/opt-step-adamw.cu.o
  [29/94] Building C object whisper.cpp/ggml/src/CMakeFiles/ggml-cpu.dir/ggml-cpu/ggml-cpu.c.o
  [30/94] Building C object whisper.cpp/ggml/src/CMakeFiles/ggml-base.dir/ggml-quants.c.o
  [31/94] Building CUDA object whisper.cpp/ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/pool2d.cu.o
  [32/94] Building CUDA object whisper.cpp/ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/pad.cu.o
  [33/94] Building CUDA object whisper.cpp/ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/quantize.cu.o
  [34/94] Building CUDA object whisper.cpp/ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/norm.cu.o
  [35/94] Building CUDA object whisper.cpp/ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/scale.cu.o
  [36/94] Building CUDA object whisper.cpp/ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/cpy.cu.o
  [37/94] Building CXX object CMakeFiles/_pywhispercpp.dir/src/main.cpp.o
  /tmp/pip-req-build-00vpxnnx/src/main.cpp: In function ‘whisper_context_wrapper whisper_init_from_file_wrapper(const char*)’:
  /tmp/pip-req-build-00vpxnnx/src/main.cpp:62:58: warning: ‘whisper_context* whisper_init_from_file(const char*)’ is deprecated: use whisper_init_from_file_with_params instead [-Wdeprecated-declarations]
     62 |     struct whisper_context * ctx = whisper_init_from_file(path_model);
        |                                    ~~~~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~
  In file included from /tmp/pip-req-build-00vpxnnx/src/main.cpp:18:
  /tmp/pip-req-build-00vpxnnx/whisper.cpp/src/../include/whisper.h:206:46: note: declared here
    206 |         WHISPER_API struct whisper_context * whisper_init_from_file(const char * path_model),
        |                                              ^~~~~~~~~~~~~~~~~~~~~~
  /tmp/pip-req-build-00vpxnnx/whisper.cpp/src/../include/whisper.h:12:44: note: in definition of macro ‘WHISPER_DEPRECATED’
     12 | #    define WHISPER_DEPRECATED(func, hint) func __attribute__((deprecated(hint)))
        |                                            ^~~~
  /tmp/pip-req-build-00vpxnnx/src/main.cpp: In function ‘whisper_context_wrapper whisper_init_from_buffer_wrapper(void*, size_t)’:
  /tmp/pip-req-build-00vpxnnx/src/main.cpp:69:60: warning: ‘whisper_context* whisper_init_from_buffer(void*, size_t)’ is deprecated: use whisper_init_from_buffer_with_params instead [-Wdeprecated-declarations]
     69 |     struct whisper_context * ctx = whisper_init_from_buffer(buffer, buffer_size);
        |                                    ~~~~~~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~
  In file included from /tmp/pip-req-build-00vpxnnx/src/main.cpp:18:
  /tmp/pip-req-build-00vpxnnx/whisper.cpp/src/../include/whisper.h:210:46: note: declared here
    210 |         WHISPER_API struct whisper_context * whisper_init_from_buffer(void * buffer, size_t buffer_size),
        |                                              ^~~~~~~~~~~~~~~~~~~~~~~~
  /tmp/pip-req-build-00vpxnnx/whisper.cpp/src/../include/whisper.h:12:44: note: in definition of macro ‘WHISPER_DEPRECATED’
     12 | #    define WHISPER_DEPRECATED(func, hint) func __attribute__((deprecated(hint)))
        |                                            ^~~~
  /tmp/pip-req-build-00vpxnnx/src/main.cpp: In function ‘whisper_context_wrapper whisper_init_wrapper(whisper_model_loader_wrapper*)’:
  /tmp/pip-req-build-00vpxnnx/src/main.cpp:76:48: warning: ‘whisper_context* whisper_init(whisper_model_loader*)’ is deprecated: use whisper_init_with_params instead [-Wdeprecated-declarations]
     76 |     struct whisper_context * ctx = whisper_init(loader->ptr);
        |                                    ~~~~~~~~~~~~^~~~~~~~~~~~~
  In file included from /tmp/pip-req-build-00vpxnnx/src/main.cpp:18:
  /tmp/pip-req-build-00vpxnnx/whisper.cpp/src/../include/whisper.h:214:46: note: declared here
    214 |         WHISPER_API struct whisper_context * whisper_init(struct whisper_model_loader * loader),
        |                                              ^~~~~~~~~~~~
  /tmp/pip-req-build-00vpxnnx/whisper.cpp/src/../include/whisper.h:12:44: note: in definition of macro ‘WHISPER_DEPRECATED’
     12 | #    define WHISPER_DEPRECATED(func, hint) func __attribute__((deprecated(hint)))
        |                                            ^~~~
  [38/94] Building CUDA object whisper.cpp/ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/ggml-cuda.cu.o
  FAILED: whisper.cpp/ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/ggml-cuda.cu.o
  /usr/bin/nvcc -forward-unknown-to-host-compiler -DGGML_BACKEND_BUILD -DGGML_BACKEND_SHARED -DGGML_CUDA_PEER_MAX_BATCH_SIZE=128 -DGGML_SCHED_MAX_COPIES=4 -DGGML_SHARED -D_GNU_SOURCE -D_XOPEN_SOURCE=600 -Dggml_cuda_EXPORTS -I/tmp/pip-req-build-00vpxnnx/whisper.cpp/ggml/src/ggml-cuda/.. -I/tmp/pip-req-build-00vpxnnx/whisper.cpp/ggml/src/../include -O3 -DNDEBUG -std=c++17 "--generate-code=arch=compute_52,code=[compute_52,sm_52]" "--generate-code=arch=compute_61,code=[compute_61,sm_61]" "--generate-code=arch=compute_70,code=[compute_70,sm_70]" "--generate-code=arch=compute_75,code=[compute_75,sm_75]" -Xcompiler=-fPIC -use_fast_math -Xcompiler "-Wmissing-declarations -Wmissing-noreturn -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wno-array-bounds -Wextra-semi -Wno-pedantic" -MD -MT whisper.cpp/ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/ggml-cuda.cu.o -MF whisper.cpp/ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/ggml-cuda.cu.o.d -x cu -c /tmp/pip-req-build-00vpxnnx/whisper.cpp/ggml/src/ggml-cuda/ggml-cuda.cu -o whisper.cpp/ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/ggml-cuda.cu.o
  /usr/include/c++/11/bits/std_function.h:435:145: error: parameter packs not expanded with ‘...’:
    435 |         function(_Functor&& __f)
        |                                                                                                                                                 ^
  /usr/include/c++/11/bits/std_function.h:435:145: note:         ‘_ArgTypes’
  /usr/include/c++/11/bits/std_function.h:530:146: error: parameter packs not expanded with ‘...’:
    530 |         operator=(_Functor&& __f)
        |                                                                                                                                                  ^
  /usr/include/c++/11/bits/std_function.h:530:146: note:         ‘_ArgTypes’
  /tmp/pip-req-build-00vpxnnx/whisper.cpp/ggml/src/ggml-cuda/ggml-cuda.cu: In function ‘bool ggml_backend_cuda_register_host_buffer(void*, size_t)’:
  /tmp/pip-req-build-00vpxnnx/whisper.cpp/ggml/src/ggml-cuda/ggml-cuda.cu:2679:51: warning: unused parameter ‘buffer’ [-Wunused-parameter]
   2679 | bool ggml_backend_cuda_register_host_buffer(void * buffer, size_t size) {
        |                                             ~~~~~~^~~~~~
  /tmp/pip-req-build-00vpxnnx/whisper.cpp/ggml/src/ggml-cuda/ggml-cuda.cu:2679:66: warning: unused parameter ‘size’ [-Wunused-parameter]
   2679 | bool ggml_backend_cuda_register_host_buffer(void * buffer, size_t size) {
        |                                                           ~~~~~~~^~~~
  [39/94] Building CUDA object whisper.cpp/ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/mmv.cu.o
  [40/94] Building CUDA object whisper.cpp/ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/rope.cu.o
  [41/94] Building CUDA object whisper.cpp/ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/convert.cu.o
  [42/94] Building CUDA object whisper.cpp/ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/binbcast.cu.o
  [43/94] Building CUDA object whisper.cpp/ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/sumrows.cu.o
  [44/94] Building CUDA object whisper.cpp/ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/upscale.cu.o
  [45/94] Building CUDA object whisper.cpp/ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/tsembd.cu.o
  [46/94] Building CUDA object whisper.cpp/ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/unary.cu.o
  [47/94] Building CUDA object whisper.cpp/ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/sum.cu.o
  [48/94] Building CUDA object whisper.cpp/ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/softmax.cu.o
  [49/94] Building CUDA object whisper.cpp/ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/wkv6.cu.o
  [50/94] Building CUDA object whisper.cpp/ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/fattn-wmma-f16-instance-kqhalf-cpb8.cu.o
  [51/94] Building CUDA object whisper.cpp/ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/fattn-tile-f16.cu.o
  [52/94] Building CUDA object whisper.cpp/ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/fattn.cu.o
  [53/94] Building CUDA object whisper.cpp/ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/fattn-tile-f32.cu.o
  [54/94] Building CUDA object whisper.cpp/ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/fattn-wmma-f16-instance-kqfloat-cpb16.cu.o
  [55/94] Building CUDA object whisper.cpp/ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/fattn-wmma-f16-instance-kqhalf-cpb16.cu.o
  [56/94] Building CUDA object whisper.cpp/ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/fattn-wmma-f16-instance-kqfloat-cpb32.cu.o
  [57/94] Building CUDA object whisper.cpp/ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/fattn-wmma-f16-instance-kqhalf-cpb32.cu.o
  [58/94] Building CUDA object whisper.cpp/ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/mmvq.cu.o
  [59/94] Building CUDA object whisper.cpp/ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/mmq-instance-iq1_s.cu.o
  ninja: build stopped: subcommand failed.
  Traceback (most recent call last):
    File "/home/amitli/python_venvs/venvWhisperCPP/lib/python3.10/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 389, in <module>
      main()
    File "/home/amitli/python_venvs/venvWhisperCPP/lib/python3.10/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 373, in main
      json_out["return_val"] = hook(**hook_input["kwargs"])
    File "/home/amitli/python_venvs/venvWhisperCPP/lib/python3.10/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 280, in build_wheel
      return _build_backend().build_wheel(
    File "/tmp/pip-build-env-q5xsossp/overlay/lib/python3.10/site-packages/setuptools/build_meta.py", line 435, in build_wheel
      return _build(['bdist_wheel', '--dist-info-dir', str(metadata_directory)])
    File "/tmp/pip-build-env-q5xsossp/overlay/lib/python3.10/site-packages/setuptools/build_meta.py", line 423, in _build
      return self._build_with_temp_dir(
    File "/tmp/pip-build-env-q5xsossp/overlay/lib/python3.10/site-packages/setuptools/build_meta.py", line 404, in _build_with_temp_dir
      self.run_setup()
    File "/tmp/pip-build-env-q5xsossp/overlay/lib/python3.10/site-packages/setuptools/build_meta.py", line 317, in run_setup
      exec(code, locals())
    File "<string>", line 240, in <module>
    File "/tmp/pip-build-env-q5xsossp/overlay/lib/python3.10/site-packages/setuptools/__init__.py", line 115, in setup
      return distutils.core.setup(**attrs)
    File "/tmp/pip-build-env-q5xsossp/overlay/lib/python3.10/site-packages/setuptools/_distutils/core.py", line 186, in setup
      return run_commands(dist)
    File "/tmp/pip-build-env-q5xsossp/overlay/lib/python3.10/site-packages/setuptools/_distutils/core.py", line 202, in run_commands
      dist.run_commands()
    File "/tmp/pip-build-env-q5xsossp/overlay/lib/python3.10/site-packages/setuptools/_distutils/dist.py", line 1002, in run_commands
      self.run_command(cmd)
    File "/tmp/pip-build-env-q5xsossp/overlay/lib/python3.10/site-packages/setuptools/dist.py", line 1102, in run_command
      super().run_command(command)
    File "/tmp/pip-build-env-q5xsossp/overlay/lib/python3.10/site-packages/setuptools/_distutils/dist.py", line 1021, in run_command
      cmd_obj.run()
    File "<string>", line 190, in run
    File "/tmp/pip-build-env-q5xsossp/overlay/lib/python3.10/site-packages/setuptools/command/bdist_wheel.py", line 370, in run
      self.run_command("build")
    File "/tmp/pip-build-env-q5xsossp/overlay/lib/python3.10/site-packages/setuptools/_distutils/cmd.py", line 357, in run_command
      self.distribution.run_command(command)
    File "/tmp/pip-build-env-q5xsossp/overlay/lib/python3.10/site-packages/setuptools/dist.py", line 1102, in run_command
      super().run_command(command)
    File "/tmp/pip-build-env-q5xsossp/overlay/lib/python3.10/site-packages/setuptools/_distutils/dist.py", line 1021, in run_command
      cmd_obj.run()
    File "/tmp/pip-build-env-q5xsossp/overlay/lib/python3.10/site-packages/setuptools/_distutils/command/build.py", line 135, in run
      self.run_command(cmd_name)
    File "/tmp/pip-build-env-q5xsossp/overlay/lib/python3.10/site-packages/setuptools/_distutils/cmd.py", line 357, in run_command
      self.distribution.run_command(command)
    File "/tmp/pip-build-env-q5xsossp/overlay/lib/python3.10/site-packages/setuptools/dist.py", line 1102, in run_command
      super().run_command(command)
    File "/tmp/pip-build-env-q5xsossp/overlay/lib/python3.10/site-packages/setuptools/_distutils/dist.py", line 1021, in run_command
      cmd_obj.run()
    File "/tmp/pip-build-env-q5xsossp/overlay/lib/python3.10/site-packages/setuptools/command/build_ext.py", line 96, in run
      _build_ext.run(self)
    File "/tmp/pip-build-env-q5xsossp/overlay/lib/python3.10/site-packages/setuptools/_distutils/command/build_ext.py", line 368, in run
      self.build_extensions()
    File "/tmp/pip-build-env-q5xsossp/overlay/lib/python3.10/site-packages/setuptools/_distutils/command/build_ext.py", line 484, in build_extensions
      self._build_extensions_serial()
    File "/tmp/pip-build-env-q5xsossp/overlay/lib/python3.10/site-packages/setuptools/_distutils/command/build_ext.py", line 510, in _build_extensions_serial
      self.build_extension(ext)
    File "<string>", line 159, in build_extension
    File "/usr/lib/python3.10/subprocess.py", line 526, in run
      raise CalledProcessError(retcode, process.args,
  subprocess.CalledProcessError: Command '['cmake', '--build', '.']' returned non-zero exit status 1.
  [end of output]

note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed building wheel for pywhispercpp
Failed to build pywhispercpp
ERROR: Failed to build installable wheels for some pyproject.toml based projects (pywhispercpp)

[absadiki]

are you able to build whisper.cpp with cuda support ?

[amitli1]

how can I do it ? (how to build whisper.cpp with cuda support ? )

[absadiki]

You can find all the instructions in the project's repository.