Repository navigation
Version 0.1.60 does not install correctly #352
Description
Activity
I just tested 0.1.59 - it works.
Reacted by Gary Mulder@Barafu thanks for reporting, likely due to #350, it installed correctly in the actions environment so I assumed it would be fine. I'll work on a fix.
Since you're on windows, is it installed from source or via the wheels from the release page? You should be able to tell by doing calling
pip freeze.pip freezeonly saysllama-cpp-python==0.1.60. I do have various compilers installed, if that is relevant.Thanks! Do you mind running
pip install llama-cpp-python --force-reinstall --upgrade --no-cache-dir --verboseand pasting the output here.Thank you!
Hmm, it looks like the
.dllshould be getting installed according to line 241-- Installing: F:/oobabooga_windows/installer_files/pip-install-r9o9syij/llama-cpp-python_e8ccf4a8b92f4361952dae89106d5f78/llama_cpp/llama.lib -- Installing: F:/oobabooga_windows/installer_files/pip-install-r9o9syij/llama-cpp-python_e8ccf4a8b92f4361952dae89106d5f78/llama_cpp/llama.dll *** scikit-build-core 0.4.4 using CMake 3.26.4I'll set up a github action workflow to install from pypi / run tests.
No
llama.dllexists anywhere, I checked with search. Could it get a wrong name?With 1.59 it goes to
F:\oobabooga_windows\installer_files\env\Lib\site-packages\llama_cpp\llama.dllHaving the same problem. Maybe something to do with
scikit_build_core - WARNING - Can't find a Python library, got libdir=None, ldlibrary=None, multiarch=None, masd=None?I have same problem
...
fatal: not a git repository: /tmp/pip-install-dly1xgll/llama-cpp-python_670d21f762724dc986670f5f60a6d74d/vendor/llama.cpp/../../.git/modules/vendor/llama.cpp
fatal: not a git repository: /tmp/pip-install-dly1xgll/llama-cpp-python_670d21f762724dc986670f5f60a6d74d/vendor/llama.cpp/../../.git/modules/vendor/llama.cpp
...reverting back to 0.1.59 works
adding +1 to 1.60 failing on MacOS with the same error.
Running command Building wheel for llama-cpp-python (pyproject.toml) loading initial cache file /var/folders/wn/8cd29xbx4vq78v3wqm91rdlm0000gn/T/tmp6xdla7wb/build/CMakeInit.txt -- The C compiler identification is AppleClang 14.0.3.14030022 -- The CXX compiler identification is AppleClang 14.0.3.14030022 -- Detecting C compiler ABI info -- Detecting C compiler ABI info - done -- Check for working C compiler: /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/cc - skipped -- Detecting C compile features -- Detecting C compile features - done -- Detecting CXX compiler ABI info -- Detecting CXX compiler ABI info - done -- Check for working CXX compiler: /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/c++ - skipped -- Detecting CXX compile features -- Detecting CXX compile features - done -- Configuring done (1.0s) -- Generating done (0.0s) -- Build files have been written to: /var/folders/wn/8cd29xbx4vq78v3wqm91rdlm0000gn/T/tmp6xdla7wb/build [1/1] cd /private/var/folders/wn/8cd29xbx4vq78v3wqm91rdlm0000gn/T/pip-install-x3i2pshd/llama-cpp-python_1e42829dafad4a18b695aa2c0af0f617/vendor/llama.cpp && make libllama.so I llama.cpp build info: I UNAME_S: Darwin I UNAME_P: arm I UNAME_M: arm64 I CFLAGS: -I. -O3 -std=c11 -fPIC -DNDEBUG -Wall -Wextra -Wpedantic -Wcast-qual -Wdouble-promotion -Wshadow -Wstrict-prototypes -Wpointer-arith -pthread -DGGML_USE_K_QUANTS -DGGML_USE_ACCELERATE I CXXFLAGS: -I. -I./examples -O3 -std=c++11 -fPIC -DNDEBUG -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wno-multichar -pthread I LDFLAGS: -framework Accelerate I CC: Apple clang version 14.0.3 (clang-1403.0.22.14.1) I CXX: Apple clang version 14.0.3 (clang-1403.0.22.14.1) c++ -I. -I./examples -O3 -std=c++11 -fPIC -DNDEBUG -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wno-multichar -pthread -c llama.cpp -o llama.o cc -I. -O3 -std=c11 -fPIC -DNDEBUG -Wall -Wextra -Wpedantic -Wcast-qual -Wdouble-promotion -Wshadow -Wstrict-prototypes -Wpointer-arith -pthread -DGGML_USE_K_QUANTS -DGGML_USE_ACCELERATE -c ggml.c -o ggml.o cc -I. -O3 -std=c11 -fPIC -DNDEBUG -Wall -Wextra -Wpedantic -Wcast-qual -Wdouble-promotion -Wshadow -Wstrict-prototypes -Wpointer-arith -pthread -DGGML_USE_K_QUANTS -DGGML_USE_ACCELERATE -c -o k_quants.o k_quants.c c++ -I. -I./examples -O3 -std=c++11 -fPIC -DNDEBUG -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wno-multichar -pthread -shared -fPIC -o libllama.so llama.o ggml.o k_quants.o -framework Accelerate -- Install configuration: "Release" -- Installing: /private/var/folders/wn/8cd29xbx4vq78v3wqm91rdlm0000gn/T/pip-install-x3i2pshd/llama-cpp-python_1e42829dafad4a18b695aa2c0af0f617/llama_cpp/libllama.so *** scikit-build-core 0.4.4 using CMake 3.26.4 *** Configurating CMake... *** Building project with Ninja... *** Installing project into wheel... *** Making wheel... Building wheel for llama-cpp-python (pyproject.toml) ... done Created wheel for llama-cpp-python: filename=llama_cpp_python-0.1.60-cp310-cp310-macosx_13_0_arm64.whl size=28396 sha256=ba91c2b560e7d5ffd171e2631c5ecf471e4e71d1cda2f3fa3d9a1871d84b20ee Stored in directory: /private/var/folders/wn/8cd29xbx4vq78v3wqm91rdlm0000gn/T/pip-ephem-wheel-cache-9myv_y5t/wheels/eb/a7/7e/e2f6aaef90347cd520e86d37bf5c613d1b96eeab4512dc080a Successfully built llama-cpp-pythonAFAICT the build suceeeds but it's still unable to load.
Yeah it looks like 0.1.60 is completely broken when installing from pip, sorry about that. I'll work on a fix and yank the broken release. Should have this fixed shortly.
Reacted by Doctor ShotgunI've been trying to build 0.1.60 from source all day wondering if it was just me not getting a llama.dll lol. Looking forward to trying out k-quants with the Windows GPU offloading fixes.
@Barafu @minemo @Celppu @stillmatic @DocShotgun pushed v0.1.61 to PyPI, reverted the build system but kept the recent updates / fixes to llama.cpp (metal support still missing until our PR is merged), let me know if everything works now, cheers!
Works for me.
Reacted by AndreiSame on my end. Thanks ^^
@Barafu @minemo @Celppu @stillmatic @DocShotgun pushed v0.1.61 to PyPI, reverted the build system but kept the recent updates / fixes to llama.cpp (metal support still missing until our PR is merged), let me know if everything works now, cheers!
Thank you, 0.1.61 works!
Reacted by Andrei- added a commit that references this issue
on Jun 13, 2023
Short
In the Oobabooga installation, on Windows11, the package stops working when upgrading from 0.1.57 to 0.1.60. Reverting back to 0.1.57 fixes the problem. Complains about
Shared library with base name 'llama' not found. There is no llama.dll anywhere in the folder, only llama.lib . I do not see any compilation errors.Logs.
Installation log:
Launch log