Can it provide an cmake option to disable building of libllama.so? #484

Activity

1. abetlen commented on Jul 18, 2023

   

   abetlen

   on Jul 18, 2023

   Owner

   More actions

   @Freed-Wu happy to add this, the main issue I see coming up is version mismatch between llama-cpp-python and llama.cpp.
2. Freed-Wu commented on Jul 18, 2023

   

   Freed-Wu

   on Jul 18, 2023

   Last edited by Freed-Wu

   Author

   More actions

   the main issue I see coming up is version mismatch between llama-cpp-python and llama.cpp.

   This issue just leave packager solve it. they have duty to keep it match. It is not a default option so no users will meet it.
3. Freed-Wu commented on Jul 19, 2023

   

   Freed-Wu

   on Jul 19, 2023

   Last edited by Freed-Wu

   Author

   More actions

   And if user install the package without building libllama.so, Can this package load it from platformdir's user_data_dir, site_data_dir?

   import sys
   from ctypes import CDLL
   from pathlib import Path
   
   from platfromdirs import user_data_dir
   
   ext = {"linux": "so", "win32": "dll", "darwin": "dylib"}[sys.platform]
   for libpath in [Path(__file__).parent, user_data_path().parent / 'lib', site_data_path().parent / 'lib']:
       if not (libpath / f"libllama.{ext}").exists():
           continute
       dll_path = str(libpath)
   dll = CDLL(dll_path)
4. gjmulder

   added

   enhancementNew feature or requestNew feature or request

   build

   on Jul 30, 2023
5. abetlen commented on Sep 13, 2023

   

   abetlen

   on Sep 13, 2023

   Owner

   More actions

   Added in v0.2 was a LLAMA_BUILD cmake flag that can be set to OFF to disable compiling the library, then you can just use the LLAMA_CPP_LIB env variable to point to a pre-built shared library (no guarantee on version compatibility though).
6. abetlen

   closed this as completedon Sep 13, 2023