From ae43513b391a7a9028257d8220b639e4f72f6552 Mon Sep 17 00:00:00 2001 From: Reelix Date: Wed, 15 Mar 2023 23:32:01 +0200 Subject: [PATCH 1/2] Added install instructions for latest python3 Added install instructions for the versions of `torch` and `sentencepiece` missing from the pip repo on the latest python3 - Used to get this working on Python 3.11.0 --- README.md | 6 ++++++ 1 file changed, 6 insertions(+) diff --git a/README.md b/README.md index 1f7e19412f53..c394bf794e79 100644 --- a/README.md +++ b/README.md @@ -140,6 +140,12 @@ ls ./models # install Python dependencies python3 -m pip install torch numpy sentencepiece +# For later versions of python3 that don't have official torch / sentencepiece packages on pip +# torch: pip3 install torch -f https://download.pytorch.org/whl/torch_stable.html +# sentencepiece +# 1.) https://github.com/google/sentencepiece/actions - Select the lastest passing build and download the artifact file (At the bottom) +# 2.) Copy \wheelhouse\sentencepiece-{Latest}-cp310-cp310-{YourOS_Architecture}.whl to your local folder +# 3.) pip3 install .\sentencepiece-from-above.whl # convert the 7B model to ggml FP16 format python3 convert-pth-to-ggml.py models/7B/ 1 From 11b3dafd2cc27533c53430140ed2a3f5b6387a86 Mon Sep 17 00:00:00 2001 From: Reelix Date: Wed, 15 Mar 2023 23:36:55 +0200 Subject: [PATCH 2/2] Made the file clearer for future python versions Better future-python support instructions. --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index c394bf794e79..99dfbf3bea30 100644 --- a/README.md +++ b/README.md @@ -144,7 +144,7 @@ python3 -m pip install torch numpy sentencepiece # torch: pip3 install torch -f https://download.pytorch.org/whl/torch_stable.html # sentencepiece # 1.) https://github.com/google/sentencepiece/actions - Select the lastest passing build and download the artifact file (At the bottom) -# 2.) Copy \wheelhouse\sentencepiece-{Latest}-cp310-cp310-{YourOS_Architecture}.whl to your local folder +# 2.) Copy \wheelhouse\sentencepiece-{Latest}-cp{PythonVersion}-cp{PythonVersion}-{YourOS_Architecture}.whl to your local folder # 3.) pip3 install .\sentencepiece-from-above.whl # convert the 7B model to ggml FP16 format