Skip to content
Closed
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 6 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -140,6 +140,12 @@ ls ./models

# install Python dependencies
python3 -m pip install torch numpy sentencepiece
# For later versions of python3 that don't have official torch / sentencepiece packages on pip
# torch: pip3 install torch -f https://download.pytorch.org/whl/torch_stable.html
# sentencepiece
# 1.) https://github.com/google/sentencepiece/actions - Select the lastest passing build and download the artifact file (At the bottom)
# 2.) Copy \wheelhouse\sentencepiece-{Latest}-cp{PythonVersion}-cp{PythonVersion}-{YourOS_Architecture}.whl to your local folder
# 3.) pip3 install .\sentencepiece-from-above.whl

# convert the 7B model to ggml FP16 format
python3 convert-pth-to-ggml.py models/7B/ 1
Expand Down