Issues

• 模型分片了怎么指定load_model_path

  ProjectD-AI/llama_inference#18 · Filter by author caowenhero opened on Jul 26, 2023
  1

• 你好 请问支持llama 65B了嘛

  ProjectD-AI/llama_inference#17 · Filter by author zcuuu opened on Jun 13, 2023
  1

• lora模型推理啥时候能出来啊

  ProjectD-AI/llama_inference#15 · Filter by author isaacxie41 opened on May 30, 2023
  1

• 为什么LLaMa模型只有encoder没有decoder

  ProjectD-AI/llama_inference#14 · Filter by author yyqi17 opened on May 25, 2023
  1

• 生成乱码

  ProjectD-AI/llama_inference#13 · Filter by author McCarrtney opened on May 24, 2023
  4

• 运行多轮对话时代码报错

  ProjectD-AI/llama_inference#12 · Filter by author LJL00000 opened on May 22, 2023
  1

• RuntimeError: probability tensor contains either inf, nan or element < 0

  ProjectD-AI/llama_inference#11 · Filter by author yingzhao27 opened on May 18, 2023
  2

• fp32 精度-inference

  ProjectD-AI/llama_inference#10 · Filter by author biubiobiu opened on May 5, 2023
  3

• llama_server.py支持多卡推理吗

  ProjectD-AI/llama_inference#7 · Filter by author yuxuan2015 opened on Apr 21, 2023
  3

• 求老哥搞个lora的

  ProjectD-AI/llama_inference#6 · Filter by author ze00ro opened on Apr 20, 2023
  1

• assert batch <= args.batch_size AssertionError

  ProjectD-AI/llama_inference#2 · Filter by author baketbek opened on Apr 17, 2023
  1