debug
startup.py:454 "/root/pyenv/bin/streamlit"
模型配置路径 - 替换模型
startup.py:688 config = get_model_worker_config(model_name)
model_config.py
找到模型加载代码
fastchat库支持的模型
FastChat/docs/model_support.md at main · lm-sys/FastChat · GitHub
startup.py:
run_model_worker() ->
create_model_worker_app()
标签:startup,模型,py,worker,langchain,chat,model,config From: https://www.cnblogs.com/levylaw/p/18066457
端口配置?
server_config.py?
中文LLM排名
https://github.com/jeinlee1991/chinese-llm-benchmark