社区/模型下载
微调
https://github.com/modelscope/swift
https://github.com/hiyouga/LLaMA-Factory
https://huggingface.co/docs/peft/index
模型部署
https://github.com/xorbitsai/inference
模型分发
https://github.com/songquanpeng/one-api
工具调用
https://www.llamaindex.ai/open-source
聊天平台
https://github.com/labring/FastGPT
教程
Open source — LlamaIndex, Data Framework for LLM Applications
生成式AI导论-李宏毅
大模型评分
| Model | Size | MMLU | BBH | C-Eval | CMMLU | Gaokao | CR | RC | Code | Math | GSM8k | Human-Eval pass@1 | MBPP pass@1 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| GPT-4 | - | 83.0 | 86.7 | 69.9 | 71.0 | 72.3 | 89.3 | - | 65.3 | 66.1 | 92.0 | 67.0 | 63.6 |
| GPT-3.5 | - | 69.1 | 70.1 | 52.5 | 55.5 | 51.1 | 83.1 | - | 54.8 | 35.6 | 57.1 | 48.1 | 61.4 |
| Qwen | 14B | 66.7 | 53.4 | 72.1 | 71.0 | 62.5 | 74.2 | 72.5 | 40.6 | 43.1 | - | - | - |
| Llama2 | 34B | 62.6 | 44.1 | - | - | - | 71.1 | 68.9 | 27.8 | 24.2 | - | - | - |
| Baichuan-2 | 13B | 55.0 | 49.0 | 59.0 | 61.97 | 45.6 | 66.3 | 62.4 | 23.4 | 16.1 | - | - | - |
| InternLM | 20B | 62.1 | 52.5 | 58.8 | 59.0 | 45.5 | 78.3 | - | 34.8 | 30.26 | - | - | - |
| Skywork | 13B | 62.1 | 41.7 | 60.6 | 61.8 | 68.1 | 72.4 | 61.4 | 64.9 | 18.1 | - | - | - |
| Falcon | 180B | 70.4 | 54.0 | 57.8 | 58.0 | 59.0 | 74.4 | - | - | - | 54.4 | 0.61 | 47.0 |
| Yi | 6B | 63.2 | 42.8 | 72.0 | 75.5 | 72.2 | 72.2 | 68.7 | 21.1 | 18.6 | - | - | - |
| Yi | 34B | 76.3 | 54.3 | 81.4 | 83.7 | 82.8 | 80.7 | 76.5 | 32.1 | 40.8 | - | - | - |
| Mistral | 7B | - | - | - | - | - | - | - | - | - | 47.5 | 30.5 | 47.5 |
| Llama2-7B | 7B | 46.8 | 38.2 | 32.5 | 31.8 | - | - | - | - | 3.3 | 16.7 | 12.8 | 14.8 |
| Llama2-13B | 13B | 55.0 | 45.6 | 41.4 | 38.4 | - | - | - | - | 5.0 | 29.6 | 18.9 | 30.3 |
| Llama2-34B | 34B | 62.6 | 44.1 | - | - | - | - | - | - | 6.2 | 42.2 | 22.6 | 33.0 |
| Llama2-70B | 70B | 69.8 | 58.4 | 50.1 | 53.6 | - | - | - | - | 10.6 | 54.4 | 23.7 | 37.7 |
| Mixtral-8x7B | - | 70.6 | - | - | - | - | - | - | - | 28.4 | 74.4 | 40.2 | 60.7 |
| Qwen1.5-7B | 7B | 61.0 | 40.2 | 74.1 | 73.1 | - | - | - | - | 20.3 | 62.5 | 36.0 | 37.4 |
| Qwen1.5-14B | 14B | 67.6 | 53.7 | 78.7 | 77.6 | - | - | - | - | 29.2 | 70.1 | 37.8 | 44.0 |
| Qwen1.5-72B | 72B | 77.5 | 65.5 | 84.1 | 83.5 | - | - | - | - | 34.1 | 79.5 | 41.5 | 53.4 |