参看:
https://github.com/openvinotoolkit/openvino.genai/releases/tag/2024.4.0.0
https://github.com/TommyZihao/openvino_tonypi/blob/main/OpenVINO-0911/AIPC%E4%BB%A3%E7%A0%81/%E3%80%90B1%E3%80%91%E4%B8%89%E8%A1%8C%E4%BB%A3%E7%A0%81%E5%BC%80%E5%90%AF%E5%A4%A7%E6%A8%A1%E5%9E%8B%E5%AF%B9%E8%AF%9D.ipynb、
安装
https://docs.openvino.ai/2024/get-started/install-openvino/install-openvino-genai.html
python -m pip install openvino-genai optimum[openvino]
下载模型:
export HF_ENDPOINT=https://hf-mirror.com
huggingface-cli download --resume-download --local-dir-use-symlinks False Qwen/Qwen2.5-1.5B-Instruct --local-dir qwen2.5-1.5b
模型转换:
参数参看https://huggingface.co/docs/optimum/intel