« KVarN » : différence entre les versions
De Le Wiki de Lug
Autres actions
| Ligne 5 : | Ligne 5 : | ||
# git clone <nowiki>https://</nowiki>github.com/huawei-csl/KVarN.git | # git clone <nowiki>https://</nowiki>github.com/huawei-csl/KVarN.git | ||
# cd KVarN | # cd KVarN | ||
# python3 -m venv .venv | # python3.12 -m venv .venv | ||
# source .venv/bin/activate | # source .venv/bin/activate | ||
# python -m pip install -U pip setuptools wheel | # python -m pip install -U pip setuptools wheel | ||
# VLLM_USE_PRECOMPILED=1 pip install -e . | # VLLM_USE_PRECOMPILED=1 python -m pip install -e . | ||
Vérification : | |||
# python -c "import vllm, vllm._C; print(vllm.__file__); print(vllm._C.__file__)" | |||
== Tests en vrac == | == Tests en vrac == | ||
=== [https://huggingface.co/shawnw3i/Qwen3.6-27B-AWQ-MTP shawnw3i/Qwen3.6-27B-AWQ-MTP] === | === [https://huggingface.co/shawnw3i/Qwen3.6-27B-AWQ-MTP shawnw3i/Qwen3.6-27B-AWQ-MTP] === | ||
# hf download shawnw3i/Qwen3.6-27B-AWQ-MTP --local-dir /opt/models/Qwen3.6-27B-AWQ-MTP | # hf download shawnw3i/Qwen3.6-27B-AWQ-MTP --local-dir /opt/models/Qwen3.6-27B-AWQ-MTP | ||
Version du 26 juillet 2026 à 09:41
Installation
# cd /opt/ # git clone https://github.com/huawei-csl/KVarN.git # cd KVarN # python3.12 -m venv .venv # source .venv/bin/activate # python -m pip install -U pip setuptools wheel # VLLM_USE_PRECOMPILED=1 python -m pip install -e .
Vérification :
# python -c "import vllm, vllm._C; print(vllm.__file__); print(vllm._C.__file__)"
Tests en vrac
# hf download shawnw3i/Qwen3.6-27B-AWQ-MTP --local-dir /opt/models/Qwen3.6-27B-AWQ-MTP