« KVarN » : différence entre les versions
De Le Wiki de Lug
Autres actions
| Ligne 8 : | Ligne 8 : | ||
# source "$HOME/.local/bin/env" | # source "$HOME/.local/bin/env" | ||
# uv python install 3.12 | # uv python install 3.12 | ||
# uv venv --python 3.12 .venv | # uv venv --python 3.12 --seed .venv | ||
# source .venv/bin/activate | # source .venv/bin/activate | ||
# python -m pip install -U pip setuptools wheel | # python -m pip install -U pip setuptools wheel | ||
| Ligne 15 : | Ligne 15 : | ||
Vérification : | Vérification : | ||
# python --version | # python --version | ||
# python -m pip --version | |||
# python -c "import vllm, vllm._C; print(vllm.__file__); print(vllm._C.__file__)" | |||
# python -c "import vllm, vllm._C; print(vllm.__file__); print(vllm._C.__file__)" | # python -c "import vllm, vllm._C; print(vllm.__file__); print(vllm._C.__file__)" | ||
Version du 26 juillet 2026 à 09:45
Installation
# cd /opt/ # git clone https://github.com/huawei-csl/KVarN.git # cd KVarN # curl -LsSf https://astral.sh/uv/install.sh | sh # source "$HOME/.local/bin/env" # uv python install 3.12 # uv venv --python 3.12 --seed .venv # source .venv/bin/activate # python -m pip install -U pip setuptools wheel # VLLM_USE_PRECOMPILED=1 python -m pip install -e .
Vérification :
# python --version # python -m pip --version # python -c "import vllm, vllm._C; print(vllm.__file__); print(vllm._C.__file__)" # python -c "import vllm, vllm._C; print(vllm.__file__); print(vllm._C.__file__)"
Tests en vrac
# hf download shawnw3i/Qwen3.6-27B-AWQ-MTP --local-dir /opt/models/Qwen3.6-27B-AWQ-MTP