« KVarN » : différence entre les versions

Version du 26 juillet 2026 à 09:55

# cd /opt/
# git clone https://github.com/huawei-csl/KVarN.git
# cd KVarN
# VLLM_USE_PRECOMPILED=1 pip install -e .

Vérification :

# python -c "import vllm, vllm._C; print(vllm.__file__); print(vllm._C.__file__)"

# hf download shawnw3i/Qwen3.6-27B-AWQ-MTP --local-dir /opt/models/Qwen3.6-27B-AWQ-MTP

@@ Ligne 5 : / Ligne 5 : @@
   # git clone <nowiki>https://</nowiki>github.com/huawei-csl/KVarN.git
   # cd KVarN
- # curl -LsSf <nowiki>https://</nowiki>astral.sh/uv/install.sh | sh
+  # VLLM_USE_PRECOMPILED=1 pip install -e .
- # source "$HOME/.local/bin/env"
- # uv python install 3.12
- # uv venv --python 3.12 --seed .venv
- # source .venv/bin/activate
- # python -m pip install -U pip setuptools wheel
-  # VLLM_USE_PRECOMPILED=1 python -m pip install -e .
 Vérification :
- # python --version
- # python -m pip --version
   # python -c "import vllm, vllm._C; print(vllm.__file__); print(vllm._C.__file__)"