镜像：jupyterlab-pytorch:2.3.0-ubuntu22.04-dtk24.04.2-py3.11-devel
运行三个export, 设置了代理
安装：
git clone http://developer.hpccube.com/codes/OpenDAS/llama-factory.git
cd /your_code_path/llama_factory
pip install -e ".[torch,metrics]" --index-url https://pypi.tuna.tsinghua.edu.cn/simple

运行：
llamafactory-cli -h

报错：

rotary_emb相关

pip show llamafactory
Name: llamafactory
Version: 0.9.3.dev0
Summary: Unified Efficient Fine-Tuning of 100+ LLMs
Home-page: https://github.com/hiyouga/LLaMA-Factory
Author: hiyouga
Author-email: hiyouga@buaa.edu.cn
License: Apache 2.0 License
Location: /opt/conda/lib/python3.11/site-packages
Editable project location: /work/home/acfxqgurt5/llm/llama-factory
Requires: accelerate, av, datasets, einops, fastapi, fire, gradio, librosa, matplotlib, numpy, omegaconf, packaging, pandas, peft, protobuf, pydantic, pyyaml, scipy, sentencepiece, sse-starlette, tiktoken, tokenizers, transformers, trl, tyro, uvicorn
Required-by:
root@worker-0:/work/home/acfxqgurt5/llm/llama-factory# llamafactory-cli -h
Traceback (most recent call last):
File "/opt/conda/lib/python3.11/site-packages/transformers/utils/import_utils.py", line 1967, in _get_module
return importlib.import_module("." + module_name, self.name)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/conda/lib/python3.11/importlib/init.py", line 126, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File " <frozen importlib._bootstrap>", line 1204, in _gcd_import
File " <frozen importlib._bootstrap>", line 1176, in _find_and_load
File " <frozen importlib._bootstrap>", line 1147, in _find_and_load_unlocked
File " <frozen importlib._bootstrap>", line 690, in _load_unlocked
File " <frozen importlib._bootstrap_external>", line 940, in exec_module
File " <frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
File "/opt/conda/lib/python3.11/site-packages/transformers/models/bloom/modeling_bloom.py", line 38, in <module>
from ...modeling_utils import PreTrainedModel
File "/opt/conda/lib/python3.11/site-packages/transformers/modeling_utils.py", line 62, in <module>
from .integrations.flash_attention import flash_attention_forward
File "/opt/conda/lib/python3.11/site-packages/transformers/integrations/flash_attention.py", line 5, in <module>
from ..modeling_flash_attention_utils import _flash_attention_forward, flash_attn_supports_top_left_mask
File "/opt/conda/lib/python3.11/site-packages/transformers/modeling_flash_attention_utils.py", line 38, in <module>
from flash_attn.layers.rotary import apply_rotary_emb # noqa
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/conda/lib/python3.11/site-packages/flash_attn/layers/rotary.py", line 10, in <module>
import rotary_emb
ModuleNotFoundError: No module named 'rotary_emb'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/opt/conda/bin/llamafactory-cli", line 5, in <module>
from llamafactory.cli import main
File "/work/home/acfxqgurt5/llm/llama-factory/src/llamafactory/init.py", line 28, in <module>
from .extras.env import VERSION
File "/work/home/acfxqgurt5/llm/llama-factory/src/llamafactory/extras/env.py", line 22, in <module>
import peft
File "/opt/conda/lib/python3.11/site-packages/peft/init.py", line 17, in <module>
from .auto import (
File "/opt/conda/lib/python3.11/site-packages/peft/auto.py", line 31, in <module>
from .config import PeftConfig
File "/opt/conda/lib/python3.11/site-packages/peft/config.py", line 24, in <module>
from .utils import CONFIG_NAME, PeftType, TaskType
File "/opt/conda/lib/python3.11/site-packages/peft/utils/init.py", line 17, in <module>
from .other import (
File "/opt/conda/lib/python3.11/site-packages/peft/utils/other.py", line 34, in <module>
from .constants import (
File "/opt/conda/lib/python3.11/site-packages/peft/utils/constants.py", line 16, in <module>
from transformers import BloomPreTrainedModel
File " <frozen importlib._bootstrap>", line 1229, in _handle_fromlist
File "/opt/conda/lib/python3.11/site-packages/transformers/utils/import_utils.py", line 1956, in getattr
value = getattr(module, name)
^^^^^^^^^^^^^^^^^^^^^
File "/opt/conda/lib/python3.11/site-packages/transformers/utils/import_utils.py", line 1955, in getattr
module = self._get_module(self._class_to_module[name])
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/conda/lib/python3.11/site-packages/transformers/utils/import_utils.py", line 1969, in _get_module
raise RuntimeError(
RuntimeError: Failed to import transformers.models.bloom.modeling_bloom because of the following error (look up to see its traceback):
No module named 'rotary_emb'
root@worker-0:/work/home/acfxqgurt5/llm/llama-factory# pip install rotary_emb
^CERROR: Operation cancelled by user
root@worker-0:/work/home/acfxqgurt5/llm/llama-factory# pip install rotary_emb --index-url https://pypi.tuna.tsinghua.edu.cn/simple
Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple
Collecting rotary_emb
Downloading https://pypi.tuna.tsinghua.edu.cn/packages/b8/86/7650135058a7893f7d3eace42b723fb9216839e1a1d0e8836180d8efaa27/rotary_emb-0.5.2.tar.gz (3.6 kB)
Preparing metadata (setup.py) ... error
error: subprocess-exited-with-error

× python setup.py egg_info did not run successfully.
│ exit code: 1
╰─> [13 lines of output]
Traceback (most recent call last):
File "<string>", line 2, in <module>
File "<pip-setuptools-caller>", line 34, in <module>
File "/tmp/pip-install-4dethqmj/rotary-emb_3b705c8b1b1340329927031c5e2b2730/setup.py", line 90, in <module>
raise_if_cuda_home_none("rotary_emb")
File "/tmp/pip-install-4dethqmj/rotary-emb_3b705c8b1b1340329927031c5e2b2730/setup.py", line 44, in raise_if_cuda_home_none
raise RuntimeError(
RuntimeError: rotary_emb was requested, but nvcc was not found. Are you sure your environment has nvcc available? If you're installing within a container from https://hub.docker.com/r/pytorch/pytorch, only images whose names contain 'devel' will provide nvcc.

  torch.__version__  = 2.3.0
  
  
  [end of output]

note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed

× Encountered error while generating package metadata.
╰─> See above for output.

note: This is an issue with the package mentioned above, not pip.
hint: See above for details.

====
安装log:
pip install -e ".[torch,metrics]" --index-url https://pypi.tuna.tsinghua.edu.cn/simple
Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple
Obtaining file:///work/home/acfxqgurt5/llm/llama-factory
Installing build dependencies ... done
Checking if build backend supports build_editable ... done
Getting requirements to build editable ... done
Preparing editable metadata (pyproject.toml) ... done
Collecting transformers!=4.46.,!=4.47.,!=4.48.0,<=4.51.3,>=4.45.0 (from llamafactory==0.9.3.dev0)
Downloading https://pypi.tuna.tsinghua.edu.cn/packages/a9/b6/5257d04ae327b44db31f15cce39e6020cc986333c715660b1315a9724d82/transformers-4.51.3-py3-none-any.whl (10.4 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 10.4/10.4 MB 10.7 MB/s eta 0:00:00
Requirement already satisfied: datasets<=3.5.0,>=2.16.0 in /opt/conda/lib/python3.11/site-packages (from llamafactory==0.9.3.dev0) (3.0.1)
Collecting accelerate<=1.6.0,>=0.34.0 (from llamafactory==0.9.3.dev0)
Downloading https://pypi.tuna.tsinghua.edu.cn/packages/63/b1/8198e3cdd11a426b1df2912e3381018c4a4a55368f6d0857ba3ca418ef93/accelerate-1.6.0-py3-none-any.whl (354 kB)
Collecting peft<=0.15.1,>=0.14.0 (from llamafactory==0.9.3.dev0)
Downloading https://pypi.tuna.tsinghua.edu.cn/packages/d5/47/f2938c20b1c6d7b738ca2a129cf73cd1453cea76d5c9a2f2bbf6199bf037/peft-0.15.1-py3-none-any.whl (411 kB)
Collecting trl<=0.9.6,>=0.8.6 (from llamafactory==0.9.3.dev0)
Downloading https://pypi.tuna.tsinghua.edu.cn/packages/a5/c3/6565c2c376a829f99da20d39c2912405195ec1fa6aae068dc45c46793e72/trl-0.9.6-py3-none-any.whl (245 kB)
Collecting tokenizers<=0.21.1,>=0.19.0 (from llamafactory==0.9.3.dev0)
Downloading https://pypi.tuna.tsinghua.edu.cn/packages/8a/63/38be071b0c8e06840bc6046991636bcb30c27f6bb1e670f4f4bc87cf49cc/tokenizers-0.21.1-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.0/3.0 MB 53.8 MB/s eta 0:00:00
Collecting gradio<=5.25.0,>=4.38.0 (from llamafactory==0.9.3.dev0)
Downloading https://pypi.tuna.tsinghua.edu.cn/packages/8e/b1/62d4b3f0573dfdb3b7ba1748f030a8433b6a7bc00c60e643dd1904549e43/gradio-5.25.0-py3-none-any.whl (46.9 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 46.9/46.9 MB 26.2 MB/s eta 0:00:00
Collecting scipy (from llamafactory==0.9.3.dev0)
Downloading https://pypi.tuna.tsinghua.edu.cn/packages/bd/37/89f19c8c05505d0601ed5650156e50eb881ae3918786c8fd7262b4ee66d3/scipy-1.15.3-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (37.7 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 37.7/37.7 MB 25.8 MB/s eta 0:00:00
Requirement already satisfied: einops in /opt/conda/lib/python3.11/site-packages (from llamafactory==0.9.3.dev0) (0.8.0)
Requirement already satisfied: sentencepiece in /opt/conda/lib/python3.11/site-packages (from llamafactory==0.9.3.dev0) (0.2.0)
Requirement already satisfied: tiktoken in /opt/conda/lib/python3.11/site-packages (from llamafactory==0.9.3.dev0) (0.8.0)
Requirement already satisfied: protobuf in /opt/conda/lib/python3.11/site-packages (from llamafactory==0.9.3.dev0) (5.28.2)
Requirement already satisfied: uvicorn in /opt/conda/lib/python3.11/site-packages (from llamafactory==0.9.3.dev0) (0.31.1)
Requirement already satisfied: fastapi in /opt/conda/lib/python3.11/site-packages (from llamafactory==0.9.3.dev0) (0.115.0)
Collecting sse-starlette (from llamafactory==0.9.3.dev0)
Downloading https://pypi.tuna.tsinghua.edu.cn/packages/c8/48/3e49cf0f64961656402c0023edbc51844fe17afe53ab50e958a6dbbbd499/sse_starlette-2.3.5-py3-none-any.whl (10 kB)
Requirement already satisfied: matplotlib>=3.7.0 in /opt/conda/lib/python3.11/site-packages (from llamafactory==0.9.3.dev0) (3.9.2)
Collecting fire (from llamafactory==0.9.3.dev0)
Downloading https://pypi.tuna.tsinghua.edu.cn/packages/6b/b6/82c7e601d6d3c3278c40b7bd35e17e82aa227f050aa9f66cb7b7fce29471/fire-0.7.0.tar.gz (87 kB)
Preparing metadata (setup.py) ... done
Collecting omegaconf (from llamafactory==0.9.3.dev0)
Downloading https://pypi.tuna.tsinghua.edu.cn/packages/e3/94/1843518e420fa3ed6919835845df698c7e27e183cb997394e4a670973a65/omegaconf-2.3.0-py3-none-any.whl (79 kB)
Requirement already satisfied: packaging in /opt/conda/lib/python3.11/site-packages (from llamafactory==0.9.3.dev0) (24.1)
Requirement already satisfied: pyyaml in /opt/conda/lib/python3.11/site-packages (from llamafactory==0.9.3.dev0) (6.0.2)
Requirement already satisfied: numpy<2.0.0 in /opt/conda/lib/python3.11/site-packages (from llamafactory==0.9.3.dev0) (1.24.3)
Requirement already satisfied: pydantic<=2.10.6 in /opt/conda/lib/python3.11/site-packages (from llamafactory==0.9.3.dev0) (2.9.2)
Requirement already satisfied: pandas>=2.0.0 in /opt/conda/lib/python3.11/site-packages (from llamafactory==0.9.3.dev0) (2.2.3)
Collecting av (from llamafactory==0.9.3.dev0)
Downloading https://pypi.tuna.tsinghua.edu.cn/packages/f8/9a/8ffabfcafb42154b4b3a67d63f9b69e68fa8c34cb39ddd5cb813dd049ed4/av-14.4.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (35.3 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 35.3/35.3 MB 24.7 MB/s eta 0:00:00
Collecting librosa (from llamafactory==0.9.3.dev0)
Downloading https://pypi.tuna.tsinghua.edu.cn/packages/b5/ba/c63c5786dfee4c3417094c4b00966e61e4a63efecee22cb7b4c0387dda83/librosa-0.11.0-py3-none-any.whl (260 kB)
Collecting tyro<0.9.0 (from llamafactory==0.9.3.dev0)
Downloading https://pypi.tuna.tsinghua.edu.cn/packages/60/ec/e34d546cfd9c5b906d1d534bb75557be9f2b179609d60bb9e97ec07e8ead/tyro-0.8.14-py3-none-any.whl (109 kB)
Requirement already satisfied: torch>=1.13.1 in /opt/conda/lib/python3.11/site-packages (from llamafactory==0.9.3.dev0) (2.3.0+das.opt1.dtk24042)
Collecting nltk (from llamafactory==0.9.3.dev0)
Downloading https://pypi.tuna.tsinghua.edu.cn/packages/4d/66/7d9e26593edda06e8cb531874633f7c2372279c3b0f46235539fe546df8b/nltk-3.9.1-py3-none-any.whl (1.5 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.5/1.5 MB 75.1 MB/s eta 0:00:00
Collecting jieba (from llamafactory==0.9.3.dev0)
Downloading https://pypi.tuna.tsinghua.edu.cn/packages/c6/cb/18eeb235f833b726522d7ebed54f2278ce28ba9438e3135ab0278d9792a2/jieba-0.42.1.tar.gz (19.2 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 19.2/19.2 MB 25.5 MB/s eta 0:00:00
Preparing metadata (setup.py) ... done
Collecting rouge-chinese (from llamafactory==0.9.3.dev0)
Downloading https://pypi.tuna.tsinghua.edu.cn/packages/03/0f/394cf877be7b903881020ef7217f7dc644dad158d52a9353fcab22e3464d/rouge_chinese-1.0.3-py3-none-any.whl (21 kB)
Requirement already satisfied: psutil in /opt/conda/lib/python3.11/site-packages (from accelerate<=1.6.0,>=0.34.0->llamafactory==0.9.3.dev0) (6.0.0)
Requirement already satisfied: huggingface-hub>=0.21.0 in /opt/conda/lib/python3.11/site-packages (from accelerate<=1.6.0,>=0.34.0->llamafactory==0.9.3.dev0) (0.25.2)
Requirement already satisfied: safetensors>=0.4.3 in /opt/conda/lib/python3.11/site-packages (from accelerate<=1.6.0,>=0.34.0->llamafactory==0.9.3.dev0) (0.4.5)
Requirement already satisfied: filelock in /opt/conda/lib/python3.11/site-packages (from datasets<=3.5.0,>=2.16.0->llamafactory==0.9.3.dev0) (3.16.1)
Requirement already satisfied: pyarrow>=15.0.0 in /opt/conda/lib/python3.11/site-packages (from datasets<=3.5.0,>=2.16.0->llamafactory==0.9.3.dev0) (17.0.0)
Requirement already satisfied: dill<0.3.9,>=0.3.0 in /opt/conda/lib/python3.11/site-packages (from datasets<=3.5.0,>=2.16.0->llamafactory==0.9.3.dev0) (0.3.8)
Requirement already satisfied: requests>=2.32.2 in /opt/conda/lib/python3.11/site-packages (from datasets<=3.5.0,>=2.16.0->llamafactory==0.9.3.dev0) (2.32.3)
Requirement already satisfied: tqdm>=4.66.3 in /opt/conda/lib/python3.11/site-packages (from datasets<=3.5.0,>=2.16.0->llamafactory==0.9.3.dev0) (4.66.4)
Requirement already satisfied: xxhash in /opt/conda/lib/python3.11/site-packages (from datasets<=3.5.0,>=2.16.0->llamafactory==0.9.3.dev0) (3.5.0)
Requirement already satisfied: multiprocess in /opt/conda/lib/python3.11/site-packages (from datasets<=3.5.0,>=2.16.0->llamafactory==0.9.3.dev0) (0.70.16)
Requirement already satisfied: fsspec<=2024.6.1,>=2023.1.0 in /opt/conda/lib/python3.11/site-packages (from fsspec[http]<=2024.6.1,>=2023.1.0->datasets<=3.5.0,>=2.16.0->llamafactory==0.9.3.dev0) (2024.6.1)
Requirement already satisfied: aiohttp in /opt/conda/lib/python3.11/site-packages (from datasets<=3.5.0,>=2.16.0->llamafactory==0.9.3.dev0) (3.10.9)
Collecting aiofiles<25.0,>=22.0 (from gradio<=5.25.0,>=4.38.0->llamafactory==0.9.3.dev0)
Downloading https://pypi.tuna.tsinghua.edu.cn/packages/a5/45/30bb92d442636f570cb5651bc661f52b610e2eec3f891a5dc3a4c3667db0/aiofiles-24.1.0-py3-none-any.whl (15 kB)
Requirement already satisfied: anyio<5.0,>=3.0 in /opt/conda/lib/python3.11/site-packages (from gradio<=5.25.0,>=4.38.0->llamafactory==0.9.3.dev0) (4.6.0)
Collecting fastapi (from llamafactory==0.9.3.dev0)
Downloading https://pypi.tuna.tsinghua.edu.cn/packages/50/b3/b51f09c2ba432a576fe63758bddc81f78f0c6309d9e5c10d194313bf021e/fastapi-0.115.12-py3-none-any.whl (95 kB)
Collecting ffmpy (from gradio<=5.25.0,>=4.38.0->llamafactory==0.9.3.dev0)
Downloading https://pypi.tuna.tsinghua.edu.cn/packages/53/5d/65f40bd333463b3230b3a72d93873caaf49b0cbb5228598fafb75fcc5357/ffmpy-0.5.0-py3-none-any.whl (6.0 kB)
Collecting gradio-client==1.8.0 (from gradio<=5.25.0,>=4.38.0->llamafactory==0.9.3.dev0)
Downloading https://pypi.tuna.tsinghua.edu.cn/packages/15/c8/0df7f92c8f1bdf5c244c29de8cd7e33a5931768ddba245526a770bfa18a2/gradio_client-1.8.0-py3-none-any.whl (322 kB)
Collecting groovy~=0.1 (from gradio<=5.25.0,>=4.38.0->llamafactory==0.9.3.dev0)
Downloading https://pypi.tuna.tsinghua.edu.cn/packages/28/27/3d6dcadc8a3214d8522c1e7f6a19554e33659be44546d44a2f7572ac7d2a/groovy-0.1.2-py3-none-any.whl (14 kB)
Requirement already satisfied: httpx>=0.24.1 in /opt/conda/lib/python3.11/site-packages (from gradio<=5.25.0,>=4.38.0->llamafactory==0.9.3.dev0) (0.27.2)
Collecting huggingface-hub>=0.21.0 (from accelerate<=1.6.0,>=0.34.0->llamafactory==0.9.3.dev0)
Downloading https://pypi.tuna.tsinghua.edu.cn/packages/33/c7/852d4473788cfd7d79b73951244b87a6d75fdac296c90aeb5e85dbb2fb5e/huggingface_hub-0.31.4-py3-none-any.whl (489 kB)
Requirement already satisfied: jinja2<4.0 in /opt/conda/lib/python3.11/site-packages (from gradio<=5.25.0,>=4.38.0->llamafactory==0.9.3.dev0) (3.1.4)
Requirement already satisfied: markupsafe<4.0,>=2.0 in /opt/conda/lib/python3.11/site-packages (from gradio<=5.25.0,>=4.38.0->llamafactory==0.9.3.dev0) (3.0.1)
Collecting orjson~=3.0 (from gradio<=5.25.0,>=4.38.0->llamafactory==0.9.3.dev0)
Downloading https://pypi.tuna.tsinghua.edu.cn/packages/d2/78/ddd3ee7873f2b5f90f016bc04062713d567435c53ecc8783aab3a4d34915/orjson-3.10.18-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (132 kB)
Requirement already satisfied: pillow<12.0,>=8.0 in /opt/conda/lib/python3.11/site-packages (from gradio<=5.25.0,>=4.38.0->llamafactory==0.9.3.dev0) (10.4.0)
Collecting pydub (from gradio<=5.25.0,>=4.38.0->llamafactory==0.9.3.dev0)
Downloading https://pypi.tuna.tsinghua.edu.cn/packages/a6/53/d78dc063216e62fc55f6b2eebb447f6a4b0a59f55c8406376f76bf959b08/pydub-0.25.1-py2.py3-none-any.whl (32 kB)
Collecting python-multipart>=0.0.18 (from gradio<=5.25.0,>=4.38.0->llamafactory==0.9.3.dev0)
Downloading https://pypi.tuna.tsinghua.edu.cn/packages/45/58/38b5afbc1a800eeea951b9285d3912613f2603bdf897a4ab0f4bd7f405fc/python_multipart-0.0.20-py3-none-any.whl (24 kB)
Collecting ruff>=0.9.3 (from gradio<=5.25.0,>=4.38.0->llamafactory==0.9.3.dev0)
Downloading https://pypi.tuna.tsinghua.edu.cn/packages/62/b3/a63b4e91850e3f47f78795e6630ee9266cb6963de8f0191600289c2bb8f4/ruff-0.11.10-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (11.6 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11.6/11.6 MB 26.3 MB/s eta 0:00:00
Collecting safehttpx<0.2.0,>=0.1.6 (from gradio<=5.25.0,>=4.38.0->llamafactory==0.9.3.dev0)
Downloading https://pypi.tuna.tsinghua.edu.cn/packages/4d/c0/1108ad9f01567f66b3154063605b350b69c3c9366732e09e45f9fd0d1deb/safehttpx-0.1.6-py3-none-any.whl (8.7 kB)
Collecting semantic-version~=2.0 (from gradio<=5.25.0,>=4.38.0->llamafactory==0.9.3.dev0)
Downloading https://pypi.tuna.tsinghua.edu.cn/packages/6a/23/8146aad7d88f4fcb3a6218f41a60f6c2d4e3a72de72da1825dc7c8f7877c/semantic_version-2.10.0-py2.py3-none-any.whl (15 kB)
Collecting starlette<1.0,>=0.40.0 (from gradio<=5.25.0,>=4.38.0->llamafactory==0.9.3.dev0)
Downloading https://pypi.tuna.tsinghua.edu.cn/packages/8b/0c/9d30a4ebeb6db2b25a841afbb80f6ef9a854fc3b41be131d249a977b4959/starlette-0.46.2-py3-none-any.whl (72 kB)
Collecting tomlkit<0.14.0,>=0.12.0 (from gradio<=5.25.0,>=4.38.0->llamafactory==0.9.3.dev0)
Downloading https://pypi.tuna.tsinghua.edu.cn/packages/f9/b6/a447b5e4ec71e13871be01ba81f5dfc9d0af7e473da256ff46bc0e24026f/tomlkit-0.13.2-py3-none-any.whl (37 kB)
Collecting typer<1.0,>=0.12 (from gradio<=5.25.0,>=4.38.0->llamafactory==0.9.3.dev0)
Downloading https://pypi.tuna.tsinghua.edu.cn/packages/c9/62/d4ba7afe2096d5659ec3db8b15d8665bdcb92a3c6ff0b95e99895b335a9c/typer-0.15.4-py3-none-any.whl (45 kB)
Requirement already satisfied: typing-extensions~=4.0 in /opt/conda/lib/python3.11/site-packages (from gradio<=5.25.0,>=4.38.0->llamafactory==0.9.3.dev0) (4.12.2)
Requirement already satisfied: websockets<16.0,>=10.0 in /opt/conda/lib/python3.11/site-packages (from gradio-client==1.8.0->gradio<=5.25.0,>=4.38.0->llamafactory==0.9.3.dev0) (13.1)
Requirement already satisfied: contourpy>=1.0.1 in /opt/conda/lib/python3.11/site-packages (from matplotlib>=3.7.0->llamafactory==0.9.3.dev0) (1.3.0)
Requirement already satisfied: cycler>=0.10 in /opt/conda/lib/python3.11/site-packages (from matplotlib>=3.7.0->llamafactory==0.9.3.dev0) (0.12.1)
Requirement already satisfied: fonttools>=4.22.0 in /opt/conda/lib/python3.11/site-packages (from matplotlib>=3.7.0->llamafactory==0.9.3.dev0) (4.54.1)
Requirement already satisfied: kiwisolver>=1.3.1 in /opt/conda/lib/python3.11/site-packages (from matplotlib>=3.7.0->llamafactory==0.9.3.dev0) (1.4.7)
Requirement already satisfied: pyparsing>=2.3.1 in /opt/conda/lib/python3.11/site-packages (from matplotlib>=3.7.0->llamafactory==0.9.3.dev0) (3.1.4)
Requirement already satisfied: python-dateutil>=2.7 in /opt/conda/lib/python3.11/site-packages (from matplotlib>=3.7.0->llamafactory==0.9.3.dev0) (2.9.0.post0)
Requirement already satisfied: pytz>=2020.1 in /opt/conda/lib/python3.11/site-packages (from pandas>=2.0.0->llamafactory==0.9.3.dev0) (2024.2)
Requirement already satisfied: tzdata>=2022.7 in /opt/conda/lib/python3.11/site-packages (from pandas>=2.0.0->llamafactory==0.9.3.dev0) (2024.2)
Requirement already satisfied: annotated-types>=0.6.0 in /opt/conda/lib/python3.11/site-packages (from pydantic<=2.10.6->llamafactory==0.9.3.dev0) (0.7.0)
Requirement already satisfied: pydantic-core==2.23.4 in /opt/conda/lib/python3.11/site-packages (from pydantic<=2.10.6->llamafactory==0.9.3.dev0) (2.23.4)
Requirement already satisfied: sympy in /opt/conda/lib/python3.11/site-packages (from torch>=1.13.1->llamafactory==0.9.3.dev0) (1.13.3)
Requirement already satisfied: networkx in /opt/conda/lib/python3.11/site-packages (from torch>=1.13.1->llamafactory==0.9.3.dev0) (3.3)
Requirement already satisfied: regex!=2019.12.17 in /opt/conda/lib/python3.11/site-packages (from transformers!=4.46.*,!=4.47.*,!=4.48.0,<=4.51.3,>=4.45.0->llamafactory==0.9.3.dev0) (2024.9.11)
Collecting docstring-parser>=0.16 (from tyro<0.9.0->llamafactory==0.9.3.dev0)
Downloading https://pypi.tuna.tsinghua.edu.cn/packages/d5/7c/e9fcff7623954d86bdc17782036cbf715ecab1bec4847c008557affe1ca8/docstring_parser-0.16-py3-none-any.whl (36 kB)
Requirement already satisfied: rich>=11.1.0 in /opt/conda/lib/python3.11/site-packages (from tyro<0.9.0->llamafactory==0.9.3.dev0) (13.9.2)
Collecting shtab>=1.5.6 (from tyro<0.9.0->llamafactory==0.9.3.dev0)
Downloading https://pypi.tuna.tsinghua.edu.cn/packages/74/03/3271b7bb470fbab4adf5bd30b0d32143909d96f3608d815b447357f47f2b/shtab-1.7.2-py3-none-any.whl (14 kB)
Requirement already satisfied: click>=7.0 in /opt/conda/lib/python3.11/site-packages (from uvicorn->llamafactory==0.9.3.dev0) (8.1.7)
Requirement already satisfied: h11>=0.8 in /opt/conda/lib/python3.11/site-packages (from uvicorn->llamafactory==0.9.3.dev0) (0.14.0)
Requirement already satisfied: termcolor in /opt/conda/lib/python3.11/site-packages (from fire->llamafactory==0.9.3.dev0) (2.5.0)
Collecting audioread>=2.1.9 (from librosa->llamafactory==0.9.3.dev0)
Downloading https://pypi.tuna.tsinghua.edu.cn/packages/57/8d/30aa32745af16af0a9a650115fbe81bde7c610ed5c21b381fca0196f3a7f/audioread-3.0.1-py3-none-any.whl (23 kB)
Collecting numba>=0.51.0 (from librosa->llamafactory==0.9.3.dev0)
Downloading https://pypi.tuna.tsinghua.edu.cn/packages/97/c8/8740616c8436c86c1b9a62e72cb891177d2c34c2d24ddcde4c390371bf4c/numba-0.61.2-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (3.8 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.8/3.8 MB 33.2 MB/s eta 0:00:00
Collecting scikit-learn>=1.1.0 (from librosa->llamafactory==0.9.3.dev0)
Downloading https://pypi.tuna.tsinghua.edu.cn/packages/a8/f3/62fc9a5a659bb58a03cdd7e258956a5824bdc9b4bb3c5d932f55880be569/scikit_learn-1.6.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (13.5 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 13.5/13.5 MB 28.8 MB/s eta 0:00:00
Collecting joblib>=1.0 (from librosa->llamafactory==0.9.3.dev0)
Downloading https://pypi.tuna.tsinghua.edu.cn/packages/da/d3/13ee227a148af1c693654932b8b0b02ed64af5e1f7406d56b088b57574cd/joblib-1.5.0-py3-none-any.whl (307 kB)
Requirement already satisfied: decorator>=4.3.0 in /opt/conda/lib/python3.11/site-packages (from librosa->llamafactory==0.9.3.dev0) (5.1.1)
Collecting soundfile>=0.12.1 (from librosa->llamafactory==0.9.3.dev0)
Downloading https://pypi.tuna.tsinghua.edu.cn/packages/57/5e/70bdd9579b35003a489fc850b5047beeda26328053ebadc1fb60f320f7db/soundfile-0.13.1-py2.py3-none-manylinux_2_28_x86_64.whl (1.3 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.3/1.3 MB 73.5 MB/s eta 0:00:00
Collecting pooch>=1.1 (from librosa->llamafactory==0.9.3.dev0)
Downloading https://pypi.tuna.tsinghua.edu.cn/packages/a8/87/77cc11c7a9ea9fd05503def69e3d18605852cd0d4b0d3b8f15bbeb3ef1d1/pooch-1.8.2-py3-none-any.whl (64 kB)
Collecting soxr>=0.3.2 (from librosa->llamafactory==0.9.3.dev0)
Downloading https://pypi.tuna.tsinghua.edu.cn/packages/9f/e5/400e3bf7f29971abad85cb877e290060e5ec61fccd2fa319e3d85709c1be/soxr-0.5.0.post1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (252 kB)
Collecting lazy_loader>=0.1 (from librosa->llamafactory==0.9.3.dev0)
Downloading https://pypi.tuna.tsinghua.edu.cn/packages/83/60/d497a310bde3f01cb805196ac61b7ad6dc5dcf8dce66634dc34364b20b4f/lazy_loader-0.4-py3-none-any.whl (12 kB)
Requirement already satisfied: msgpack>=1.0 in /opt/conda/lib/python3.11/site-packages (from librosa->llamafactory==0.9.3.dev0) (1.1.0)
Collecting antlr4-python3-runtime==4.9.* (from omegaconf->llamafactory==0.9.3.dev0)
Downloading https://pypi.tuna.tsinghua.edu.cn/packages/3e/38/7859ff46355f76f8d19459005ca000b6e7012f2f1ca597746cbcd1fbfe5e/antlr4-python3-runtime-4.9.3.tar.gz (117 kB)
Preparing metadata (setup.py) ... done
Requirement already satisfied: six in /opt/conda/lib/python3.11/site-packages (from rouge-chinese->llamafactory==0.9.3.dev0) (1.16.0)
Collecting anyio<5.0,>=3.0 (from gradio<=5.25.0,>=4.38.0->llamafactory==0.9.3.dev0)
Downloading https://pypi.tuna.tsinghua.edu.cn/packages/a1/ee/48ca1a7c89ffec8b6a0c5d02b89c305671d5ffd8d3c94acf8b8c408575bb/anyio-4.9.0-py3-none-any.whl (100 kB)
Requirement already satisfied: idna>=2.8 in /opt/conda/lib/python3.11/site-packages (from anyio<5.0,>=3.0->gradio<=5.25.0,>=4.38.0->llamafactory==0.9.3.dev0) (3.7)
Requirement already satisfied: sniffio>=1.1 in /opt/conda/lib/python3.11/site-packages (from anyio<5.0,>=3.0->gradio<=5.25.0,>=4.38.0->llamafactory==0.9.3.dev0) (1.3.1)
Requirement already satisfied: aiohappyeyeballs>=2.3.0 in /opt/conda/lib/python3.11/site-packages (from aiohttp->datasets<=3.5.0,>=2.16.0->llamafactory==0.9.3.dev0) (2.4.3)
Requirement already satisfied: aiosignal>=1.1.2 in /opt/conda/lib/python3.11/site-packages (from aiohttp->datasets<=3.5.0,>=2.16.0->llamafactory==0.9.3.dev0) (1.3.1)
Requirement already satisfied: attrs>=17.3.0 in /opt/conda/lib/python3.11/site-packages (from aiohttp->datasets<=3.5.0,>=2.16.0->llamafactory==0.9.3.dev0) (24.2.0)
Requirement already satisfied: frozenlist>=1.1.1 in /opt/conda/lib/python3.11/site-packages (from aiohttp->datasets<=3.5.0,>=2.16.0->llamafactory==0.9.3.dev0) (1.4.1)
Requirement already satisfied: multidict<7.0,>=4.5 in /opt/conda/lib/python3.11/site-packages (from aiohttp->datasets<=3.5.0,>=2.16.0->llamafactory==0.9.3.dev0) (6.1.0)
Requirement already satisfied: yarl<2.0,>=1.12.0 in /opt/conda/lib/python3.11/site-packages (from aiohttp->datasets<=3.5.0,>=2.16.0->llamafactory==0.9.3.dev0) (1.14.0)
Requirement already satisfied: certifi in /opt/conda/lib/python3.11/site-packages (from httpx>=0.24.1->gradio<=5.25.0,>=4.38.0->llamafactory==0.9.3.dev0) (2024.8.30)
Requirement already satisfied: httpcore==1.* in /opt/conda/lib/python3.11/site-packages (from httpx>=0.24.1->gradio<=5.25.0,>=4.38.0->llamafactory==0.9.3.dev0) (1.0.6)
Collecting llvmlite<0.45,>=0.44.0dev0 (from numba>=0.51.0->librosa->llamafactory==0.9.3.dev0)
Downloading https://pypi.tuna.tsinghua.edu.cn/packages/99/fe/d030f1849ebb1f394bb3f7adad5e729b634fb100515594aca25c354ffc62/llvmlite-0.44.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (42.4 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 42.4/42.4 MB 27.3 MB/s eta 0:00:00
Requirement already satisfied: platformdirs>=2.5.0 in /opt/conda/lib/python3.11/site-packages (from pooch>=1.1->librosa->llamafactory==0.9.3.dev0) (3.10.0)
Requirement already satisfied: charset-normalizer<4,>=2 in /opt/conda/lib/python3.11/site-packages (from requests>=2.32.2->datasets<=3.5.0,>=2.16.0->llamafactory==0.9.3.dev0) (3.3.2)
Requirement already satisfied: urllib3<3,>=1.21.1 in /opt/conda/lib/python3.11/site-packages (from requests>=2.32.2->datasets<=3.5.0,>=2.16.0->llamafactory==0.9.3.dev0) (2.2.2)
Requirement already satisfied: markdown-it-py>=2.2.0 in /opt/conda/lib/python3.11/site-packages (from rich>=11.1.0->tyro<0.9.0->llamafactory==0.9.3.dev0) (3.0.0)
Requirement already satisfied: pygments<3.0.0,>=2.13.0 in /opt/conda/lib/python3.11/site-packages (from rich>=11.1.0->tyro<0.9.0->llamafactory==0.9.3.dev0) (2.18.0)
Collecting threadpoolctl>=3.1.0 (from scikit-learn>=1.1.0->librosa->llamafactory==0.9.3.dev0)
Downloading https://pypi.tuna.tsinghua.edu.cn/packages/32/d5/f9a850d79b0851d1d4ef6456097579a9005b31fea68726a4ae5f2d82ddd9/threadpoolctl-3.6.0-py3-none-any.whl (18 kB)
Requirement already satisfied: cffi>=1.0 in /opt/conda/lib/python3.11/site-packages (from soundfile>=0.12.1->librosa->llamafactory==0.9.3.dev0) (1.16.0)
Collecting shellingham>=1.3.0 (from typer<1.0,>=0.12->gradio<=5.25.0,>=4.38.0->llamafactory==0.9.3.dev0)
Downloading https://pypi.tuna.tsinghua.edu.cn/packages/e0/f9/0595336914c5619e5f28a1fb793285925a8cd4b432c9da0a987836c7f822/shellingham-1.5.4-py2.py3-none-any.whl (9.8 kB)
Requirement already satisfied: mpmath<1.4,>=1.1.0 in /opt/conda/lib/python3.11/site-packages (from sympy->torch>=1.13.1->llamafactory==0.9.3.dev0) (1.3.0)
Requirement already satisfied: pycparser in /opt/conda/lib/python3.11/site-packages (from cffi>=1.0->soundfile>=0.12.1->librosa->llamafactory==0.9.3.dev0) (2.21)
Requirement already satisfied: mdurl~=0.1 in /opt/conda/lib/python3.11/site-packages (from markdown-it-py>=2.2.0->rich>=11.1.0->tyro<0.9.0->llamafactory==0.9.3.dev0) (0.1.2)
Requirement already satisfied: propcache>=0.2.0 in /opt/conda/lib/python3.11/site-packages (from yarl<2.0,>=1.12.0->aiohttp->datasets<=3.5.0,>=2.16.0->llamafactory==0.9.3.dev0) (0.2.0)
Building wheels for collected packages: llamafactory, fire, jieba, antlr4-python3-runtime
Building editable for llamafactory (pyproject.toml) ... done
Created wheel for llamafactory: filename=llamafactory-0.9.3.dev0-0.editable-py3-none-any.whl size=12639 sha256=33467dd53418d292f7201c5166eb09ac5f1bc689a56546919cab97753f09c7d9
Stored in directory: /tmp/pip-ephem-wheel-cache-2_viqp15/wheels/d2/bb/7a/21465cf8d34431d01bd79c02d568cc677fd9ffd7c4908957f2
Building wheel for fire (setup.py) ... done
Created wheel for fire: filename=fire-0.7.0-py3-none-any.whl size=114250 sha256=e3a814f2160182086fd0c975283deb1293fbda74374a8ef914dddac33ab895da
Stored in directory: /root/.cache/pip/wheels/ca/d7/59/bded1534a72d6b702c835f1f7556c73277850f60578f462984
Building wheel for jieba (setup.py) ... done
Created wheel for jieba: filename=jieba-0.42.1-py3-none-any.whl size=19314458 sha256=8b480af0de0c021bce7763f7417899b132361b6f23911b15afd443bd1053d778
Stored in directory: /root/.cache/pip/wheels/37/08/79/ea7c0d2ca823affa13f89586a5a9eff8dd6ad589640396e1b5
Building wheel for antlr4-python3-runtime (setup.py) ... done
Created wheel for antlr4-python3-runtime: filename=antlr4_python3_runtime-4.9.3-py3-none-any.whl size=144552 sha256=18b90f00b678ebfd2f1473d1586034923be0e1b26472bc6f54b7b1622316b6bf
Stored in directory: /root/.cache/pip/wheels/b7/1a/64/f0dc37c50c3c337e906abf4eb29393c3f72add010ab48881b5
Successfully built llamafactory fire jieba antlr4-python3-runtime
Installing collected packages: pydub, jieba, antlr4-python3-runtime, tomlkit, threadpoolctl, soxr, shtab, shellingham, semantic-version, scipy, ruff, rouge-chinese, python-multipart, orjson, omegaconf, llvmlite, lazy_loader, joblib, groovy, fire, ffmpy, docstring-parser, av, audioread, anyio, aiofiles, starlette, soundfile, scikit-learn, pooch, numba, nltk, huggingface-hub, tyro, typer, tokenizers, sse-starlette, safehttpx, librosa, gradio-client, fastapi, accelerate, transformers, gradio, trl, peft, llamafactory
Attempting uninstall: anyio
Found existing installation: anyio 4.6.0
Uninstalling anyio-4.6.0:
Successfully uninstalled anyio-4.6.0
Attempting uninstall: starlette
Found existing installation: starlette 0.38.6
Uninstalling starlette-0.38.6:
Successfully uninstalled starlette-0.38.6
Attempting uninstall: huggingface-hub
Found existing installation: huggingface-hub 0.25.2
Uninstalling huggingface-hub-0.25.2:
Successfully uninstalled huggingface-hub-0.25.2
Attempting uninstall: tokenizers
Found existing installation: tokenizers 0.15.0
Uninstalling tokenizers-0.15.0:
Successfully uninstalled tokenizers-0.15.0
Attempting uninstall: fastapi
Found existing installation: fastapi 0.115.0
Uninstalling fastapi-0.115.0:
Successfully uninstalled fastapi-0.115.0
Attempting uninstall: transformers
Found existing installation: transformers 4.38.0
Uninstalling transformers-4.38.0:
Successfully uninstalled transformers-4.38.0
Successfully installed accelerate-1.6.0 aiofiles-24.1.0 antlr4-python3-runtime-4.9.3 anyio-4.9.0 audioread-3.0.1 av-14.4.0 docstring-parser-0.16 fastapi-0.115.12 ffmpy-0.5.0 fire-0.7.0 gradio-5.25.0 gradio-client-1.8.0 groovy-0.1.2 huggingface-hub-0.31.4 jieba-0.42.1 joblib-1.5.0 lazy_loader-0.4 librosa-0.11.0 llamafactory-0.9.3.dev0 llvmlite-0.44.0 nltk-3.9.1 numba-0.61.2 omegaconf-2.3.0 orjson-3.10.18 peft-0.15.1 pooch-1.8.2 pydub-0.25.1 python-multipart-0.0.20 rouge-chinese-1.0.3 ruff-0.11.10 safehttpx-0.1.6 scikit-learn-1.6.1 scipy-1.15.3 semantic-version-2.10.0 shellingham-1.5.4 shtab-1.7.2 soundfile-0.13.1 soxr-0.5.0.post1 sse-starlette-2.3.5 starlette-0.46.2 threadpoolctl-3.6.0 tokenizers-0.21.1 tomlkit-0.13.2 transformers-4.51.3 trl-0.9.6 typer-0.15.4 tyro-0.8.14
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager, possibly rendering your system unusable.It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv. Use the --root-user-action option if you know what you are doing and want to suppress this warning.