Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Bug] VideoQnA docker compose deployment failing #1479

Open
2 of 8 tasks
ezelanza opened this issue Jan 28, 2025 · 2 comments
Open
2 of 8 tasks

[Bug] VideoQnA docker compose deployment failing #1479

ezelanza opened this issue Jan 28, 2025 · 2 comments
Assignees
@ashahba
Labels
bug Something isn't working

Comments

@ezelanza
Copy link

Priority

P1-Stopper

OS type

Ubuntu

Hardware type

Xeon-SPR

Installation method

  • Pull docker images from hub.docker.com
  • Build docker images from source
  • Other

Deploy method

  • Docker
  • Docker Compose
  • Kubernetes Helm Charts
  • Kubernetes GMC
  • Other

Running nodes

Single Node

What's the version?

1

Description

Docker compose for VideoQnA in GenAIExamples FAILS

Reproduce steps

Docker compose

/GenAIExamples/VideoQnA/docker_compose/intel/cpu/xeon$ docker compose up -d

After all containers were pulled and started. DATAPREP IS NOT THERE (FAILED)

/GenAIExamples/VideoQnA/docker_compose/intel/cpu/xeon$ docker ps
CONTAINER ID   IMAGE                                   COMMAND                  CREATED              STATUS                          PORTS                                           NAMES
858d5ab7720e   opea/videoqna-ui:latest                 "streamlit run ui.py…"   About a minute ago   Up About a minute (healthy)     0.0.0.0:5173->5173/tcp, :::5173->5173/tcp       videoqna-xeon-ui-server
71b6939801fa   opea/videoqna:latest                    "sh -c 'sleep 45 && …"   About a minute ago   Up About a minute               0.0.0.0:8888->8888/tcp, :::8888->8888/tcp       videoqna-xeon-backend-server
51592f9ab27e   opea/lvm:latest                         "python opea_lvm_mic…"   About a minute ago   Up About a minute               0.0.0.0:9000->9000/tcp, :::9000->9000/tcp       lvm
c3acf225b427   opea/embedding-multimodal-clip:latest   "python clip_server.…"   3 minutes ago        Restarting (1) 12 seconds ago                                                   embedding-multimodal-server
7f28be3d7546   opea/reranking:latest                   "python opea_reranki…"   3 minutes ago        Up About a minute               0.0.0.0:8000->8000/tcp, :::8000->8000/tcp       reranking-tei-server
7236e1af6ca7   opea/retriever:latest                   "sh -c 'sleep 30 && …"   3 minutes ago        Up 4 seconds                    0.0.0.0:7000->7000/tcp, :::7000->7000/tcp       retriever-vdms-server
449a8c262ecd   opea/lvm-video-llama:latest             "bash start.sh"          3 minutes ago        Restarting (1) 11 seconds ago                                                   lvm-video-llama
bc9c17762075   intellabs/vdms:v2.8.0                   "/start.sh"              20 minutes ago       Up About a minute (healthy)     0.0.0.0:8001->55555/tcp, [::]:8001->55555/tcp   vdms-vector-db```

Also Restarting containers show "permission denied" on the logs. I've solved this error in the past building each of them replacing USER root on the DOCKERFILE

### Raw log

```shell
m: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/hooks/push-to-checkout.sample': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/hooks/pre-merge-commit.sample': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/hooks/update.sample': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/hooks/post-update.sample': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/hooks/pre-commit.sample': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/hooks/fsmonitor-watchman.sample': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/hooks/pre-push.sample': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/hooks/pre-applypatch.sample': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/hooks/applypatch-msg.sample': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/hooks/post-merge': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/hooks/post-checkout': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/hooks/pre-rebase.sample': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/hooks/prepare-commit-msg.sample': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/hooks/post-commit': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/hooks/pre-receive.sample': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/refs/heads/main': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/refs/remotes/origin/HEAD': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/refs/tags': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/config': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/index': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/logs/HEAD': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/logs/refs/heads/main': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/logs/refs/remotes/origin/HEAD': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/imagebind_huge.pth': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.gitattributes': Permission denied
Please wait for model download...
Git LFS initialized.
fatal: destination path '/home/user/model/Video-LLaMA-2-7B-Finetuned' already exists and is not an empty directory.
/usr/local/lib/python3.9/site-packages/timm/models/hub.py:4: FutureWarning: Importing from timm.models.hub is deprecated, please import via timm.models
  warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.models", FutureWarning)
There was a problem when trying to write in your cache folder (/home/user/.cache/huggingface/hub). You should set the environment variable TRANSFORMERS_CACHE to a writable directory.
/usr/local/lib/python3.9/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers
  warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning)
/usr/local/lib/python3.9/site-packages/timm/models/registry.py:4: FutureWarning: Importing from timm.models.registry is deprecated, please import via timm.models
  warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.models", FutureWarning)
/usr/local/lib/python3.9/site-packages/torchvision/transforms/_functional_video.py:6: UserWarning: The 'torchvision.transforms._functional_video' module is deprecated since 0.12 and will be removed in the future. Please use the 'torchvision.transforms.functional' module instead.
  warnings.warn(
/usr/local/lib/python3.9/site-packages/torchvision/transforms/_transforms_video.py:22: UserWarning: The 'torchvision.transforms._transforms_video' module is deprecated since 0.12 and will be removed in the future. Please use the 'torchvision.transforms' module instead.
  warnings.warn(
/home/user/comps/lvms/src/integrations/dependency/video-llama/server.py:108: LangChainDeprecationWarning: The class `HuggingFaceEmbeddings` was deprecated in LangChain 0.2.2 and will be removed in 1.0. An updated version of the class exists in the :class:`~langchain-huggingface package and should be used instead. To use it run `pip install -U :class:`~langchain-huggingface` and import as `from :class:`~langchain_huggingface import HuggingFaceEmbeddings``.
  HFembeddings = HuggingFaceEmbeddings(model_kwargs={"device": "cpu"})
/home/user/comps/lvms/src/integrations/dependency/video-llama/server.py:108: LangChainDeprecationWarning: Default values for HuggingFaceEmbeddings.model_name were deprecated in LangChain 0.2.16 and will be removed in 0.4.0. Explicitly pass a model_name to the HuggingFaceEmbeddings constructor instead.
  HFembeddings = HuggingFaceEmbeddings(model_kwargs={"device": "cpu"})
INFO:sentence_transformers.SentenceTransformer:Load pretrained SentenceTransformer: sentence-transformers/all-mpnet-base-v2
WARNING:sentence_transformers.SentenceTransformer:No sentence-transformers model found with name sentence-transformers/all-mpnet-base-v2. Creating a new one with mean pooling.
Could not cache non-existence of file. Will ignore error and continue. Error: [Errno 13] Permission denied: '/home/user/.cache/huggingface/hub/models--sentence-transformers--all-mpnet-base-v2'
ERROR:huggingface_hub.file_download:Could not cache non-existence of file. Will ignore error and continue. Error: [Errno 13] Permission denied: '/home/user/.cache/huggingface/hub/models--sentence-transformers--all-mpnet-base-v2'
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/huggingface_hub/utils/_http.py", line 406, in hf_raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.9/site-packages/requests/models.py", line 1024, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://huggingface.co/sentence-transformers/all-mpnet-base-v2/resolve/main/adapter_config.json

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/huggingface_hub/file_download.py", line 1374, in _get_metadata_or_catch_error
    metadata = get_hf_file_metadata(
  File "/usr/local/lib/python3.9/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn
    return fn(*args, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/huggingface_hub/file_download.py", line 1294, in get_hf_file_metadata
    r = _request_wrapper(
  File "/usr/local/lib/python3.9/site-packages/huggingface_hub/file_download.py", line 278, in _request_wrapper
    response = _request_wrapper(
  File "/usr/local/lib/python3.9/site-packages/huggingface_hub/file_download.py", line 302, in _request_wrapper
    hf_raise_for_status(response)
  File "/usr/local/lib/python3.9/site-packages/huggingface_hub/utils/_http.py", line 417, in hf_raise_for_status
    raise _format(EntryNotFoundError, message, response) from e
huggingface_hub.errors.EntryNotFoundError: 404 Client Error. (Request ID: Root=1-6798586d-7eea3cfc22baa2da79118435;a0a05634-b379-41a0-b8fb-c18cc6def2fd)

Entry Not Found for url: https://huggingface.co/sentence-transformers/all-mpnet-base-v2/resolve/main/adapter_config.json.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.9/pathlib.py", line 1323, in mkdir
    self._accessor.mkdir(self, mode)
FileNotFoundError: [Errno 2] No such file or directory: '/home/user/.cache/huggingface/hub/models--sentence-transformers--all-mpnet-base-v2/refs'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/user/comps/lvms/src/integrations/dependency/video-llama/server.py", line 280, in <module>
    context_db = construct_instructions()
  File "/home/user/comps/lvms/src/integrations/dependency/video-llama/server.py", line 108, in construct_instructions
    HFembeddings = HuggingFaceEmbeddings(model_kwargs={"device": "cpu"})
  File "/usr/local/lib/python3.9/site-packages/langchain_core/_api/deprecation.py", line 216, in warn_if_direct_instance
    return wrapped(self, *args, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/langchain_community/embeddings/huggingface.py", line 92, in __init__
    self.client = sentence_transformers.SentenceTransformer(
  File "/usr/local/lib/python3.9/site-packages/sentence_transformers/SentenceTransformer.py", line 320, in __init__
    modules = self._load_auto_model(
  File "/usr/local/lib/python3.9/site-packages/sentence_transformers/SentenceTransformer.py", line 1538, in _load_auto_model
    transformer_model = Transformer(
  File "/usr/local/lib/python3.9/site-packages/sentence_transformers/models/Transformer.py", line 80, in __init__
    config, is_peft_model = self._load_config(model_name_or_path, cache_dir, backend, config_args)
  File "/usr/local/lib/python3.9/site-packages/sentence_transformers/models/Transformer.py", line 121, in _load_config
    find_adapter_config_file(
  File "/usr/local/lib/python3.9/site-packages/transformers/utils/peft_utils.py", line 88, in find_adapter_config_file
    adapter_cached_filename = cached_file(
  File "/usr/local/lib/python3.9/site-packages/transformers/utils/hub.py", line 403, in cached_file
    resolved_file = hf_hub_download(
  File "/usr/local/lib/python3.9/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn
    return fn(*args, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/huggingface_hub/file_download.py", line 860, in hf_hub_download
    return _hf_hub_download_to_cache_dir(
  File "/usr/local/lib/python3.9/site-packages/huggingface_hub/file_download.py", line 923, in _hf_hub_download_to_cache_dir
    (url_to_download, etag, commit_hash, expected_size, head_call_error) = _get_metadata_or_catch_error(
  File "/usr/local/lib/python3.9/site-packages/huggingface_hub/file_download.py", line 1390, in _get_metadata_or_catch_error
    _cache_commit_hash_for_specific_revision(storage_folder, revision, commit_hash)
  File "/usr/local/lib/python3.9/site-packages/huggingface_hub/file_download.py", line 616, in _cache_commit_hash_for_specific_revision
    ref_path.parent.mkdir(parents=True, exist_ok=True)
  File "/usr/local/lib/python3.9/pathlib.py", line 1327, in mkdir
    self.parent.mkdir(parents=True, exist_ok=True)
  File "/usr/local/lib/python3.9/pathlib.py", line 1323, in mkdir
    self._accessor.mkdir(self, mode)
PermissionError: [Errno 13] Permission denied: '/home/user/.cache/huggingface/hub/models--sentence-transformers--all-mpnet-base-v2'
llm_download: True
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/VL_LLaMA_2_7B_Finetuned.pth': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/llama-2-7b-chat-hf/tokenizer.json': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/llama-2-7b-chat-hf/pytorch_model.bin.index.json': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/llama-2-7b-chat-hf/pytorch_model-00002-of-00002.bin': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/llama-2-7b-chat-hf/generation_config.json': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/llama-2-7b-chat-hf/config.json': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/llama-2-7b-chat-hf/pytorch_model-00001-of-00002.bin': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/llama-2-7b-chat-hf/tokenizer.model': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/llama-2-7b-chat-hf/tokenizer_config.json': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/llama-2-7b-chat-hf/special_tokens_map.json': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/AL_LLaMA_2_7B_Finetuned.pth': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/HEAD': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/lfs/tmp': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/lfs/objects/8e/8f/8e8fc22b2c138439c6bafb7331ac139585e683005407e016feb18a4feea18417': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/lfs/objects/9e/55/9e556afd44213b6bd1be2b850ebbbd98f5481437a8021afaf58ee7fb1818d347': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/lfs/objects/3c/ec/3cec0e2979ed7656e08ecc5b185c2229a3c577b4b7a4721a94bd461ba0447c6e': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/lfs/objects/1a/d6/1ad66d3e0eb9eaef5392e7b67c4689166f5610088c92652b9ecdae332b8d5b6f': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/lfs/objects/8f/91/8f917a253ef631128743798d284a7e7a5a22ac1ad23ecd6a9da57550348317f5': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/lfs/objects/d6/f6/d6f6c22bedcc90708448d5d2fbb7b2db9c73f505dc89bd0b2e09b23af1b62157': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/lfs/incomplete': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/packed-refs': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/description': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/branches': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/objects/ba/1da66086e9c7a2d80c7443a19850d6ccde206f': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/objects/f8/2c60f73916ba70b757a13de56b325e362fd5d7': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/objects/d8/5ba6cb6820b01226ef8bd40b46bb489041c6a8': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/objects/46/38053c1229701b510db774f2ea1367026e6215': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/objects/f0/fe7fb1b496a034bd58f3dea5a470447286dd94': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/objects/60/ee43c00ce15ed87a09bcbbe1f8a8903803a520': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/objects/7f/e9404b3a5c773fefcd830214e8908d632b5f16': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/objects/21/709a82dbb35fca042d46877b89074bc1885401': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/objects/db/7264b24cac7a39947bb5fc02fe5c2d7ac9eaf4': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/objects/a6/344aac8c09253b3b630fb776ae94478aa0275b': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/objects/pack': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/objects/8d/595d80ce98770857c22b7aa1e1c8541f549e97': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/objects/a0/201ea3b8e89373271760acaf53782ea760be62': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/objects/33/3c1821f1357f6facd09a56760b95c7ec18fa37': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/objects/31/8f8f56cf1502f2ce89174363edd6687ff386b5': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/objects/91/387af1ea6dec06a28188c22856e097f1d3efe6': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/objects/6c/00c742ce03c627d6cd5b795984876fa49fa899': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/objects/40/0e3de6ffc3884ec3c158a046f6a04da00ef3ca': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/objects/ec/97373f1e87ea4c685aabd15f43c6fc55c7cf52': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/objects/eb/6a71a04d8fb87146345d51eb802463efdc62ce': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/objects/2a/0c0baee51872079bc98498b131f699be7c7de1': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/objects/c0/540aae149acd3ff44c259c6415e77e8a6543a0': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/objects/info': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/objects/ca/1821a6c6342bb4115adff7b6665fc301b9a210': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/objects/1c/925bf2a53cfd54d76614d484e71fd375187848': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/objects/9d/9519ffac4e48ef6510e829b1a1a643771a4dd0': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/objects/2c/057487fd479614df7ac437b5ae2faedb245063': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/objects/0e/721a8b733ee92429a826c216cbe03b45afda45': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/objects/8b/6ec8f70df4f3a10b13059dc0ed15499321c308': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/objects/42/d26a8e0b12b1731dc84099926af71466f6882b': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/info/exclude': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/hooks/pre-push': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/hooks/commit-msg.sample': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/hooks/push-to-checkout.sample': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/hooks/pre-merge-commit.sample': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/hooks/update.sample': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/hooks/post-update.sample': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/hooks/pre-commit.sample': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/hooks/fsmonitor-watchman.sample': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/hooks/pre-push.sample': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/hooks/pre-applypatch.sample': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/hooks/applypatch-msg.sample': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/hooks/post-merge': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/hooks/post-checkout': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/hooks/pre-rebase.sample': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/hooks/prepare-commit-msg.sample': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/hooks/post-commit': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/hooks/pre-receive.sample': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/refs/heads/main': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/refs/remotes/origin/HEAD': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/refs/tags': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/config': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/index': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/logs/HEAD': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/logs/refs/heads/main': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/logs/refs/remotes/origin/HEAD': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/imagebind_huge.pth': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.gitattributes': Permission denied
Please wait for model download...
Git LFS initialized.
fatal: destination path '/home/user/model/Video-LLaMA-2-7B-Finetuned' already exists and is not an empty directory.
/usr/local/lib/python3.9/site-packages/timm/models/hub.py:4: FutureWarning: Importing from timm.models.hub is deprecated, please import via timm.models
  warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.models", FutureWarning)
There was a problem when trying to write in your cache folder (/home/user/.cache/huggingface/hub). You should set the environment variable TRANSFORMERS_CACHE to a writable directory.
/usr/local/lib/python3.9/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers
  warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning)
/usr/local/lib/python3.9/site-packages/timm/models/registry.py:4: FutureWarning: Importing from timm.models.registry is deprecated, please import via timm.models
  warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.models", FutureWarning)
/usr/local/lib/python3.9/site-packages/torchvision/transforms/_functional_video.py:6: UserWarning: The 'torchvision.transforms._functional_video' module is deprecated since 0.12 and will be removed in the future. Please use the 'torchvision.transforms.functional' module instead.
  warnings.warn(
/usr/local/lib/python3.9/site-packages/torchvision/transforms/_transforms_video.py:22: UserWarning: The 'torchvision.transforms._transforms_video' module is deprecated since 0.12 and will be removed in the future. Please use the 'torchvision.transforms' module instead.
  warnings.warn(
/home/user/comps/lvms/src/integrations/dependency/video-llama/server.py:108: LangChainDeprecationWarning: The class `HuggingFaceEmbeddings` was deprecated in LangChain 0.2.2 and will be removed in 1.0. An updated version of the class exists in the :class:`~langchain-huggingface package and should be used instead. To use it run `pip install -U :class:`~langchain-huggingface` and import as `from :class:`~langchain_huggingface import HuggingFaceEmbeddings``.
  HFembeddings = HuggingFaceEmbeddings(model_kwargs={"device": "cpu"})
/home/user/comps/lvms/src/integrations/dependency/video-llama/server.py:108: LangChainDeprecationWarning: Default values for HuggingFaceEmbeddings.model_name were deprecated in LangChain 0.2.16 and will be removed in 0.4.0. Explicitly pass a model_name to the HuggingFaceEmbeddings constructor instead.
  HFembeddings = HuggingFaceEmbeddings(model_kwargs={"device": "cpu"})
INFO:sentence_transformers.SentenceTransformer:Load pretrained SentenceTransformer: sentence-transformers/all-mpnet-base-v2
WARNING:sentence_transformers.SentenceTransformer:No sentence-transformers model found with name sentence-transformers/all-mpnet-base-v2. Creating a new one with mean pooling.
Could not cache non-existence of file. Will ignore error and continue. Error: [Errno 13] Permission denied: '/home/user/.cache/huggingface/hub/models--sentence-transformers--all-mpnet-base-v2'
ERROR:huggingface_hub.file_download:Could not cache non-existence of file. Will ignore error and continue. Error: [Errno 13] Permission denied: '/home/user/.cache/huggingface/hub/models--sentence-transformers--all-mpnet-base-v2'
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/huggingface_hub/utils/_http.py", line 406, in hf_raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.9/site-packages/requests/models.py", line 1024, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://huggingface.co/sentence-transformers/all-mpnet-base-v2/resolve/main/adapter_config.json

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/huggingface_hub/file_download.py", line 1374, in _get_metadata_or_catch_error
    metadata = get_hf_file_metadata(
  File "/usr/local/lib/python3.9/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn
    return fn(*args, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/huggingface_hub/file_download.py", line 1294, in get_hf_file_metadata
    r = _request_wrapper(
  File "/usr/local/lib/python3.9/site-packages/huggingface_hub/file_download.py", line 278, in _request_wrapper
    response = _request_wrapper(
  File "/usr/local/lib/python3.9/site-packages/huggingface_hub/file_download.py", line 302, in _request_wrapper
    hf_raise_for_status(response)
  File "/usr/local/lib/python3.9/site-packages/huggingface_hub/utils/_http.py", line 417, in hf_raise_for_status
    raise _format(EntryNotFoundError, message, response) from e
huggingface_hub.errors.EntryNotFoundError: 404 Client Error. (Request ID: Root=1-67985872-39a962922f0ad3af0423ef1d;0a84e968-7e10-4194-a7f0-987da437bf9a)

Entry Not Found for url: https://huggingface.co/sentence-transformers/all-mpnet-base-v2/resolve/main/adapter_config.json.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.9/pathlib.py", line 1323, in mkdir
    self._accessor.mkdir(self, mode)
FileNotFoundError: [Errno 2] No such file or directory: '/home/user/.cache/huggingface/hub/models--sentence-transformers--all-mpnet-base-v2/refs'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/user/comps/lvms/src/integrations/dependency/video-llama/server.py", line 280, in <module>
    context_db = construct_instructions()
  File "/home/user/comps/lvms/src/integrations/dependency/video-llama/server.py", line 108, in construct_instructions
    HFembeddings = HuggingFaceEmbeddings(model_kwargs={"device": "cpu"})
  File "/usr/local/lib/python3.9/site-packages/langchain_core/_api/deprecation.py", line 216, in warn_if_direct_instance
    return wrapped(self, *args, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/langchain_community/embeddings/huggingface.py", line 92, in __init__
    self.client = sentence_transformers.SentenceTransformer(
  File "/usr/local/lib/python3.9/site-packages/sentence_transformers/SentenceTransformer.py", line 320, in __init__
    modules = self._load_auto_model(
  File "/usr/local/lib/python3.9/site-packages/sentence_transformers/SentenceTransformer.py", line 1538, in _load_auto_model
    transformer_model = Transformer(
  File "/usr/local/lib/python3.9/site-packages/sentence_transformers/models/Transformer.py", line 80, in __init__
    config, is_peft_model = self._load_config(model_name_or_path, cache_dir, backend, config_args)
  File "/usr/local/lib/python3.9/site-packages/sentence_transformers/models/Transformer.py", line 121, in _load_config
    find_adapter_config_file(
  File "/usr/local/lib/python3.9/site-packages/transformers/utils/peft_utils.py", line 88, in find_adapter_config_file
    adapter_cached_filename = cached_file(
  File "/usr/local/lib/python3.9/site-packages/transformers/utils/hub.py", line 403, in cached_file
    resolved_file = hf_hub_download(
  File "/usr/local/lib/python3.9/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn
    return fn(*args, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/huggingface_hub/file_download.py", line 860, in hf_hub_download
    return _hf_hub_download_to_cache_dir(
  File "/usr/local/lib/python3.9/site-packages/huggingface_hub/file_download.py", line 923, in _hf_hub_download_to_cache_dir
    (url_to_download, etag, commit_hash, expected_size, head_call_error) = _get_metadata_or_catch_error(
  File "/usr/local/lib/python3.9/site-packages/huggingface_hub/file_download.py", line 1390, in _get_metadata_or_catch_error
    _cache_commit_hash_for_specific_revision(storage_folder, revision, commit_hash)
  File "/usr/local/lib/python3.9/site-packages/huggingface_hub/file_download.py", line 616, in _cache_commit_hash_for_specific_revision
    ref_path.parent.mkdir(parents=True, exist_ok=True)
  File "/usr/local/lib/python3.9/pathlib.py", line 1327, in mkdir
    self.parent.mkdir(parents=True, exist_ok=True)
  File "/usr/local/lib/python3.9/pathlib.py", line 1323, in mkdir
    self._accessor.mkdir(self, mode)
PermissionError: [Errno 13] Permission denied: '/home/user/.cache/huggingface/hub/models--sentence-transformers--all-mpnet-base-v2'
llm_download: True
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/VL_LLaMA_2_7B_Finetuned.pth': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/llama-2-7b-chat-hf/tokenizer.json': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/llama-2-7b-chat-hf/pytorch_model.bin.index.json': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/llama-2-7b-chat-hf/pytorch_model-00002-of-00002.bin': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/llama-2-7b-chat-hf/generation_config.json': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/llama-2-7b-chat-hf/config.json': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/llama-2-7b-chat-hf/pytorch_model-00001-of-00002.bin': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/llama-2-7b-chat-hf/tokenizer.model': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/llama-2-7b-chat-hf/tokenizer_config.json': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/llama-2-7b-chat-hf/special_tokens_map.json': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/AL_LLaMA_2_7B_Finetuned.pth': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/HEAD': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/lfs/tmp': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/lfs/objects/8e/8f/8e8fc22b2c138439c6bafb7331ac139585e683005407e016feb18a4feea18417': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/lfs/objects/9e/55/9e556afd44213b6bd1be2b850ebbbd98f5481437a8021afaf58ee7fb1818d347': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/lfs/objects/3c/ec/3cec0e2979ed7656e08ecc5b185c2229a3c577b4b7a4721a94bd461ba0447c6e': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/lfs/objects/1a/d6/1ad66d3e0eb9eaef5392e7b67c4689166f5610088c92652b9ecdae332b8d5b6f': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/lfs/objects/8f/91/8f917a253ef631128743798d284a7e7a5a22ac1ad23ecd6a9da57550348317f5': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/lfs/objects/d6/f6/d6f6c22bedcc90708448d5d2fbb7b2db9c73f505dc89bd0b2e09b23af1b62157': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/lfs/incomplete': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/packed-refs': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/description': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/branches': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/objects/ba/1da66086e9c7a2d80c7443a19850d6ccde206f': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/objects/f8/2c60f73916ba70b757a13de56b325e362fd5d7': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/objects/d8/5ba6cb6820b01226ef8bd40b46bb489041c6a8': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/objects/46/38053c1229701b510db774f2ea1367026e6215': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/objects/f0/fe7fb1b496a034bd58f3dea5a470447286dd94': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/objects/60/ee43c00ce15ed87a09bcbbe1f8a8903803a520': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/objects/7f/e9404b3a5c773fefcd830214e8908d632b5f16': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/objects/21/709a82dbb35fca042d46877b89074bc1885401': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/objects/db/7264b24cac7a39947bb5fc02fe5c2d7ac9eaf4': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/objects/a6/344aac8c09253b3b630fb776ae94478aa0275b': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/objects/pack': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/objects/8d/595d80ce98770857c22b7aa1e1c8541f549e97': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/objects/a0/201ea3b8e89373271760acaf53782ea760be62': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/objects/33/3c1821f1357f6facd09a56760b95c7ec18fa37': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/objects/31/8f8f56cf1502f2ce89174363edd6687ff386b5': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/objects/91/387af1ea6dec06a28188c22856e097f1d3efe6': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/objects/6c/00c742ce03c627d6cd5b795984876fa49fa899': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/objects/40/0e3de6ffc3884ec3c158a046f6a04da00ef3ca': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/objects/ec/97373f1e87ea4c685aabd15f43c6fc55c7cf52': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/objects/eb/6a71a04d8fb87146345d51eb802463efdc62ce': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/objects/2a/0c0baee51872079bc98498b131f699be7c7de1': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/objects/c0/540aae149acd3ff44c259c6415e77e8a6543a0': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/objects/info': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/objects/ca/1821a6c6342bb4115adff7b6665fc301b9a210': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/objects/1c/925bf2a53cfd54d76614d484e71fd375187848': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/objects/9d/9519ffac4e48ef6510e829b1a1a643771a4dd0': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/objects/2c/057487fd479614df7ac437b5ae2faedb245063': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/objects/0e/721a8b733ee92429a826c216cbe03b45afda45': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/objects/8b/6ec8f70df4f3a10b13059dc0ed15499321c308': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/objects/42/d26a8e0b12b1731dc84099926af71466f6882b': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/info/exclude': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/hooks/pre-push': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/hooks/commit-msg.sample': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/hooks/push-to-checkout.sample': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/hooks/pre-merge-commit.sample': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/hooks/update.sample': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/hooks/post-update.sample': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/hooks/pre-commit.sample': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/hooks/fsmonitor-watchman.sample': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/hooks/pre-push.sample': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/hooks/pre-applypatch.sample': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/hooks/applypatch-msg.sample': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/hooks/post-merge': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/hooks/post-checkout': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/hooks/pre-rebase.sample': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/hooks/prepare-commit-msg.sample': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/hooks/post-commit': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/hooks/pre-receive.sample': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/refs/heads/main': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/refs/remotes/origin/HEAD': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/refs/tags': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/config': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/index': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/logs/HEAD': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/logs/refs/heads/main': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.git/logs/refs/remotes/origin/HEAD': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/imagebind_huge.pth': Permission denied
rm: cannot remove '/home/user/model/Video-LLaMA-2-7B-Finetuned/.gitattributes': Permission denied
Please wait for model download...
Git LFS initialized.
fatal: destination path '/home/user/model/Video-LLaMA-2-7B-Finetuned' already exists and is not an empty directory.
/usr/local/lib/python3.9/site-packages/timm/models/hub.py:4: FutureWarning: Importing from timm.models.hub is deprecated, please import via timm.models
  warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.models", FutureWarning)
There was a problem when trying to write in your cache folder (/home/user/.cache/huggingface/hub). You should set the environment variable TRANSFORMERS_CACHE to a writable directory.
/usr/local/lib/python3.9/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers
  warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning)
/usr/local/lib/python3.9/site-packages/timm/models/registry.py:4: FutureWarning: Importing from timm.models.registry is deprecated, please import via timm.models
  warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.models", FutureWarning)
/usr/local/lib/python3.9/site-packages/torchvision/transforms/_functional_video.py:6: UserWarning: The 'torchvision.transforms._functional_video' module is deprecated since 0.12 and will be removed in the future. Please use the 'torchvision.transforms.functional' module instead.
  warnings.warn(
/usr/local/lib/python3.9/site-packages/torchvision/transforms/_transforms_video.py:22: UserWarning: The 'torchvision.transforms._transforms_video' module is deprecated since 0.12 and will be removed in the future. Please use the 'torchvision.transforms' module instead.
  warnings.warn(
/home/user/comps/lvms/src/integrations/dependency/video-llama/server.py:108: LangChainDeprecationWarning: The class `HuggingFaceEmbeddings` was deprecated in LangChain 0.2.2 and will be removed in 1.0. An updated version of the class exists in the :class:`~langchain-huggingface package and should be used instead. To use it run `pip install -U :class:`~langchain-huggingface` and import as `from :class:`~langchain_huggingface import HuggingFaceEmbeddings``.
  HFembeddings = HuggingFaceEmbeddings(model_kwargs={"device": "cpu"})
/home/user/comps/lvms/src/integrations/dependency/video-llama/server.py:108: LangChainDeprecationWarning: Default values for HuggingFaceEmbeddings.model_name were deprecated in LangChain 0.2.16 and will be removed in 0.4.0. Explicitly pass a model_name to the HuggingFaceEmbeddings constructor instead.
  HFembeddings = HuggingFaceEmbeddings(model_kwargs={"device": "cpu"})
INFO:sentence_transformers.SentenceTransformer:Load pretrained SentenceTransformer: sentence-transformers/all-mpnet-base-v2
WARNING:sentence_transformers.SentenceTransformer:No sentence-transformers model found with name sentence-transformers/all-mpnet-base-v2. Creating a new one with mean pooling.
Could not cache non-existence of file. Will ignore error and continue. Error: [Errno 13] Permission denied: '/home/user/.cache/huggingface/hub/models--sentence-transformers--all-mpnet-base-v2'
ERROR:huggingface_hub.file_download:Could not cache non-existence of file. Will ignore error and continue. Error: [Errno 13] Permission denied: '/home/user/.cache/huggingface/hub/models--sentence-transformers--all-mpnet-base-v2'
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/huggingface_hub/utils/_http.py", line 406, in hf_raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.9/site-packages/requests/models.py", line 1024, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://huggingface.co/sentence-transformers/all-mpnet-base-v2/resolve/main/adapter_config.json

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/huggingface_hub/file_download.py", line 1374, in _get_metadata_or_catch_error
    metadata = get_hf_file_metadata(
  File "/usr/local/lib/python3.9/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn
    return fn(*args, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/huggingface_hub/file_download.py", line 1294, in get_hf_file_metadata
    r = _request_wrapper(
  File "/usr/local/lib/python3.9/site-packages/huggingface_hub/file_download.py", line 278, in _request_wrapper
    response = _request_wrapper(
  File "/usr/local/lib/python3.9/site-packages/huggingface_hub/file_download.py", line 302, in _request_wrapper
    hf_raise_for_status(response)
  File "/usr/local/lib/python3.9/site-packages/huggingface_hub/utils/_http.py", line 417, in hf_raise_for_status
    raise _format(EntryNotFoundError, message, response) from e
huggingface_hub.errors.EntryNotFoundError: 404 Client Error. (Request ID: Root=1-67985876-40e5b8497817dcee2d474bb7;e7a434d8-4fed-4e48-b485-3f41ff4f912e)

Entry Not Found for url: https://huggingface.co/sentence-transformers/all-mpnet-base-v2/resolve/main/adapter_config.json.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.9/pathlib.py", line 1323, in mkdir
    self._accessor.mkdir(self, mode)
FileNotFoundError: [Errno 2] No such file or directory: '/home/user/.cache/huggingface/hub/models--sentence-transformers--all-mpnet-base-v2/refs'

Attachments

No response
@ezelanza ezelanza added the bug Something isn't working label Jan 28, 2025
@ashahba ashahba self-assigned this Jan 31, 2025
@ashahba ashahba mentioned this issue Feb 1, 2025
Open
4 tasks
@xiguiw
Copy link
Collaborator

xiguiw commented Feb 5, 2025

  1. The log shows not found the request file "https://huggingface.co/sentence-transformers/all-mpnet-base-v2/resolve/main/adapter_config.json"
  2. No access to "/home/user/.cache/huggingface/hub/models--sentence-transformers--all-mpnet-base-v2",

Image

Would you please confirm you have write access to '/home/user/.cache' inside docker container?

Traceback (most recent call last):
File "/usr/local/lib/python3.9/site-packages/huggingface_hub/file_download.py", line 1374, in _get_metadata_or_catch_error
metadata = get_hf_file_metadata(
File "/usr/local/lib/python3.9/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn
return fn(*args, **kwargs)
File "/usr/local/lib/python3.9/site-packages/huggingface_hub/file_download.py", line 1294, in get_hf_file_metadata
r = _request_wrapper(
File "/usr/local/lib/python3.9/site-packages/huggingface_hub/file_download.py", line 278, in _request_wrapper
response = _request_wrapper(
File "/usr/local/lib/python3.9/site-packages/huggingface_hub/file_download.py", line 302, in _request_wrapper
hf_raise_for_status(response)
File "/usr/local/lib/python3.9/site-packages/huggingface_hub/utils/_http.py", line 417, in hf_raise_for_status
raise _format(EntryNotFoundError, message, response) from e
huggingface_hub.errors.EntryNotFoundError: 404 Client Error. (Request ID: Root=1-6798586d-7eea3cfc22baa2da79118435;a0a05634-b379-41a0-b8fb-c18cc6def2fd)

Entry Not Found for url: https://huggingface.co/sentence-transformers/all-mpnet-base-v2/resolve/main/adapter_config.json.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/usr/local/lib/python3.9/pathlib.py", line 1323, in mkdir
self._accessor.mkdir(self, mode)
FileNotFoundError: [Errno 2] No such file or directory: '/home/user/.cache/huggingface/hub/models--sentence-transformers--all-mpnet-base-v2/refs'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/home/user/comps/lvms/src/integrations/dependency/video-llama/server.py", line 280, in
context_db = construct_instructions()
File "/home/user/comps/lvms/src/integrations/dependency/video-llama/server.py", line 108, in construct_instructions
HFembeddings = HuggingFaceEmbeddings(model_kwargs={"device": "cpu"})
File "/usr/local/lib/python3.9/site-packages/langchain_core/_api/deprecation.py", line 216, in warn_if_direct_instance
return wrapped(self, *args, **kwargs)
File "/usr/local/lib/python3.9/site-packages/langchain_community/embeddings/huggingface.py", line 92, in init
self.client = sentence_transformers.SentenceTransformer(
File "/usr/local/lib/python3.9/site-packages/sentence_transformers/SentenceTransformer.py", line 320, in init
modules = self._load_auto_model(
File "/usr/local/lib/python3.9/site-packages/sentence_transformers/SentenceTransformer.py", line 1538, in _load_auto_model
transformer_model = Transformer(
File "/usr/local/lib/python3.9/site-packages/sentence_transformers/models/Transformer.py", line 80, in init
config, is_peft_model = self._load_config(model_name_or_path, cache_dir, backend, config_args)
File "/usr/local/lib/python3.9/site-packages/sentence_transformers/models/Transformer.py", line 121, in _load_config
find_adapter_config_file(
File "/usr/local/lib/python3.9/site-packages/transformers/utils/peft_utils.py", line 88, in find_adapter_config_file
adapter_cached_filename = cached_file(
File "/usr/local/lib/python3.9/site-packages/transformers/utils/hub.py", line 403, in cached_file
resolved_file = hf_hub_download(
File "/usr/local/lib/python3.9/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn
return fn(*args, **kwargs)
File "/usr/local/lib/python3.9/site-packages/huggingface_hub/file_download.py", line 860, in hf_hub_download
return _hf_hub_download_to_cache_dir(
File "/usr/local/lib/python3.9/site-packages/huggingface_hub/file_download.py", line 923, in _hf_hub_download_to_cache_dir
(url_to_download, etag, commit_hash, expected_size, head_call_error) = _get_metadata_or_catch_error(
File "/usr/local/lib/python3.9/site-packages/huggingface_hub/file_download.py", line 1390, in _get_metadata_or_catch_error
_cache_commit_hash_for_specific_revision(storage_folder, revision, commit_hash)
File "/usr/local/lib/python3.9/site-packages/huggingface_hub/file_download.py", line 616, in _cache_commit_hash_for_specific_revision
ref_path.parent.mkdir(parents=True, exist_ok=True)
File "/usr/local/lib/python3.9/pathlib.py", line 1327, in mkdir
self.parent.mkdir(parents=True, exist_ok=True)
File "/usr/local/lib/python3.9/pathlib.py", line 1323, in mkdir
self._accessor.mkdir(self, mode)
PermissionError: [Errno 13] Permission denied: '/home/user/.cache/huggingface/hub/models--sentence-transformers--all-mpnet-base-v2'
llm_download: True

@xiguiw
Copy link
Collaborator

xiguiw commented Feb 6, 2025

@ezelanza
There is a known issue of VideoQnA #1477
Please try VideoQnA after #1477 been fixed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@ashahba ashahba

Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@ashahba @ezelanza @xiguiw