HfApi.endpoint should be configurable in Repository

[SBrandeis]

huggingface_hub/src/huggingface_hub/repository.py

Line 434 in c2ffc48

user = HfApi().whoami(self.huggingface_token)

We should be able to pass arguments to HfApi() from Repository

[adrinjalali]

@SBrandeis could you please explain further what the usecase is, and share a bit of code which would use the arguments? It helps with designing the API.

[SBrandeis]

I'm using huggingface_hub in AutoTrain to handle repo creation / cloning

My local version of AutoTrain uses a local version of the HF Hub to store and manipulate repos. The URL of the local HF Hub is not https://huggingface.co but rather http://localhost:PORT

Currently huggingface_hub assumes the URL to the HF Hub is https://huggingface.co, and I have to implement ugly hacks as the one following to make it work:

import os
import huggingface_hub

# I have to override ENDPOINT
HF_HUB_URL = "http://localhost:PORT"
huggingface_hub.constants.ENDPOINT = HF_HUB_URL
huggingface_hub.hf_api.ENDPOINT = HF_HUB_URL
huggingface_hub.repository.ENDPOINT = HF_HUB_URL

# Even worse:
clone_url = f"http://user:{hf_token}@{HF_HUB_URL[len('http://'):]}/datasets/user/dataset_name"
repo = huggingface_hub.Repository(local_dir=".", clone_from=clone_url, use_auth_token=hf_token)

I would like to be able to configure the URL of the HF Hub when using huggingface_hub

[SBrandeis]

I'm happy to open a PR if it makes sense to add this to the library

[LysandreJik]

It's a reasonable asumption which would also unblock on-prem efforts as seen in #650 and huggingface/transformers#15514

[LysandreJik]

Related to #798

[adrinjalali]

Looks quite reasonable to me. Happy to review the PR if you're kind enough to open one @SBrandeis :)