How to use private model

Hello everyone,
The official submission document mentioned “hf_models: A list of Hugging Face models your agent depends on. These models must be publicly available or the aicrowd HF account must have access. Important: If your model is private, grant the aicrowd user permission to pull it, or your submission will fail.”

But how do we specifically authorize the private model on huggingface to aicrowd?

Looking forward to your responses and good luck to everyone competing!

Best regards

Do I need to create an organization on huggingface and then invite the aicrowd official account to join my organization to share my private model? Is there a more convenient way?

ChatGPT says we can add them as collaborators under settings. What is aicrowd’s HF username?

Hi @Chris_Deotte ,

The docs for referencing private HF repos is added to the (soon to be released) starter kit here.
We will make an announcement soon once the evaluators are ready to support the new starter kit.

Update: We have slightly changed the interfacing with Huggingface, and how we expect teams to securely submit their models via Hugginface. The key change is that, we want people to have their models available as “Public Gated” repos on Huggingface instead of Private repos. We have added step by step instructions for the same here: Using Gated Hugging Face Models in Your Submission :lock:

1 Like

@mohanty
I would like to know how to submit a private model.

Using Gated Hugging Face Models in Your Submission states that aicrowd.json must include “aicrowd” in the “repository name” of huggingface, and provides the following example.
On the other hand, since the part of <owner>/<model name> of a hugging face account that has already been created is the username, it is difficult to change it (when I actually tried to change it, I got a warning that the username can only be changed once).

"hf_models": [
{
"repo_id": "your-team-aicrowd/your-model",
"revision": "main"
}
]

Also, Getting Started with Repositories states that the model name in <owner>/<model name> is the repository name, as follows:

3.Enter your model’s name. This will also be the name of the repository.

For this reason, I thought the following might be correct, so I prepared a gated hugging face model like the one below and submitted it, but an error occurred.

"hf_models": [
{
"repo_id": "your-team/aicrowd-your-model",
"revision": "main"
}
]

In that case, do I need to include aicrowd in the part of <owner>/<model name> in Using Gated Hugging Face Models in Your Submission?
In other words, do I really need to change the username of the huggingface account I’ve already created?