How to download for huggingface LLM pretrained model

hello, can we download models from huggingface? it is too large for us to upload the model files.


at present, we have not supported downloading from huggingface. We are working on that now, but that would be limited to a relatively small set of models, which we will host on our clusters and you can call them locally.

We suggest that you should try using git lfs, which we think would be OK to handle even 70B model checkpoints. It may also happen that our cached models do not meet your demands and you still have to upload them by yourself.

Hi @yilun_jin,

Just to clarify, we can not download models using Dockerfile either, right?

We recommend against it, as this causes pressure on the file system we use.

One more question please. Sorry, maybe I missed this. Is the 25GB limit still valid? Or after moving to we can use more?

After consulting with aicrowd folks, we confirm that the current limit is 200GB.

1 Like