Git push over 50mb

Unity Obstacle Tower Challenge
#1

How can I push a file over 50mb?

During the submission.
I got an error when I restore my model.

Message type "tensorflow.MetaGraphDef" has no field named "version"..

This problem is rare.I google it and has little result.But the model runs fine in the GCP. I try many way to figure out. Finally I try not use the “git lfs” but normal git push the .meta file and problem solved.
Then I got another error:

not an sstable (bad magic number)

and I tried to normal git push the other model files. Lots of them was pushed. Except a file about 81mb.

When I push it. Shows the error

 fatal: pack exceeds maximum allowed size.

I use git lfs, and submission failed. It shows

Checksum does not match:

I google it , Lots of people tell the error occurred by using the wrong file.
I can run my model on GCP. So I think it is just occurred by the git lfs.

I google it, use the

git config http.postBuffer 52428800
git config -l

not useful.And I can’t find any place to change the limit.
There is someone can help me solve this problem?

#2

@Petero: You will have to use git-lfs (https://dzone.com/articles/git-lfs-why-and-how-to-use) for larger files. We recommend using git-lfs-migrate (https://manpages.debian.org/unstable/git-lfs/git-lfs-migrate.1.en.html) to migrate the larger files into git-lfs.

#3

Hi, Mohanty. There is the “pending” problem again.

Evaluation Logs (Debug Mode)
This is a debug mode to test out your submission in AICrowd environment, the actual scores for this submission will not be reflected back to leaderboard.
State : Evaluation Pending :hourglass:
Total Execution Time :hourglass: : 12634s

Pod Health :heart:

Pod State : Pending

Pod Scheduling Time :clock1: : 12135 secs

Containers Waiting :large_orange_diamond: : redis-server,aicrowd-subcontractor

#4

@Petero : They should be scheduled now.

#5

Hi,Mohanty. I think the problem is still there.

#7

https://gitlab.aicrowd.com/Petero/obstacle-tower-challenge/issues/54

Evaluation Logs (Debug Mode)
This is a debug mode to test out your submission in AICrowd environment, the actual scores for this submission will not be reflected back to leaderboard.
State : Evaluation Pending :hourglass:
Total Execution Time :hourglass: : 9919s

Pod Health :heart:

Pod State : Pending

Pod Scheduling Time :clock1: : 9530 secs

Containers Waiting :large_orange_diamond: : redis-server,aicrowd-subcontractor

#8

I have same issue.
It is difficult to solve because it fails without errors.
https://gitlab.aicrowd.com/kenshi_abe/obstacle-tower-challenge/issues/55

#9

@Petero @kenshi_abe
Thanks for reporting. We noticed problem in our inter-container communication, due to which multiple submissions were stuck in pending state (including yours).

The issue has been fully resolved now and re-evaluation is triggered on all the affected submissions. Please let us know if you still face any issue.

1 Like
#10

I have used the git-lfs to push the large files to our project. But it still cannot work, can you do some help or give me some advice. I have already create a topic here:Error uploading fail
And when I try to use HTTP to connect the gitlab project, I don’t know how to activate the personal access token, because after I successfully create the token, I cannot see it from the list below.
Thank you very much!!!

image
image.png802×86 4.46 KB

#11

I use this method and solve my problem. You can try this.