Seems like EVERYONE's submission is getting 'FAILED'

[kcy4]

Dear, hosters.
Are you monitering the competition’s leaderboard status?
It seems like everyone’s submission is getting failed since yesterday evening.
Would you review this problem and give us feedback?

Thank you.

p.s. Error message before error: Conv Ai Validation: Preparing the cluster for you

[biu_biu]

cc: @dipam @mohanty
It seems like several of us are facing the same issue.

1. Submission failure - pod deleted during operation - Commonsense Persona-Grounded Dialogue Chall-1f6f43 - AIcrowd Forum
2. Submission evaluation is stuck - Task 2: Commonsense Persona Knowledge Linking - AIcrowd Forum

[aicrowd_team]

@biu_biu @kcy4 : Please refer to this post: Service Announcement: Delays in GPU Node Provisioning

we will post more updates on this thread soon.

Best,
Mohanty

[decem]

Please reply to my discussion

Submission Failed - didn't get debug log of private dataset

Hello @ mohanty, I submitted and got results on the validation set, but inference failed on the private dataset. This is the inference speed on the validation set for the service I submitted. I don’t think this inference speed is causing the private dataset inference to take too long. Can you help me to see what is wrong with my submission? Thanks! Submission ID: v1.5 Submission issues ID: 249983 submission_hash : 8437873b724aa68596db07ab21a79ff2ac2494e3 Each piece of valid data: 100%|█████…

[tomtom]

Yes, a review / feedback on the issue would be great.