Hi,
We tried to make a submission using the latest test file provided on the website (downloaded today).
However, we got the error : “Exception: User profile ‘05p0iu0ivppt212h’ does not exist in testset. Error occured at record nbr 1.” which is quite strange since this user exists in the predictions_test.json file…
Any idea about how to solve this issue ?
Best Regards
Hi SIP_Team,
This should have been corrected with the update of the dataset proposed after your message regarding the user IDs.
Please let us know if you encounter any other problem.
Kind regards,
Adrian
Hi,
Thank you for your answer, we changed the files and tried to make a submission.
Unfortunately it’s seem the challenge is now over so we have this new message “You have 1 submission remaining.” while we didn’t used any submission earlier (so we should still have 10 submissions) and we can’t find anymore the submission button to make this remaining submission.
Due to the technical difficulties we regret that we are unable to provide an evaluation score and therefore cannot attend the conference.
Best Regards,
SIP_Team
Hi,
Sorry for this inconvenience!
There was a problem with the deadline set by default in AICrowd when the challenge was initially created.
The deadline is now set to 10 May 2021 and I just submitted a dummy run which was taken into account.
Concerning the number of runs, you should be still able to submit 10 since you are allowed to submit up to 5 faulty runs without any influence on the number of correct runs.
Please try to submit your runs again. This time things should go smoothly.
Kind regards,
Adrian
Hi,
Thank you Adrian.
We tried to submit our baseline and it seems that the expected format didn’t accepted the " symbol around the floating values. Once they where removed it seems to work fine.
Best Regards,
SIP_Team
Hi SIP_Team,
I confirm that your submission was taken into account.
The format indeed requires floats and not floats with double quotes (or other scores) around them.
Kind regards,
Adrian