I know that we have commnad for submission
./submission.sh 1
I believe this refers to the file predict.py and runs at backedn to create the final submissions.
Now let us assume if this predict.py has some error and we do a submission. How do we know if this has run with error beucase once you run in submission it is not giving any error message in terminal. How to identify the errors? Any debug method? to know location of error in code and any other pointers which it dispalys error message.
We provide feedback for all the submissions via Gitlab issues.
To clarify, the exact flow is as follows:
You make changes to your code, followed by git commit
./submission.sh <xyz> to create a new git tag and push it to the repository
We create a new Gitlab issue in your repository when your submission tag is correct i.e. prefix of the Gitlab tag is submission- (prefix thing happen automatically in submission.sh for Novartis challenge)
In case to run locally, you can simply call ./run.sh on your local system and it mimics what will happen on online server (except the runtime environment). When ran in online environment i.e. as a submissions we provide feedback via sharing logs, you can read more about it here.
@shivam Thanks very much for the clear explanation.
For the Submission Received #25991.
I see that imagebuildsuccessfully but failed evaluation.
Can you please let me know which is leading to failed evaluation - at what part of the code? Any debug mode available ? to check my code myself.
Please check out this FAQ for debug mode which will speed up your debugging. Meanwhile also try running ./run.sh in local system (workspace) before submitting, to catch bugs without even making a submission (as submissions/day are limited).
I see an error when am submitting to the environment. but when i ran it locally it provided me predictions. #25998
Here is the error on log issue:
2019-11-30T09:24:10.376970299Z Traceback (most recent call last):
2019-11-30T09:24:10.376999401Z File “predict.py”, line 30, in
2019-11-30T09:24:10.377004301Z import xgboost as xgb
2019-11-30T09:24:10.377008101Z ModuleNotFoundError: No module named ‘xgboost’
I installed locally these packages xgboost , lightgbm, catboost by
pip install xgboost --user
pip install lightgbm --user
pip install catboost --user
my belief is that the above packages are not updated in the environment i think. Can you please update from your side.
to update in environment I did this below
conda env export --no-build>environment.yml
(but I do not think the environment.yml is updated).
Thanks for sharing the output. The pip package installation looks correct on your side.
I am suspecting pip version to be 18.X on similar on your side which isn’t working out well with conda. (Github Issue)
Can you share output of pip -V and also at the same time try installing pip version 10.X by conda install pip=10 . The exports so generated should contain all of your pip packages as well.
Let me know if this resolves the issue you are facing.
Hi, as I mentioned earlier you will need to get in touch with Aridhia first on Microsoft Teams to get your conda working i.e. fixing permission issue above.
After this, conda install pip=10 should resolve this issue. If not, we can debug further.
Hi, I just remembered that participants were having sudo in their workspace. Can you instead try running the sudo chown... command yourself on workspace? I believe it will fix the permission issue for you, followed by pip=10 installation.
Aridhia team seems to be clueless on how to resolve or troubleshoot. They are just giving us the readme link and check the error. It is so strange they are not able to do this.
As an alternative:
Can I open the environment.yml manually and update the packages ? This is what I have done.
I dont think this is working. This is the error I got in AICrowd issues log.
