We are constantly trying to improve this challenge for you and would appreciate any feedback you might have! 
Please reply to this thread with your suggestions and feedback on making the challenge better for you!
Cheers,
Team Amazon KDD Cup’23
Hi @snehananavati , I have a question about team system which I posted here (Question about team system). Could you help me answer it? Thanks.
Hi @snehananavati ,
For all the three tasks, I would like to see the metrics defined precisely in this page. The fractional notation appears to be broken.
Moreover, both MRR and BLEU are calculated for each sample (row) in the test_sessions, so how do you calculate the final score? E.g., take a simple average over samples of test_sessions, or weighted-mean.
Hi @snehananavati , could you help me cancel my operation for creating my team? Please see Could the staff cancel my operation for creating the team? in detail.
In addition, could we upload the compressed file of a submission, e.g. .zip, .7z, .gz?
The speed of file uploading is too slow.
Hi @Bruce your team creation has been reverted as you asked.
As for compressed files for submission, parquet has a number of compression options, can you use those directly? Are you seeing a major difference in size when using parquet’s available compression methods vs other ones?
Thanks a lot.
I tried to use gzip to obtain parquet with pandas, and the file become smaller.
Can you clarify if you save with df.to_parquet(filename, compression='gzip'), after this if you submit this file does it fail?
Yes. I save the file with df.to_parquet(filename, compression='gzip'.
It can work well
@dipam Hi, could you also help me cancel my operation for creating my team? I have the almost same case with BruceQD. Thanks.
Hi,
Where can I find the link to the data download?
Hi @snehananavati,
The timeline written in the rules is incorrect. Please correct it.
Overview:
Timeline
- Start Date: 15th March 2023
- End Date: 14th June 2023 00.00 UTC
- Winner Announcement: 14th June 2023
Rules
- CHALLENGE START AND END DATES (“CHALLENGE PERIOD”)
- Start Date: March 15, 2022
- Entry Deadline: June 09, 2022 at 00:00:00 UTC
- Winners Announced: June 14, 2022
Hello, I tried to create my own Collab Notebook, but I encountered a problem while opening it and couldn’t open it correctly.
I feel confused about this. May I ask the administrator to help me take a look at this issue? If you could tell me how I can solve it, it would be even better.
Fetch for https://api.github.com/gists/aicrowd-bot?zx=bzki8fbjr28n failed: { “message”: “Not Found”, “documentation_url”: “Gists - GitHub Docs” } CustomError: Fetch for https://api.github.com/gists/aicrowd-bot?zx=bzki8fbjr28n failed: { “message”: “Not Found”, “documentation_url”: “Gists - GitHub Docs” } at new HH (https://ssl.gstatic.com/colaboratory-static/common/d42b9041c87c7f85d49a93be9c3c668a/external_polymer_binary_l10n__zh_cn.js:2100:68) at ta.program_ (https://ssl.gstatic.com/colaboratory-static/common/d42b9041c87c7f85d49a93be9c3c668a/external_polymer_binary_l10n__zh_cn.js:2083:435) at va (https://ssl.gstatic.com/colaboratory-static/common/d42b9041c87c7f85d49a93be9c3c668a/external_polymer_binary_l10n__zh_cn.js:21:57) at ta.next_ (https://ssl.gstatic.com/colaboratory-static/common/d42b9041c87c7f85d49a93be9c3c668a/external_polymer_binary_l10n__zh_cn.js:19:195) at laa.next (https://ssl.gstatic.com/colaboratory-static/common/d42b9041c87c7f85d49a93be9c3c668a/external_polymer_binary_l10n__zh_cn.js:22:48) at b (https://ssl.gstatic.com/colaboratory-static/common/d42b9041c87c7f85d49a93be9c3c668a/external_polymer_binary_l10n__zh_cn.js:22:309)
Anyone who needs their team creation reverted please dm me, mention your registered email in the message, and if the team contains more than one member, all members need to message me consenting to it.
@dipam @snehananavati Hello! currently I can achieve about MRR@100=0.14 in the verification set of the custom division in the session_train.csv file, but the result is 0 after submitting the test set in session_test_task1.csv. I would like to know how the official process the submitted parquet file to get the final MRR value ,and this is helpful for me to troubleshoot related issues.
Same question. I am also curious about the official evaluation codes as I could reach MRR@100=0.3 in my self-splitting validation set from the session_train.csv, but I reached almost 0 after submitting the test set.
