Do I need to set up my own openai key when uploading evaluations

Meta Comprehensive RAG Benchmark: KDD Cup 2-9d1937
#1

image
Does openai key need to be set? What if I don’t have my own openai key? How do I assess

#2

@yaxun_dai : We will be evaluating the predictions using a separate script, which has access to the openai keys. so you do not need to include your own api keys.

1 Like
#3

But when running local_evaluation.py line 185，it would give an error without an openai client key.

#4

@hongru_liu: No, the evaluator provides its own OpenAI key when evaluating your submissions.

#5

So when I submit the api_key in the local_evaluation.py file, is it okay to write it like this before submitting it? Because I failed to submit it four times, I don’t know if it is possible. Please answer it at your convenience. Thank you.

image
image1117×326 32.1 KB

@aicrowd_team

#6

@zhuozj : You do not need to submit your OpenAI API Keys to the evaluation servers. We include our own API keys when evaluating your submissions.