How to use Mock API in submission

Meta Comprehensive RAG Benchmark: KDD Cup 2-9d1937
#1

I don’t know the IP address and port number to call Mock API when getting remote evaluation.

I built my web server in my local environment ,so I can call API with “127.0.0.1:8000”, like bellow.

def __init__(self):
    self.server = os.environ.get('CRAG_SERVER', "http://127.0.0.1:8000")
#2

@aicrowd_team
Please check it.

#3

Please refer to the example here:

You do not need to include the MockAPI in your submission, it will be automatically made available in your evaluation environment, and the correct URI will be populated in the environment variable referenced in the example above (CRAG_MOCK_API_URL)

#4

Thank you.

I use the below script when I submit.
CRAG_MOCK_API_URL = os.getenv("CRAG_MOCK_API_URL", "http://localhost:8000")