Hello, I have a few questions.
-
Currently, the grpc server counts each action request as a step, not each response. Therefore, even if the response isn’t called 200 times, if you send multiple actions from the use_tool action, the server counts each as a step and recognizes that 200 steps have been reached. For example, when executing the continue_dialog action, the client counts it as one step, but the server counts each action (a) that moves the dialog box forward as one step. I changed this to a client-side step counting method, and I’m wondering if this is legal.
-
I’m curious about how much information is allowed in the prompt. The current rules seem ambiguous.
Thank you for your help.