To maintain the open AI compatibility of your API, would it be possible to disable the reasoning of the LLM if reasoning_effort: "none" is specified in the request?
I know the standard way to disable the thinking for models such as Gemma 4 and Qwen 3 would be { ..., chat_template_kwargs: {"enable_thinking": false} }, but I don't want to have to write VLLM/LLAMA specefic parameters in OpenAI request.
To maintain the open AI compatibility of your API, would it be possible to disable the reasoning of the LLM if
reasoning_effort: "none"is specified in the request?I know the standard way to disable the thinking for models such as Gemma 4 and Qwen 3 would be
{ ..., chat_template_kwargs: {"enable_thinking": false} }, but I don't want to have to write VLLM/LLAMA specefic parameters in OpenAI request.