fix(#1312): hold the NemotronH device MoE router pair resident instead of re-uploading it per token - #1348

fix(#1312): hold the NemotronH device MoE router pair resident instead of re-uploading it per token#1348

localai-bot wants to merge 6 commits into

mainmudler/vllm.cpp:mainfrom

row/A2-Q2A-MOE-ROUTER-RESIDENTmudler/vllm.cpp:row/A2-Q2A-MOE-ROUTER-RESIDENTCopy head branch name to clipboard