feat(#810 A2-R): NemotronH's dense weights reach the device, and the attention block that reads them is model-local (#517) - #950

Merged

localai-bot merged 8 commits into

mainfrom

row/MODEL-NEMOTRON-H-ABI-A2A

Aug 16, 2026

Commits on Aug 15, 2026

feat(#810 A2a): NemotronH's dense weights reach the device, and the attention block that reads them is model-local (#517)
mudler
committed
f6cd567
merge: origin/main @ 2688e6586 into row/MODEL-NEMOTRON-H-ABI-A2A (#810)
mudler
committed
a238f7c
fix(#810 A2a): the bf16 arm of the device gate could not see a rotation, and bf16 is the checkpoint's dtype
mudler
committed
f77dbac
fix(#810 A2-R): the armed margin observed nothing, the residency gate watched a test-local copy, and `nk` had no reader at all
mudler
committed
bfab1e9
merge: origin/main @ 4880c5715 into row/MODEL-NEMOTRON-H-ABI-A2A (#810)
mudler
committed
7d7d395
docs(#810 A2-R): the no-RoPE comment still described the guard it replaced
mudler
committed
5ea5c9e
docs(style): a bare `---` in a PR body deletes the trailer block from the parser's view
mudler
committed
d69a63a

Commits on Aug 16, 2026

merge: origin/main (903433958) into row/MODEL-NEMOTRON-H-ABI-A2A (#810)
mudler
committed
e10fb62