v3.12.1
✨ gpt-oss is here! ✨
Read about the release in the blog post
3.12.1 (2025-08-11)
Features
commentsegment budget (#489) (30eaa23) (documentation: API:LLamaChatPromptOptions["budgets"]["commentTokens"])- Electron template: comment segments
- Electron template: improve completions speed when using functions
Bug Fixes
gpt-osssegment budgets (#489) (30eaa23)- add support for more
gpt-ossvariations (#489) (30eaa23) - default to using a model message for prompt completion on unsupported models (#489) (30eaa23)
- prompt completion config (#490) (f849cd9)
Shipped with llama.cpp release b6133
To use the latest
llama.cpprelease available, runnpx -n node-llama-cpp source download --release latest. (learn more)
