Skip to content

Conversation

@XkunW
Copy link
Contributor

@XkunW XkunW commented Nov 11, 2025

PR Type

[Feature]

Short Description

Add SGlang as alternative inference engine to vLLM

XkunW and others added 30 commits November 11, 2025 15:49
Fix disk space blowup by adding cache clean
XkunW and others added 28 commits December 3, 2025 17:58
… of 'CACHED_CONFIG_DIR/models.yaml'to maintain backwards compatibility
… launch options and config for better abstraction
@codecov-commenter
Copy link

codecov-commenter commented Dec 15, 2025

Codecov Report

❌ Patch coverage is 96.47887% with 5 lines in your changes missing coverage. Please review.
✅ Project coverage is 91.30%. Comparing base (e8f0788) to head (cbe250f).

Files with missing lines Patch % Lines
vec_inf/client/_slurm_script_generator.py 90.32% 3 Missing ⚠️
vec_inf/cli/_cli.py 75.00% 1 Missing ⚠️
vec_inf/client/_utils.py 83.33% 1 Missing ⚠️

❌ Your changes status has failed because you have indirect coverage changes. Learn more about Unexpected Coverage Changes and reasons for indirect coverage changes.

Additional details and impacted files

Impacted file tree graph

@@            Coverage Diff             @@
##             main     #164      +/-   ##
==========================================
+ Coverage   90.83%   91.30%   +0.46%     
==========================================
  Files          14       14              
  Lines        1342     1426      +84     
==========================================
+ Hits         1219     1302      +83     
- Misses        123      124       +1     
Files with missing lines Coverage Δ
vec_inf/cli/_helper.py 95.47% <100.00%> (+0.16%) ⬆️
vec_inf/cli/_vars.py 100.00% <100.00%> (ø)
vec_inf/client/_client_vars.py 100.00% <100.00%> (ø)
vec_inf/client/_helper.py 93.26% <100.00%> (+0.65%) ⬆️
vec_inf/client/_slurm_templates.py 100.00% <100.00%> (ø)
vec_inf/client/_slurm_vars.py 80.00% <100.00%> (+0.93%) ⬆️
vec_inf/client/config.py 100.00% <100.00%> (ø)
vec_inf/client/models.py 100.00% <100.00%> (ø)
vec_inf/cli/_cli.py 88.00% <75.00%> (-0.31%) ⬇️
vec_inf/client/_utils.py 80.98% <83.33%> (+2.09%) ⬆️
... and 1 more

Impacted file tree graph

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants