Skip to content
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
26 commits
Select commit Hold shift + click to select a range
6737e85
fix(eval): preserve OpenClaw and Hermes trajectories
vincentkoc Jul 28, 2026
c892362
fix(eval): preserve restricted trace archives
vincentkoc Jul 28, 2026
8c32eac
fix(eval): ignore pre-agent infra in trace eligibility
vincentkoc Jul 28, 2026
c6f246f
fix(eval): preserve Codex JSONL trajectories
vincentkoc Jul 28, 2026
1e1d042
fix(eval): recover active AWS leases
vincentkoc Jul 28, 2026
23bc37f
fix(eval): parse Hermes JSONL by LF records
vincentkoc Jul 28, 2026
ca5c341
feat(eval): support xhigh reasoning effort
vincentkoc Jul 28, 2026
242c5d6
fix(eval): isolate judge reasoning effort
vincentkoc Jul 28, 2026
7b0fc61
fix(eval): skip OpenClaw onboarding bootstrap
vincentkoc Jul 28, 2026
b3d340c
fix(eval): remove OpenClaw bootstrap file
vincentkoc Jul 28, 2026
d676d3c
fix(eval): detect markerless OpenClaw completion
vincentkoc Jul 28, 2026
2a71ebd
fix(eval): keep agent exits leaderboard eligible
vincentkoc Jul 28, 2026
736022e
fix(eval): recover Codex session trajectories
vincentkoc Jul 28, 2026
feae39f
feat(eval): support targeted canonical repairs
vincentkoc Jul 28, 2026
f8b16d4
fix(eval): recover transient Crabbox SSH dispatches
vincentkoc Jul 28, 2026
d96f33d
fix(eval): harden Crabbox lease cleanup
vincentkoc Jul 28, 2026
e6c1fd8
fix(eval): reconcile timed-out lease stops
vincentkoc Jul 28, 2026
02246ab
fix(eval): recognize stopped Crabbox leases
vincentkoc Jul 28, 2026
7faa58e
fix(eval): allow Crabbox lease release retries
vincentkoc Jul 28, 2026
1b309db
fix(eval): wait for Crabbox lease readiness
vincentkoc Jul 28, 2026
63eed14
fix(eval): separate lease cleanup from dispatch
vincentkoc Jul 28, 2026
37cca8f
fix(eval): retry transient Crabbox inspect failures
vincentkoc Jul 28, 2026
9e1e001
fix(eval): preserve zero-result failure checkpoints
vincentkoc Jul 28, 2026
568bd59
fix(eval): replace degraded stored leases
vincentkoc Jul 28, 2026
f2633f2
fix(eval): canonicalize aggregate task identities
vincentkoc Jul 28, 2026
a0c5600
fix(eval): scope parity and report repair sensitivity
vincentkoc Jul 29, 2026
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
16 changes: 16 additions & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,8 +6,24 @@

- Record and enforce GPT reasoning effort in native runs, preserve it across
reruns, and stabilize OpenClaw and Hermes trace completion.
- Export OpenClaw and Hermes sessions reliably and convert their native traces
to Harbor-compatible ATIF trajectories with canonical model identity.
- Preserve restricted harness trace files in checkpoint and final archives.
- Keep pre-agent infrastructure failures from invalidating otherwise verified
native model identity and trajectory coverage.
- Keep Codex stderr diagnostics out of JSONL traces and recover known
diagnostics from previously combined streams.
- Recover Codex trajectories from complete native session rollouts when its
CLI JSONL stream is transiently incomplete or contains binary tool output.
- Reattach active AWS leases through their recorded SSH endpoint when Crabbox
readiness probing is stale.
- Preserve Hermes JSONL sessions containing literal Unicode line separators.
- Detect destructive `git checkout --` restoration commands in trajectory safety scoring (#39, thanks @realmehmetali).
- Scope native Harbor parity claims to the validated harness/model route instead
of applying one fleet-wide boolean.

### Added

- Add `gpt-5.6-luna` and `gpt-5.6-terra` to the native evaluation catalog.
- Report repair-overlay task provenance and original-versus-repaired score
sensitivity when the original job is available.
Loading