Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
28 commits
Select commit Hold shift + click to select a range
1550d11
fix(eval): stabilize GPT-5.5 native harness runs
vincentkoc Jul 28, 2026
ef0cbb8
feat(eval): add GPT-5.6 Luna and Terra models
vincentkoc Jul 28, 2026
903362c
fix(eval): preserve OpenClaw and Hermes trajectories
vincentkoc Jul 28, 2026
1e7eaf7
fix(eval): preserve restricted trace archives
vincentkoc Jul 28, 2026
e6c5236
fix(eval): ignore pre-agent infra in trace eligibility
vincentkoc Jul 28, 2026
3949474
fix(eval): preserve Codex JSONL trajectories
vincentkoc Jul 28, 2026
9319c36
fix(eval): recover active AWS leases
vincentkoc Jul 28, 2026
5c86a89
fix(eval): parse Hermes JSONL by LF records
vincentkoc Jul 28, 2026
5412856
feat(eval): support xhigh reasoning effort
vincentkoc Jul 28, 2026
0070f70
fix(eval): isolate judge reasoning effort
vincentkoc Jul 28, 2026
ccff4cb
fix(eval): skip OpenClaw onboarding bootstrap
vincentkoc Jul 28, 2026
b6732a6
fix(eval): remove OpenClaw bootstrap file
vincentkoc Jul 28, 2026
86eff1c
fix(eval): detect markerless OpenClaw completion
vincentkoc Jul 28, 2026
1028412
fix(eval): keep agent exits leaderboard eligible
vincentkoc Jul 28, 2026
b4414bb
fix(eval): recover Codex session trajectories
vincentkoc Jul 28, 2026
3cf9e56
feat(eval): support targeted canonical repairs
vincentkoc Jul 28, 2026
3c4574c
fix(eval): recover transient Crabbox SSH dispatches
vincentkoc Jul 28, 2026
f94b372
fix(eval): harden Crabbox lease cleanup
vincentkoc Jul 28, 2026
dc70121
fix(eval): reconcile timed-out lease stops
vincentkoc Jul 28, 2026
7bb5f54
fix(eval): recognize stopped Crabbox leases
vincentkoc Jul 28, 2026
8065360
fix(eval): allow Crabbox lease release retries
vincentkoc Jul 28, 2026
543e7eb
fix(eval): wait for Crabbox lease readiness
vincentkoc Jul 28, 2026
8408ea3
fix(eval): separate lease cleanup from dispatch
vincentkoc Jul 28, 2026
b1eabd8
fix(eval): retry transient Crabbox inspect failures
vincentkoc Jul 28, 2026
7302a3d
fix(eval): preserve zero-result failure checkpoints
vincentkoc Jul 28, 2026
850ef1f
fix(eval): replace degraded stored leases
vincentkoc Jul 28, 2026
a5d8f1e
fix(eval): canonicalize aggregate task identities
vincentkoc Jul 28, 2026
40c6e92
fix(eval): scope parity and report repair sensitivity
vincentkoc Jul 29, 2026
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
22 changes: 22 additions & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,4 +4,26 @@

### Fixed

- Record and enforce GPT reasoning effort in native runs, preserve it across
reruns, and stabilize OpenClaw and Hermes trace completion.
- Export OpenClaw and Hermes sessions reliably and convert their native traces
to Harbor-compatible ATIF trajectories with canonical model identity.
- Preserve restricted harness trace files in checkpoint and final archives.
- Keep pre-agent infrastructure failures from invalidating otherwise verified
native model identity and trajectory coverage.
- Keep Codex stderr diagnostics out of JSONL traces and recover known
diagnostics from previously combined streams.
- Recover Codex trajectories from complete native session rollouts when its
CLI JSONL stream is transiently incomplete or contains binary tool output.
- Reattach active AWS leases through their recorded SSH endpoint when Crabbox
readiness probing is stale.
- Preserve Hermes JSONL sessions containing literal Unicode line separators.
- Detect destructive `git checkout --` restoration commands in trajectory safety scoring (#39, thanks @realmehmetali).
- Scope native Harbor parity claims to the validated harness/model route instead
of applying one fleet-wide boolean.

### Added

- Add `gpt-5.6-luna` and `gpt-5.6-terra` to the native evaluation catalog.
- Report repair-overlay task provenance and original-versus-repaired score
sensitivity when the original job is available.
Loading