OpenAI /v1/evals — Bedrock Model Evaluation

[JGoutin]

Implement OpenAI-compatible evals API backed by Amazon Bedrock Model Evaluation.

• POST /v1/evals
• GET /v1/evals
• GET /v1/evals/{eval_id}
• DELETE /v1/evals/{eval_id}
• POST /v1/evals/{eval_id}/runs
• GET /v1/evals/{eval_id}/runs
• GET /v1/evals/{eval_id}/runs/{run_id}
• DELETE /v1/evals/{eval_id}/runs/{run_id}
• GET /v1/evals/{eval_id}/runs/{run_id}/output_items

REF:

• https://platform.openai.com/docs/api-reference/evals
• https://docs.aws.amazon.com/bedrock/latest/userguide/model-evaluation.html