From 4accd99121670a01ecb40a9c1a9c829fd554bea0 Mon Sep 17 00:00:00 2001 From: BenchAttributer Date: Fri, 13 Nov 2026 11:42:42 +0800 Subject: [PATCH] docs: announce OpenJudge v0.2.5 in README news --- README.md | 2 ++ README_zh.md | 2 ++ 2 files changed, 4 insertions(+) diff --git a/README.md b/README.md index 029da8dfc..a6dacaef2 100644 --- a/README.md +++ b/README.md @@ -54,6 +54,8 @@ It can also convert grading results into **reward signals** to help you **fine-t ## News +- **2026-11-10** - 🚀 **OpenJudge v0.2.5** is now available on PyPI, with fixes for grading correctness, multimodal evaluation prompts, model request compatibility, cancellation cleanup, and Auto Arena credential handling. 👉 [Release Notes](https://github.com/agentscope-ai/OpenJudge/releases/tag/v0.2.5) | [PyPI](https://pypi.org/project/py-openjudge/0.2.5/) + - **2026-06-17** - 🐾 **PawBench v1.0** - A Model × Harness co-evaluation benchmark for agentic AI: 150 tasks · 9 models · 3 harnesses, with public prompts, graders, task labels, submissions, and leaderboard slices. 👉 [GitHub](https://github.com/agentscope-ai/PawBench) | [Leaderboard](https://agentscope-ai.github.io/PawBench/) - **2026-04-07** - 🔒 **Skill Graders** - 5 new LLM-based graders for evaluating AI Agent Skill packages: threat analysis (AITech taxonomy), declaration alignment, completeness, relevance, and design quality. 👉 [Documentation](./docs/built_in_graders/skills.md) | [Cookbook](./cookbooks/skills_evaluation/README.md) diff --git a/README_zh.md b/README_zh.md index 82e78d15b..ec7f9faf0 100644 --- a/README_zh.md +++ b/README_zh.md @@ -52,6 +52,8 @@ OpenJudge 提供**即用型评分器**,并支持生成**场景特定的评估 ## 最新动态 +- **2026-11-10** - 🚀 **OpenJudge v0.2.5** 已在 PyPI 发布,修复评分正确性、多模态评估提示词、模型请求兼容性、取消任务清理及 Auto Arena 凭据处理等问题。👉 [发布说明](https://github.com/agentscope-ai/OpenJudge/releases/tag/v0.2.5) | [PyPI](https://pypi.org/project/py-openjudge/0.2.5/) + - **2026-06-17** - 🐾 **PawBench v1.0** - 面向智能体的 Model × Harness 协同评测基准:150 个任务 · 9 个模型 · 3 个 Harness,包含公开的 prompt、评分器、任务标签、提交结果和排行榜切片分析。 👉 [GitHub](https://github.com/agentscope-ai/PawBench) | [排行榜](https://agentscope-ai.github.io/PawBench/) - **2026-04-07** - 🔒 **Skill Graders** - 5 个新的基于 LLM 的 AI Agent Skill 包评估器:威胁分析(AITech 分类体系)、声明对齐、完整性、相关性和结构设计质量。 👉 [文档](./docs/built_in_graders/skills.md) | [Cookbook](./cookbooks/skills_evaluation/README.md)