OpenCompass v0.2.6
The OpenCompass team is thrilled to announce the release of OpenCompass v0.2.6!
🌟 Highlights
- No noteworthy highlights.
🚀 New Features
📖 Documentation
🐛 Bug Fixes
- #1221 Resolve release version installation and import issues
- #1228 Fix pip version issues
- #1282 Update MathBench summarizer & fix cot setting
⚙ Enhancements and Refactors
- #1284 Reorganize subjective eval
🎉 Welcome New Contributors
- @mqy004, @sefira, @Zor-X-L and @baymax591 made their first contributions. Welcome to the OpenCompass community!
🔗 Full Change Logs
- [Fix] fix summarizer by @bittersweet1999 in #1217
- 解决release版本安装后不能导入opencompass.cli.main的问题 by @mqy004 in #1221
- MT-Bench-101 by @sefira in #1215
- [Feature] add dataset Fofo by @bittersweet1999 in #1224
- [Fix] fix pip version by @bittersweet1999 in #1228
- add ",<2.0.0" to "numpy>=1.23.4" in requirements/runtime.txt, as pand… by @Zor-X-L in #1267
- Support wildbench by @kleinzcy in #1266
- Add doc for accelerator function by @liushz in #1252
- flash attn installation in daily testcase by @zhulinJulia24 in #1272
- Update mtbench101.py by @sefira in #1276
- [Sync] Sync with internal codes 2024.06.28 by @Leymore in #1279
- Update MathBench summarizer & fix cot setting by @liushz in #1282
- npu适配 by @baymax591 in #1250
- [ci] update daily testcase by @zhulinJulia24 in #1285
- [Feature] Add InternLM2.5 by @tonysy in #1286
- [Feat] Update owners for issues by @tonysy in #1293
- [Refactor] Reorganize subjective eval by @bittersweet1999 in #1284
- [Doc] quick start swap tabs by @Leymore in #1263
Full Changelog: 0.2.5...0.2.6