0.3.2
The OpenCompass team is thrilled to announce the release of OpenCompass v0.3.2!
🚀 New Features
- 🛠 Added
extra_body
support for OpenAISDK and introduced proxy URL support when connecting to OpenAI's API. - 🗂 Included auto-download functionality for Mmlu-pro, Needlebench, Longbench and other datasets.
- 🤝 Integrated support for the Rendu API.
- 🧪 Added a model postprocess function.
📖 Documentation
- 📜 Updated the README file for better clarity and guidance.
🐛 Bug Fixes
- 🛠 Fixed CLI evaluation for multiple models.
- 🛠 Updated requirements to resolve dependency issues.
- 🛠 Corrected configurations for the Llama model series.
- 🛠 Addressed bad cases and added environment information to improve testing.
⚙ Enhancements and Refactors
- 🛠 Made OPENAI_API_BASE compatible with OpenAI's default environment settings.
- 🛠 Optimized SciCode for improved performance.
- 🛠 Added an
api_key
attribute to TurboMindAPIModel. - 🛠 Implemented fixes and improvements to the CI test environment, including baselines for vllm.
🎉 Welcome New Contributors
- 👋 @cpa2001 contributed with the addition of icl_sliding_k_retriever.py and updates to __init__.py.
- 👋 @gyin94 made the OPENAI_API_BASE compatible with OpenAI's default environment.
- 👋 @chengyingshe added an attribute
api_key
into TurboMindAPIModel. - 👋 @yanzeyu supported the integration of Rendu API.
Full Changelog: 0.3.1...0.3.2