Skip to content

0.3.2

Compare
Choose a tag to compare
@MaiziXiao MaiziXiao released this 06 Sep 08:21
· 110 commits to main since this release
ff18545

The OpenCompass team is thrilled to announce the release of OpenCompass v0.3.2!

🚀 New Features

  • 🛠 Added extra_body support for OpenAISDK and introduced proxy URL support when connecting to OpenAI's API.
  • 🗂 Included auto-download functionality for Mmlu-pro, Needlebench, Longbench and other datasets.
  • 🤝 Integrated support for the Rendu API.
  • 🧪 Added a model postprocess function.

📖 Documentation

  • 📜 Updated the README file for better clarity and guidance.

🐛 Bug Fixes

  • 🛠 Fixed CLI evaluation for multiple models.
  • 🛠 Updated requirements to resolve dependency issues.
  • 🛠 Corrected configurations for the Llama model series.
  • 🛠 Addressed bad cases and added environment information to improve testing.

⚙ Enhancements and Refactors

  • 🛠 Made OPENAI_API_BASE compatible with OpenAI's default environment settings.
  • 🛠 Optimized SciCode for improved performance.
  • 🛠 Added an api_key attribute to TurboMindAPIModel.
  • 🛠 Implemented fixes and improvements to the CI test environment, including baselines for vllm.

🎉 Welcome New Contributors

  • 👋 @cpa2001 contributed with the addition of icl_sliding_k_retriever.py and updates to __init__.py.
  • 👋 @gyin94 made the OPENAI_API_BASE compatible with OpenAI's default environment.
  • 👋 @chengyingshe added an attribute api_key into TurboMindAPIModel.
  • 👋 @yanzeyu supported the integration of Rendu API.

Full Changelog: 0.3.1...0.3.2