Search results

How to evaluate MathVista with GPT-like closed-source api?

Status: Open.

#1006 In open-compass/VLMEvalKit;

· TongkunGuan opened on May 23, 2025

单机多卡测试,shape对不上

Status: Open.

#1002 In open-compass/VLMEvalKit;

· dulibubai opened on May 21, 2025

除了输入image的路径之外，能否将image的tensor作为model.generate()方法的输入？

Status: Open.

#998 In open-compass/VLMEvalKit;

· fyqsama opened on May 19, 2025

Are there any problems with using vlmeval for the model evaluation of qwen2/2.5?

Status: Open.

#997 In open-compass/VLMEvalKit;

· warmsnow-sh opened on May 19, 2025

Fine-tuned Model

Status: Open.

#995 In open-compass/VLMEvalKit;

· JVal123 opened on May 17, 2025

InternVL2_5-8B-BoN-8（VisualPRM）任务无法复现

Status: Open.

#994 In open-compass/VLMEvalKit;

· YuanDaoze opened on May 17, 2025

support for think model

Status: Open.

#989 In open-compass/VLMEvalKit;

· nutsintheshell opened on May 12, 2025

关于qwen2.5omni的性能

Status: Open.

#988 In open-compass/VLMEvalKit;

· WenmuZhou opened on May 12, 2025

请问如何评测qwen2.5-omni的图文能力

Status: Open.

#983 In open-compass/VLMEvalKit;

· WenmuZhou opened on May 8, 2025

结果Excel能否保存每个样本正确或错误或者得分

Status: Open.

#981 In open-compass/VLMEvalKit;

· bjzhb666 opened on May 7, 2025

测试api based model时preprocess_message_with_role()会造成system prompt无限叠加

bugSomething isn't workingSomething isn't working

Status: Open.

#977 In open-compass/VLMEvalKit;

· vvirgooo2 opened on May 4, 2025

Adding LiveXiv - a live benchmark

Feature RequestExtra attention is neededExtra attention is needed

Status: Open.

#976 In open-compass/VLMEvalKit;

· NimrodShabtay opened on May 3, 2025