Skip to content

funcation calling failed for xinference with qwen model #10878

@cyflhn

Description

@cyflhn

Self Checks

  • This is only for bug report, if you would like to ask a question, please head to Discussions.
  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • Please do not modify this template :) and fill in all the required fields.

Dify version

0.10.

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

bug for ollama provider:
1. add ollama provider in dify model settings.
2. launch a model with ollama
3. create an agent app in dify
4. check agent mode for this app.

bug for xinference provider:

  1. add xinference provider in dify model settings
  2. launch a qwen2.5 model with xinference.
  3. create an agent app in dify
  4. add a tool in this agent app.
  5. run this agent app.

✔️ Expected Behavior

for ollama provider
the agent mode should be function calling.
for xinference provider
the agent app runs ok with correct function calling result.

❌ Actual Behavior

for ollama provider
the agent mode is always reAct.
for xinference provider
the agent app could not run with tool integrated. There is an error showing that the parameter was incorrect with function calling for qwen model.

Metadata

Metadata

Assignees

No one assigned

    Labels

    🔨 feat:toolsTools for agent, function call related stuff.🤖 feat:agentAgent related topics

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions