Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: 模型回答时极大概率出现� #1039

Open
4 tasks done
GitHub-lql opened this issue Oct 28, 2024 · 3 comments
Open
4 tasks done

[Bug]: 模型回答时极大概率出现� #1039

GitHub-lql opened this issue Oct 28, 2024 · 3 comments

Comments

@GitHub-lql
Copy link

Model Series

Qwen2.5

What are the models used?

Qwen2.5-3B-Instruct

What is the scenario where the problem happened?

使用tensorrt进行模型加速

Is this a known issue?

  • I have followed the GitHub README.
  • I have checked the Qwen documentation and cannot find an answer there.
  • I have checked the documentation of the related framework and cannot find useful information.
  • I have searched the issues and there is not a similar one.

Information about environment

Log output

Description

例如进行回答时,问题:关于4K显示器的支持情况及分辨率和刷新率的信息?

大模型回答:�记本通常支持通过HDMI、DP等接口连接4K显示器并输出相应的分辨率和刷新率。

@GitHub-lql
Copy link
Author

在输出添加了decode(errors='ignore')没有变化

@jklj077
Copy link
Collaborator

jklj077 commented Oct 29, 2024

please provide steps to reproduce. do you have the generated token ids?

@gloomy-emerald
Copy link

Same problem, gone after updating ollama.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants