Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

mlp的测试用例不够好 #5

Open
17999824wyj opened this issue Sep 19, 2024 · 0 comments
Open

mlp的测试用例不够好 #5

17999824wyj opened this issue Sep 19, 2024 · 0 comments

Comments

@17999824wyj
Copy link

在实现mlp时，我在silu时，错误的写反了“gate”和“up”，但由于目前的测试用例里，gate和up是数值相同的，导致我当时并未发现此问题。在项目阶段，我才偶然发现了这个问题，这会导致最后的输出出现乱码。

建议将test_mpl的up和gate的值进行区分。
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@17999824wyj