New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Figure1.作图疑问 #9

Open

Hardcandies opened this issue Apr 8, 2023 · 0 comments

Hardcandies commented Apr 8, 2023 •

edited

Loading

Hi, 麻烦问下。

对Fig.1的梯度均值，统计的是整体loss对模型的梯度向量的L2范数吗？
对Fig.1的梯度方差，统计的是[正样本doc的loss的梯度的L2范数, 负样本doc的loss梯度的L2范数】这个向量的方差吗？

如果可以的话，可以提供一个简单的作图代码。感谢！

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment