Skip to content

Add Gradnorm to TensorBoard#20

Open
osilkin98 wants to merge 1 commit intokarpathy:masterfrom
osilkin98:some-updates
Open

Add Gradnorm to TensorBoard#20
osilkin98 wants to merge 1 commit intokarpathy:masterfrom
osilkin98:some-updates

Conversation

@osilkin98
Copy link
Copy Markdown

@osilkin98 osilkin98 commented Nov 24, 2024

Resolves #19

This PR adds a Gradnorm view to TensorBoard by computing the average of the L2 gradnorm across all parame

Here's how it appears in TensorBoard:

Screenshot 2024-11-23 at 10 25 13 PM ters.

Signed-off-by: Oleg 16809287+osilkin98@users.noreply.github.com

Signed-off-by: Oleg <16809287+osilkin98@users.noreply.github.com>
@Anurag1
Copy link
Copy Markdown

Anurag1 commented Apr 4, 2026

@gradnorm

Copy link
Copy Markdown

@Anurag1 Anurag1 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copy link
Copy Markdown

@Anurag1 Anurag1 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Plot Gradnorm

2 participants