Skip to content

Commit

Permalink
[ez] Remove legacy float8 enabling flag in 405B toml (pytorch#559)
Browse files Browse the repository at this point in the history
Somehow, when rebasing, the legacy float8 enabling flag stays in the
405B toml. Let's remove it. And this does not affect the perf number we
obtained because the old flag is just a no-op after rebase.
  • Loading branch information
fduwjj authored Aug 23, 2024
1 parent 21e8b55 commit 3bdccb9
Showing 1 changed file with 0 additions and 1 deletion.
1 change: 0 additions & 1 deletion train_configs/llama3_405b.toml
Original file line number Diff line number Diff line change
Expand Up @@ -33,7 +33,6 @@ max_norm = 1.0 # grad norm clipping
steps = 3000
data_parallel_degree = -1
tensor_parallel_degree = 8 # 8-way TP
enable_float8_linear = false
compile = true
dataset = "c4"

Expand Down

0 comments on commit 3bdccb9

Please sign in to comment.