Releases: lucidrains/nGPT-pytorch
Releases · lucidrains/nGPT-pytorch
0.1.0
finishing touches release 0.1.0
0.0.14
flash attention and move the quasi hypersphere idea into the same fil…
0.0.12
make all scaling hyperparameter configurable for completeness
0.0.11
line up the scaling as in the paper
0.0.10
add tied embeddings for @faresobeid to play around with
0.0.9
address https://github.com/lucidrains/nGPT-pytorch/issues/1
0.0.8
add a quasi normalized gpt, which allow the vectors to inhabit a thin…
0.0.7
add a quasi normalized gpt, which allow the vectors to inhabit a thin…
0.0.6
fix more mistakes
0.0.5
oops