5 times slower then before

[SidneyLann]

I had installed unsloth from github and pytorch 2.1.2 from pip and had 4 seconds/iteration. now I install unsloth 2024.11.7 from PIP and pytorch 2.5.1 from pip and had 20 seconds/iteration. 5 times slower then before. Is the unsloth or pytorch version cause the issue? What's the different for installing unsloth from github and pip?

[shimmyshimmer]

For which fine-tuning and which model? Llama?

[SidneyLann]

fine-tuning Llama 3.2 by gpu

[danielhanchen]

Wait do you remember what was the previous version?

[SidneyLann]

Now I run app for pytorch 2.1.0 + unsloth 2024.7 + python 3.10. it only start one python process. 4s/iter

But pytorch 2.5.1 +unsloth 2024.11.7 +python 3.12 start 17+1 python processes. 20s/iter

Is cudnn impact this? How to check if cudnn in using?