Got RuntimeError when run on Google Colab

[kietbg0079]

I ran the Readme.md samples on Google Colab with GPU and got this Error "RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cpu and cuda:0! (when checking argument for argument index in method wrapper__index_select)".

Error code:
outputs = model.generate(tokenizer(inputs, return_tensors="pt", padding=True).input_ids.to('cuda'), max_length=512)

[heraclex12]

Hi @kietbg0079

Sorry for not getting back to you sooner, to overcome this error, you should assign the model to GPU as well.

For example: model.cuda()

We will update the example code more accurately.