Unable to optimize microsoft/deberta-v3-small model

[hlkong323]

Here's command and error message. Please advise and help fix it. Thanks!

sudo docker run -it --rm --gpus all -v $PWD:/project ghcr.io/els-rd/transformer-deploy:latest bash -c "cd /project &&
convert_model -m "microsoft/deberta-v3-small"
--backend tensorrt onnx
--seq-len 16 128 128
--task classification"

[bminixhofer]

Hi @pommedeterresautee, I have the same problem trying to optimize DeBERTa.

Do you think it's possible to fix this with a reasonable amount of effort? In my experience DeBERTa is the best encoder-style model right now so this would be super useful to have.

[pommedeterresautee]

Currently it s not on our todo