feature: Huggingface hub embedder

[zivkovicn]

Description

• we should have Huggingface hub embedder, like we currently have for openai/veretexai.

I will work on this.

[nidzola]

created: #246

[KarimNMG]

@nidzola I am trying to use the huggingface embedder, but it's not stable sometimes it works fine, sometimes I am getting this error "API returned unexpected status code: 503: unable to create embeddings", Could you please explain why this happen?

[zivkovicn]

@KarimNMG that is the Huggingface API issue - has nothing to do with the embedder it self. That usually means the instance is spinning up for you and should resolve after a while and this.

[KarimNMG]

@zivkovicn Thanks for your fast response !. Is there a way to load the model once and use it like python?

[zivkovicn]

@KarimNMG probably, but that would require some package like SentenceTransformer that python has.

[KarimNMG]

Ok, Thank you