Support LiteLLM pip package https://github.com/BerriAI/litellm

[ishaan-jaff]

Starting a disucssion to add litellm python package support on Cloudflare Python workers https://github.com/BerriAI/litellm

[mitch-36]

+1

[Manouchehri]

Right now requirements.txt isn't supported by Python Workers.

https://developers.cloudflare.com/workers/languages/python/

Here's the list of supported packages:

https://developers.cloudflare.com/workers/languages/python/packages#supported-packages

Would LiteLLM work properly with that super restricted list?

[ishaan-jaff]

Having initial support for LiteLLM + OpenAI / Azure would be a good start

Would LiteLLM work properly with that super restricted list?

Yes - but LiteLLM would not be able to support VertexAI, Bedrock Models

[krrishdholakia]

We can move to making the calls to bedrock + vertex via http - this should loosen the requirement there. @Manouchehri

[krrishdholakia]

bedrock + vertex calls now use httpx. Still need the core packages for handling auth though.

[rawwerks]

+100 for adding litellm!

[krrishdholakia]

cc: @AdityaAtulTewari @hoodmane @fhanau