Feature request: make Wllama an option, next to WebLLM

[flatsiedatsie]

Wllama is a browser-based version of Llama.cpp with low-level capabilities, and has a built-in embedding option too.

https://github.com/ngxson/wllama

While WebLLM only runs on WebGPU-enabled browsers, Wllama can run on all browsers. It could perhaps be a great fallback option? E.g. for Safari / Firefox?

[jacoblee93]

Interesting! Would love to look into it!