You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hello, as someone who has contributed to the data of Open Assistant, I would really appreciate it if I (and others) could make use of it locally on mobile.
To run Open Assistant on Android a llama2-7b based model would be needed (there is a mlc apk that supports llama2 but the official version with llama2 support needs time to be released).
Here is a link that could help with making the model: mlc-llm docs
Hello, as someone who has contributed to the data of Open Assistant, I would really appreciate it if I (and others) could make use of it locally on mobile.
To run Open Assistant on Android a llama2-7b based model would be needed (there is a mlc apk that supports llama2 but the official version with llama2 support needs time to be released).
Here is a link that could help with making the model:
mlc-llm docs
And here is an example of a model that runs on mobile (Android):
huggingface mlc-chat-georgesung-llama2-7b-chat-uncensored-q4f16_1
The text was updated successfully, but these errors were encountered: