A TextProcessing provider Large Language Model that runs locally on CPU
This app is deprecated in favor of llm2. Have a look at the docs for llm2
The models run completely on your machine. No private data leaves your servers.
After installing this app you will need to run
occ llm:download-model
Models:
Llama 2 by Meta
GPT4All Falcon by Nomic AI
Leo HessianAI by LAION LeoLM
x86 CPU
GNU lib C (musl is not supported)
Python 3.10+ (including python-venv)
With Nextcloud AIO, this app is not going to work because AIO uses musl. However you can use this community container as replacement for this app.
Positive:
Negative:
Positive:
Learn more about the Nextcloud Ethical AI Rating in our blog.
No comments found.