Local Large language model

Highest Nextcloud version

Nextcloud 28
Show all releases

Community rating
Author

Marcel Klehr

Last updated

1 year, 2 months ago

Categories

Tools

Interact
Report problem Request feature Ask questions or discuss

A TextProcessing provider Large Language Model that runs locally on CPU

This app is deprecated in favor of llm2. Have a look at the docs for llm2

The models run completely on your machine. No private data leaves your servers.

After installing this app you will need to run

occ llm:download-model

Models:

Nextcloud All-in-One:

With Nextcloud AIO, this app is not going to work because AIO uses musl. However you can use this community container as replacement for this app.

Ethical AI Rating "Llama 2" model

Rating: 🟡

Positive:

  • the software for training and inference of this model is open source
  • the trained model is freely available, and thus can be run on-premises

Negative:

  • the training data is not freely available, limiting the ability of external parties to check and correct for bias or optimise the model’s performance and CO2 usage.

Ethical AI Rating for "GPT4All Falcon" model

Rating: 🟢

Positive:

  • the software for training and inference of this model is open source
  • the trained model is freely available, and thus can be run on-premises
  • the training data is freely available, making it possible to check or correct for bias or optimise the performance and CO2 usage.

Learn more about the Nextcloud Ethical AI Rating in our blog.

Releases

Nextcloud version Stable channel Nightly channel All releases
28 1.2.1 - 28
27 1.2.1 - 27

Comments

Amato Cole
Good
Ok
Bad
6 months, 3 weeks ago

Excellent feature set! Regarding the inappropriate review from Arthur, those not wishing to utilize the features need simply not install them.

Kate Döen
Good
Ok
Bad
1 year ago

Works well, no need to send my data to OpenAI and other surveillance capitalism companies.

Arthur Ursus
Good
Ok
Bad
1 year, 1 month ago

AI integration in NextCloud. Hard pass.