AnythingLLMProduct update

AnythingLLM · v1.19.0

AnythingLLM v1.19.0 can run a built-in local LLM inside Docker using AMD's open-source Lemonade inference server on llama.cpp, so Ollama or LM Studio are no longer required alongside it. The engine picks CUDA, Vulkan or the CPU automatically, runs on amd64 and arm64, and stays off until ENABLE_BUILT_IN_LLM=true is set. Color palettes can tint the whole interface. The release also caps request body size to block unauthenticated embed denial-of-service attacks.

Read the original

Saved . A shortened excerpt from GitHub Releases; the original publisher retains authorship.

Show all