From 875796923afb66809b431a668d9196dcddb5cc34 Mon Sep 17 00:00:00 2001 From: Jean-Yves <7360784+docjyJ@users.noreply.github.com> Date: Wed, 2 Jul 2025 13:53:26 +0200 Subject: [PATCH] Add url Signed-off-by: Jean-Yves <7360784+docjyJ@users.noreply.github.com> --- community-containers/local-ai-vulkan/readme.md | 5 ++++- 1 file changed, 4 insertions(+), 1 deletion(-) diff --git a/community-containers/local-ai-vulkan/readme.md b/community-containers/local-ai-vulkan/readme.md index 9e3e9a3b..4a926200 100644 --- a/community-containers/local-ai-vulkan/readme.md +++ b/community-containers/local-ai-vulkan/readme.md @@ -2,13 +2,16 @@ > [!WARNING] > ARM devices are not supported by this container. It is only for x86_64 devices. (See: https://github.com/mudler/LocalAI/issues/5778) +> [!CAUTION] +> If the configuration is not correct, it should still work but it will use the CPU only and will not benefit from hardware acceleration. + ## Local AI This container bundles Local AI and auto-configures it for you. ### Notes - Make sure vulkan is enabled in the AIO settings. Run `vulkaninfo` in the terminal to check if it is enabled. - Make sure to have enough storage space available. This container alone needs ~7GB storage. -- Make sure to have enabled DRI device by adding `--env NEXTCLOUD_ENABLE_DRI_DEVICE=true` +- Make sure to have enabled DRI device by adding `--env NEXTCLOUD_ENABLE_DRI_DEVICE=true`, see https://github.com/nextcloud/all-in-one?tab=readme-ov-file#with-open-source-drivers-mesa-for-amd-intel-and-new-drivers-nouveau-for-nvidia. - To make it work, you first need to browse `https://your-nc-domain.com/settings/admin/ai` and enable or disable specific features for your models in the openAI settings. Afterwards using the Nextcloud Assistant should work. - To access the Local AI web interface, you need to set reverse proxy rules for it. ```Cadyfile