diff --git a/docs/manual/olares/settings/gpu-resource.md b/docs/manual/olares/settings/gpu-resource.md index 857667c27..7d6bdbe5d 100644 --- a/docs/manual/olares/settings/gpu-resource.md +++ b/docs/manual/olares/settings/gpu-resource.md @@ -19,7 +19,7 @@ Currently, only Nvidia GPU is supported. Olares supports three GPU allocation modes. Choosing the right mode helps optimize performance based on your needs. -### Time slicing +### Time Slicing In this mode, the GPU's processing power is shared among multiple applications. @@ -27,14 +27,14 @@ In this mode, the GPU's processing power is shared among multiple applications. * Suitable for General-purpose use and running multiple lightweight applications. -### App exclusive +### App Exclusive In this mode, the entire GPU processing power and memory is dedicated to a single application. * Best for intensive, performance-critical applications like AI-generated imagery or high-performance gaming servers. * Large memory demands may limit availability for other tasks. -### Memory slicing +### Memory Slicing In this mode, GPU memory (VRAM) is partitioned into fixed, dedicated amounts for specific applications. * Ideal for running multiple GPU-intensive applications simultaneously, each with guaranteed VRAM allocation. @@ -44,41 +44,43 @@ In this mode, GPU memory (VRAM) is partitioned into fixed, dedicated amounts for To view your GPU status: -1. Navigate to **Settings > GPU**. The GPU list shows each GPU’s model, associated node, total VRAM, and current GPU mode. +1. Navigate to **Settings** > **GPU**. The GPU list shows each GPU’s model, associated node, total VRAM, and current GPU mode. 2. Click on a specific GPU to visit its details. ::: tip Note -If your Olares only contains one GPU, navigating to the GPU section will take you directly to the GPU details page. If you have multiple GPUs, you will see a list first. +If your Olares only has one GPU, navigating to the GPU section will take you directly to the GPU details page. If you have multiple GPUs, you will see a list first. ::: ## Configure GPU mode On the **GPU details** page, select your desired mode from the **GPU mode** dropdown. Depending on your selected mode, different follow-up options apply. -* **Time slicing**： +* **Time Slicing**： 1. Select this mode from the GPU mode dropdown. - 2. In the **Application pinning** section, click **+Add an application** button to manually pin an application to this specific GPU in a multi-GPU setup. + 2. In the **Pin application** section, click **+Add an application** to manually pin an application to this specific GPU in a multi-GPU setup. + + ![Time slicing](/images/manual/olares/gpu-time-slicing.png#bordered) :::tip Note No manual pinning is required if you only have one GPU in your cluster. ::: -* **App exclusive** +* **App Exclusive** 1. Select this mode from the GPU mode dropdown. 2. In the **Select exclusive app** dropbox, choose your target application. 3. Click **Confirm**. ![App exclusive](/images/manual/olares/gpu-app-exclusive.png#bordered) -* **Memory slicing** - 1. Select this mode from the dropdown. - 2. In the **Allocate VRAM** section, click **Add application**. - 3. Select your target application and assign it a specific amount of VRAM (in GB). - 4. Repeat for other applications and click **Confirm**. - ![VRAM slicing](/images/manual/olares/gpu-memory-slicing.png#bordered) + * **Memory Slicing** + 1. Select this mode from the dropdown. + 2. In the **Allocate VRAM** section, click **Add an application**. + 3. Select your target application and assign it a specific amount of VRAM (in GB). + 4. Repeat for other applications and click **Confirm**. + ![VRAM slicing](/images/manual/olares/gpu-memory-slicing.png#bordered) - ::: tip Note - You can't assign a VRAM that's larger than the total VRAM. - ::: + ::: tip Note + You can't assign a VRAM that's larger than the total VRAM. + ::: ## Learn more - [Monitor GPU usage in Olares](../resources-usage.md) \ No newline at end of file diff --git a/docs/public/images/manual/olares/gpu-app-exclusive.png b/docs/public/images/manual/olares/gpu-app-exclusive.png index 6a47ebc39..be5d44e1d 100644 Binary files a/docs/public/images/manual/olares/gpu-app-exclusive.png and b/docs/public/images/manual/olares/gpu-app-exclusive.png differ diff --git a/docs/public/images/manual/olares/gpu-memory-slicing.png b/docs/public/images/manual/olares/gpu-memory-slicing.png index ba704fd8a..f05c462ee 100644 Binary files a/docs/public/images/manual/olares/gpu-memory-slicing.png and b/docs/public/images/manual/olares/gpu-memory-slicing.png differ diff --git a/docs/public/images/manual/olares/gpu-time-slicing.png b/docs/public/images/manual/olares/gpu-time-slicing.png index a0f8245e6..b2c0c3b67 100644 Binary files a/docs/public/images/manual/olares/gpu-time-slicing.png and b/docs/public/images/manual/olares/gpu-time-slicing.png differ diff --git a/docs/public/images/zh/manual/olares/gpu-app-exclusive.png b/docs/public/images/zh/manual/olares/gpu-app-exclusive.png index 3d43ca1f5..c6b4d3502 100644 Binary files a/docs/public/images/zh/manual/olares/gpu-app-exclusive.png and b/docs/public/images/zh/manual/olares/gpu-app-exclusive.png differ diff --git a/docs/public/images/zh/manual/olares/gpu-memory-slicing.png b/docs/public/images/zh/manual/olares/gpu-memory-slicing.png index 608c19599..d603c6ae3 100644 Binary files a/docs/public/images/zh/manual/olares/gpu-memory-slicing.png and b/docs/public/images/zh/manual/olares/gpu-memory-slicing.png differ diff --git a/docs/public/images/zh/manual/olares/gpu-time-slicing.png b/docs/public/images/zh/manual/olares/gpu-time-slicing.png index b5111e4f1..a9984d660 100644 Binary files a/docs/public/images/zh/manual/olares/gpu-time-slicing.png and b/docs/public/images/zh/manual/olares/gpu-time-slicing.png differ diff --git a/docs/zh/manual/olares/settings/gpu-resource.md b/docs/zh/manual/olares/settings/gpu-resource.md index 7e002ee77..d9b2b7c54 100644 --- a/docs/zh/manual/olares/settings/gpu-resource.md +++ b/docs/zh/manual/olares/settings/gpu-resource.md @@ -63,13 +63,16 @@ Olares 提供三种分配方式，可按场景灵活选择。 1. 在 GPU 模式下拉菜单中选择该模式。 2. 在**选择独占应用**下拉框中选择目标应用。 3. 点击**确认**。 - ![独占](/images/zh/manual/olares/gpu-app-exclusive.png#bordered) -- **显存切片**： + ![独占](/images/zh/manual/olares/gpu-app-exclusive.png#bordered) +- **显存分片**： 1. 在下拉菜单中选择该模式。 2. 在**分配显存**窗口，点击 **+ 添加应用**。 3. 选择目标应用，并指定分配给该应用的显存大小（以 GB 为单位）。 4. 如需为其他应用分配显存，可重复以上操作，然后点击**确认**。 ![显存分片](/images/zh/manual/olares/gpu-memory-slicing.png#bordered) + ::: tip 注意 + 分配的显存必须小于显卡总显存。 + ::: ## 了解更多 - [监控 Olares 中的显卡使用情况](../resources-usage.md) \ No newline at end of file