docs: update screenshots for GPU management (#1641)
|
|
@ -19,7 +19,7 @@ Currently, only Nvidia GPU is supported.
|
|||
|
||||
Olares supports three GPU allocation modes. Choosing the right mode helps optimize performance based on your needs.
|
||||
|
||||
### Time slicing
|
||||
### Time Slicing
|
||||
|
||||
In this mode, the GPU's processing power is shared among multiple applications.
|
||||
|
||||
|
|
@ -27,14 +27,14 @@ In this mode, the GPU's processing power is shared among multiple applications.
|
|||
|
||||
* Suitable for General-purpose use and running multiple lightweight applications.
|
||||
|
||||
### App exclusive
|
||||
### App Exclusive
|
||||
|
||||
In this mode, the entire GPU processing power and memory is dedicated to a single application.
|
||||
|
||||
* Best for intensive, performance-critical applications like AI-generated imagery or high-performance gaming servers.
|
||||
* Large memory demands may limit availability for other tasks.
|
||||
|
||||
### Memory slicing
|
||||
### Memory Slicing
|
||||
In this mode, GPU memory (VRAM) is partitioned into fixed, dedicated amounts for specific applications.
|
||||
|
||||
* Ideal for running multiple GPU-intensive applications simultaneously, each with guaranteed VRAM allocation.
|
||||
|
|
@ -44,41 +44,43 @@ In this mode, GPU memory (VRAM) is partitioned into fixed, dedicated amounts for
|
|||
|
||||
To view your GPU status:
|
||||
|
||||
1. Navigate to **Settings > GPU**. The GPU list shows each GPU’s model, associated node, total VRAM, and current GPU mode.
|
||||
1. Navigate to **Settings** > **GPU**. The GPU list shows each GPU’s model, associated node, total VRAM, and current GPU mode.
|
||||
2. Click on a specific GPU to visit its details.
|
||||
|
||||
::: tip Note
|
||||
If your Olares only contains one GPU, navigating to the GPU section will take you directly to the GPU details page. If you have multiple GPUs, you will see a list first.
|
||||
If your Olares only has one GPU, navigating to the GPU section will take you directly to the GPU details page. If you have multiple GPUs, you will see a list first.
|
||||
:::
|
||||
|
||||
## Configure GPU mode
|
||||
|
||||
On the **GPU details** page, select your desired mode from the **GPU mode** dropdown. Depending on your selected mode, different follow-up options apply.
|
||||
|
||||
* **Time slicing**:
|
||||
* **Time Slicing**:
|
||||
1. Select this mode from the GPU mode dropdown.
|
||||
2. In the **Application pinning** section, click **+Add an application** button to manually pin an application to this specific GPU in a multi-GPU setup.
|
||||
2. In the **Pin application** section, click **+Add an application** to manually pin an application to this specific GPU in a multi-GPU setup.
|
||||
|
||||

|
||||
|
||||
:::tip Note
|
||||
No manual pinning is required if you only have one GPU in your cluster.
|
||||
:::
|
||||
|
||||
* **App exclusive**
|
||||
* **App Exclusive**
|
||||
1. Select this mode from the GPU mode dropdown.
|
||||
2. In the **Select exclusive app** dropbox, choose your target application.
|
||||
3. Click **Confirm**.
|
||||

|
||||
|
||||
* **Memory slicing**
|
||||
1. Select this mode from the dropdown.
|
||||
2. In the **Allocate VRAM** section, click **Add application**.
|
||||
3. Select your target application and assign it a specific amount of VRAM (in GB).
|
||||
4. Repeat for other applications and click **Confirm**.
|
||||

|
||||
* **Memory Slicing**
|
||||
1. Select this mode from the dropdown.
|
||||
2. In the **Allocate VRAM** section, click **Add an application**.
|
||||
3. Select your target application and assign it a specific amount of VRAM (in GB).
|
||||
4. Repeat for other applications and click **Confirm**.
|
||||

|
||||
|
||||
::: tip Note
|
||||
You can't assign a VRAM that's larger than the total VRAM.
|
||||
:::
|
||||
::: tip Note
|
||||
You can't assign a VRAM that's larger than the total VRAM.
|
||||
:::
|
||||
|
||||
## Learn more
|
||||
- [Monitor GPU usage in Olares](../resources-usage.md)
|
||||
|
Before Width: | Height: | Size: 7.7 KiB After Width: | Height: | Size: 22 KiB |
|
Before Width: | Height: | Size: 31 KiB After Width: | Height: | Size: 24 KiB |
|
Before Width: | Height: | Size: 8.2 KiB After Width: | Height: | Size: 23 KiB |
|
Before Width: | Height: | Size: 7.1 KiB After Width: | Height: | Size: 24 KiB |
|
Before Width: | Height: | Size: 23 KiB After Width: | Height: | Size: 18 KiB |
|
Before Width: | Height: | Size: 22 KiB After Width: | Height: | Size: 22 KiB |
|
|
@ -63,13 +63,16 @@ Olares 提供三种分配方式,可按场景灵活选择。
|
|||
1. 在 GPU 模式下拉菜单中选择该模式。
|
||||
2. 在**选择独占应用**下拉框中选择目标应用。
|
||||
3. 点击**确认**。
|
||||

|
||||
- **显存切片**:
|
||||

|
||||
- **显存分片**:
|
||||
1. 在下拉菜单中选择该模式。
|
||||
2. 在**分配显存**窗口,点击 **+ 添加应用**。
|
||||
3. 选择目标应用,并指定分配给该应用的显存大小(以 GB 为单位)。
|
||||
4. 如需为其他应用分配显存,可重复以上操作,然后点击**确认**。
|
||||

|
||||
::: tip 注意
|
||||
分配的显存必须小于显卡总显存。
|
||||
:::
|
||||
|
||||
## 了解更多
|
||||
- [监控 Olares 中的显卡使用情况](../resources-usage.md)
|
||||