4.2 KiB
| outline | description | ||
|---|---|---|---|
|
Install Olares on NVIDIA DGX Spark using the command-line installation script for quick deployment. |
Install Olares on DGX Spark via script
This guide explains how to install Olares on NVIDIA DGX Spark using the command-line installation script.
System requirements
- DGX Spark: Ensure your device has completed the initial setup, with a user account created and network configured.
- Storage: At least 150 GB of available SSD storage on DGX Spark.
- Access method: You need access to the terminal on DGX Spark, either via:
- Direct access: Connect a monitor, keyboard, and mouse to DGX Spark.
- Remote access: Connect via SSH from another computer on the same network.
- Network: An Ethernet cable connecting DGX Spark to your router (recommended for stable connection).
Prepare DGX Spark
Before installing Olares, you need to remove the pre-installed container runtime on DGX Spark.
Olares installs and manages its own containerd runtime. If the system already has Docker or containerd installed, it will cause conflicts that prevent Olares from functioning properly.
:::warning Impact of removing container runtime The following steps will:
- Uninstall Docker packages
- Stop and disable the existing containerd service
- Clear existing network rules :::
On DGX Spark, open a terminal and run:
sudo apt remove docker*
sudo systemctl disable --now containerd
sudo rm -f /usr/bin/containerd
sudo nft flush ruleset
Install Olares
- In the same terminal, run the following command:
Activate Olares
Use the Wizard URL and initial one-time password to activate. This process connects the Olares device with your Olares ID using LarePass.
-
Enter the Wizard URL in your browser. You will be directed to the welcome page. Press any key to continue.
-
Enter the one-time password and click Continue.
-
Select the system language.
-
Select a reverse proxy node that is geographically closest to your location. You can adjust this later on the Change reverse proxy page.
-
Activate Olares using LarePass app.
:::warning Same network required for admin users To avoid activation failures, ensure that both your phone and the Olares device are connected to the same network. ::: a. Open LarePass app, and tap Scan QR code to scan the QR code on the Wizard page and complete the activation.
b. Reset the login password for Olares by following the on-screen instructions on LarePass.
After setup is complete, the LarePass app returns to the home screen, and the Wizard redirects you to the Olares login page.
Configure GPU memory for AI apps
DGX Spark features a unified memory architecture where the CPU and GPU share 128 GB of LPDDR5x memory. Unlike traditional GPUs with dedicated VRAM, DGX Spark does not distinguish between system memory and GPU memory.
On DGX Spark, Olares uses Memory slicing mode by default for GPU resource management. When you install an AI application, Olares automatically allocates the minimum required memory to ensure the app can start and run properly.
If needed, you can manually adjust the memory allocation for each AI application:
-
Open Settings from Olares, and then navigate to GPU.
-
In the Allocate VRAM section, find the target app.
{width=70%} -
Click edit_square next to the VRAM value.
-
In the Edit VRAM allocation dialog, enter the desired VRAM amount in GB and click Confirm.