AWS - EC2 Instance

Before using the Lumeo Gateway Installer on your Nvidia GPU enabled AWS EC2 machines, follow these steps :

In the EC2 console, configure and launch machine instance with the following configuration:

Ubuntu 20.04 or 22.04 OS (x86)
At least 50 GB of Disk space
Instance type must have an Nvidia GPU (XXdn.XXXXX are Nvidia GPUs)
- https://docs.aws.amazon.com/dlami/latest/devguide/gpu.html
- G4dn.xlarge is a single T4 which is suitable and recommended for most applications

After launching the virtual, log in, execute the following commands to configure the machine instance and install Lumeo Gateway software:

sudo apt update

Install nvidia drivers

sudo apt install nvidia-compute-utils-525 nvidia-dkms-525 nvidia-driver-525 nvidia-kernel-common-525 nvidia-kernel-source-525 nvidia-modprobe nvidia-prime nvidia-settings nvidia-utils-525

Verify the nvidia drivers are properly installed, execute the command:

nvidia-smi

To see output like this

ubuntu@ip-172-31-5-37:~$ nvidia-smi
Tue Apr 11 02:12:18 2023       
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 525.105.17   Driver Version: 525.105.17   CUDA Version: 12.0     |
|-------------------------------+----------------------+----------------------+
| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|                               |                      |               MIG M. |
|===============================+======================+======================|
|   0  Tesla T4            Off  | 00000000:00:1E.0 Off |                    0 |
| N/A   55C    P0    30W /  70W |      2MiB / 15360MiB |      4%      Default |
|                               |                      |                  N/A |
+-------------------------------+----------------------+----------------------+
                                                                               
+-----------------------------------------------------------------------------+
| Processes:                                                                  |
|  GPU   GI   CI        PID   Type   Process name                  GPU Memory |
|        ID   ID                                                   Usage      |
|=============================================================================|
|  No running processes found                                                 |
+-----------------------------------------------------------------------------+

If you receive an error, reboot the instance as it maybe required for different instance types and the drivers to load properly.

Finally execute the installer interactively and selecting the default option which is container.

bash <(wget -qO- https://link.lumeo.com/setup)