gpu | |
---|---|
Owner | Space |
Status | Infra |
Hostname | gpu.lan.nurd.space |
Tool | Yes |
Tool category | Infrastructure |
naaimachine.jpg {{{InventoryOwner}}}Property "Tool Owner" (as page type) with input value "{{{InventoryOwner}}}" contains invalid characters or is incomplete and therefore can cause unexpected results during a query or annotation process. {{{Location}}}Property "Tool Location" (as page type) with input value "{{{Location}}}" contains invalid characters or is incomplete and therefore can cause unexpected results during a query or annotation process.
(Na)AI machine, was a dedicated system to be used for AI at the space located inside the rack near the door of zaal 1. It's recently been replaced by a GPU inside Erratic that's available 24/7
Address: gpu.vm.nurd.space (10.208.1.20)
The system has the following GPUs available:
- NVIDIA GeForce RTX 3080 (10GB vram)
The system is running Archlinux
, with the latest kernel and Nvidia drivers as well as Cuda 12
.
AI models
LLM (Large Language Model)
One of the AI machine’s primary usages is the LLM. It’s integrated with Nurdbot. For this we use Ollama.