Naaimachine: Difference between revisions
(Created page with "{{Inventory |Name=gpu |Owner=Space |Status=Infra |Hostname=gpu.lan.nurd.space |Picture=naaimachine.jpg |Tool=Yes |Category=Infrastructure }} Naaimachine (or gpu for short) is a dedicated machine for AI projects. The machine contains 3 GPUs that can be used. By default the system runs Stable-Diffusion on one GPU, and an LLM on the other GPU. Nvidia Docker is available. == Addresses == gpu.lan.nurd.space 10.208.1.20") |
No edit summary |
||
| (One intermediate revision by the same user not shown) | |||
| Line 8: | Line 8: | ||
|Category=Infrastructure | |Category=Infrastructure | ||
}} | }} | ||
(Na)AI machine, was a dedicated system to be used for AI at the space located inside the rack near the door of zaal 1. | |||
It's recently been replaced by a GPU inside Erratic that's available 24/7 | |||
Address: gpu.vm.nurd.space (10.208.1.20) | |||
== | The system has the following GPUs available: | ||
- NVIDIA GeForce RTX 3080 (10GB vram) | |||
The system is running <code>Archlinux</code>, with the latest kernel and Nvidia drivers as well as <code>Cuda 12</code>. | |||
<span id="ai-models"></span> | |||
= AI models = | |||
<span id="llm-large-language-model"></span> | |||
=== LLM (Large Language Model) === | |||
One of the AI machine’s primary usages is the LLM. It’s integrated with Nurdbot. For this we use Ollama. | |||
Latest revision as of 17:00, 17 January 2025
| gpu | |
|---|---|
| Owner | Space |
| Status | Infra |
| Hostname | gpu.lan.nurd.space |
| Tool | Yes |
| Tool category | Infrastructure |
naaimachine.jpg {{{InventoryOwner}}}Property "Tool Owner" (as page type) with input value "{{{InventoryOwner}}}" contains invalid characters or is incomplete and therefore can cause unexpected results during a query or annotation process. {{{Location}}}Property "Tool Location" (as page type) with input value "{{{Location}}}" contains invalid characters or is incomplete and therefore can cause unexpected results during a query or annotation process.
(Na)AI machine, was a dedicated system to be used for AI at the space located inside the rack near the door of zaal 1. It's recently been replaced by a GPU inside Erratic that's available 24/7
Address: gpu.vm.nurd.space (10.208.1.20)
The system has the following GPUs available:
- NVIDIA GeForce RTX 3080 (10GB vram)
The system is running Archlinux, with the latest kernel and Nvidia drivers as well as Cuda 12.
AI models
LLM (Large Language Model)
One of the AI machine’s primary usages is the LLM. It’s integrated with Nurdbot. For this we use Ollama.