Coherence update 2022

Coherence update 2022
Name	Coherence update 2022
Date	2022/01/06
DateEnd	2022/01/31
Location	Space
Contact	Melan
Attendees

The upgrade project was successful, a big thank you to everyone who worked hard on this!

What

We are several versions behind on Proxmox on Coherence, as of writing the current version of Proxmox is 7.1-7 while we are still running 5.4-13(!). This means that we can't make any new LXC containers with newer distributions because they are simply not supported by Proxmox 5. Several attempts to upgrade Coherence have been made in the past, but I hope this time we can actually do it! It would also be nice if we could use this as an opportunity to clear old unused VMs and containers off Coherence. Done

Upgrading Proxmox path

A upgrade from 5 to 6 is needed, and from there on we can upgrade from 6 to 7. - [1] - [2] Done \o/

Upgrade stuff (can be done already when backups are possible)

Please make backups first before you upgrade a VM or container

There should be a backup system available on backup-nfs before we start.

Debian containers should be Debian 10 at least before we can upgrade Proxmox, and Ubuntu 18.04 it seems.

Thinking steps required

* Backups - if we mess up, how do we bring things back? - Need at least 4Tb to do this.

• Redundancy - Can we upgrade some other host and migrate? Would this be a good plan going forwards?

- Probably not required - Proxmox upgrade scripts should check containers before upgrades.

• Upgrades - All VkMs/Containers below need to be ticked off

Done

Backup

A system called `notnotapp.lan.nurd.space` has been setup and has 4x 1TB in raid 5 storage, meaning we have 3TB available for backup with redundancy. Although, roughly 1.8TB has been used for the mp3 share and the user data. Which should leave enough for VMs however, it is advised to remove your backup once the VM has been successfully upgraded to leave enough room.

A update of the user directory and mp3 share has finished at 10 January, rsync should be ran from time to time to keep notnotapp in sync with notapp. There is 966GB left free for VM backups.

Restore

Make sure you don't check unprivileged checkbox if you plan to do NFS inside the container!

List of LXCs/VMs

LXCs/VMs in need of OS upgrade

VMID	type	Name	OS	Done	Remarks	Last backup
144	VM	nurdservices.nurdspace.lan	Debian 9	-	Critical - but this is a VM, so not blocking for proxmox upgrade	Feb 24th 2022

LXCs/VMs that are upgraded or are new

Some of these have been done previously

VMID	type	Name	OS	Done	Remarks	Last backup
102	LXC	parts.vm.nurd.space	Debian 10	OK	A partkeepr frontend. Has php7.1 from https://deb.sury.org/ now.	Feb 23th 2022
103	LXC	postgresql.vm.nurd.space	Debian 10	Dennis	New container with Debian 10, will need some work later (newer postgres, auth stuff)	Feb 23th 2022
106	LXC	harkbot	Debian 11	New	r3boot, replacement for NURDbot	No need
108	LXC	gitea.vm.nurd.space	Debian 11	New	Niz	No need
110	LXC	IPFIXer	Debian 11	New	Flok	Feb 24th 2022
133	LXC	egg.vm.nurd.space	Debian 10	-	This is now Debian 10, but is a bit wacky. Might be a good idea to rebuild this one from scratch someday.	Feb 24th 2022
101	LXC	notapp.vm.nurd.space	Debian 10	-	Critical - this is the main container that provides storage mounts to everywhere (egg, mpd). Update this one early.	Feb 24th 2022
125	LXC	ipam.vm.nurd.space	Debian 10	-	Petraea	Feb 24th 2022
140	LXC	nurdbot.vm.nurd.space	Ubuntu 16.04 LTS	Update to Ubuntu 20.04.3 LTS	Critical	Feb 24th 2022
100	LXC	spacesound.vm.nurd.space	Ubuntu 20.04.3 LTS	OK	Used to be VM 105 but now it's LXC 100	Feb 23rd 2022
107	LXC	nurdbotdev.vm.nurd.space	Ubuntu 20.04 LTS	OK		Feb 23rd 2022
109	LXC	asterisk	Debian 10	Previously		Feb 24th 2022
113	LXC	auth.vm.nurd.space / auth.nurd.space	Debian 10	New	Replaces saml.nurd.space - using Keycloak	Feb 24th 2022
114	LXC	irctvserver	Debian 11	New	Flok	Feb 24th 2022
123	VM	jarvis.vm.nurd.space	Hass OS 6.6	-		Feb 24th 2022
124	LXC	sdr.nurd.space	Ubuntu 20.04 LTS	OK		Feb 23rd 2022
128	LXC	revproxy01.nurd.space	Debian 10	Previously		Feb 24th 2022
105	LXC	influx.vm.nurd.space	Debian 10	Previously		Feb 23th 2022
112	VM	portal.nurd.space	Debian 10	OK	CAREFULNEXTTIME: see that the http://pkg.switch.ch/switchaai/debian repo also follows along well!!	Feb 24th 2022

LXCs/VMs that are not running

These can possibly be deleted or archived.

VMID	type	Name	OS	Done	Remarks	Last backup
104	LXC	status.vm.nurd.space	Debian 10	Previously		Feb 23rd 2022
106	VM	jarvis-ng.vm.nurd.space	?	Deleted		Not needed
108	VM	docker.vm.nurd.space	?	Deleted		Not needed
110	LXC	bridger.lan.nurd.space	?	Deleted	Petraea - An old routing box for prototyping different network layers. Could be folded.	Not needed
111	LXC	Flunk	?	-		Feb 23rd 2022
113	LXC	panopticon.vm.nurd.space	?	Deleted	Petraea - An old monitoring setup (zabbix). Could be folded.	Not needed
114	LXC	vinculum.vm.nurd.space	Debian 8	Deleted	Petraea - An old IoT processing system. Could be folded.	Not needed
115	LXC	wopr.vm.nurd.space	?	Deleted	Gaming VM. Noone knows whose it is so fuck it :p Not used since 2015	Not needed
116	LXC	music.nurd.space	?	Deleted		Not needed
117	LXC	snor.vm.nurd.space	?	-		Feb 23rd 2022
118	LXC	gopher	Debian 10	OK		Feb 23rd 2022
119	LXC	gallery.nurd.space	Debian 10	Previously		Feb 23rd 2022
120	LXC	mailng.vm.nurd.space	Debian 9	Deleted		Not needed
121	LXC	mercator.vm.nurd.space	?	-	Petraea	Feb 23rd 2022
122	LXC	saml.nurd.space	CentOS 6.6	stopped	Zarya has replaced this with 113	Feb 23rd 2022
126	LXC	soundfx.dhcp.nurd.space		stopped		Feb 23rd 2022
127	LXC	mail.vm.nurd.space	?	-		Feb 23rd 2022
131		oldinflux.vm.nurd.space		Deleted	New one is 105	Not needed
135	LXC	lightsjam.vm.nurd.space	?	Deleted	backup has been transferred to Petraeas homedir	Not needed
137	LXC	wol-server.vm.nurd.space	Debian 7	Deleted	Petraea - Some central means of coordinating WoL handling with an API. Could be folded.	Not needed
141	LXC	pretender.dhcp.nurd.space	?	-	Petraea	Feb 23rd 2022
143	LXC	neural.vm.nurd.space	?	Deleted	Petraea - an old artistic neural network processor. Could be folded.	Not needed