Coherence update 2022: Difference between revisions

From NURDspace
No edit summary
 
(25 intermediate revisions by 2 users not shown)
Line 6: Line 6:
|Contact=Melan
|Contact=Melan
}}
}}
* Date still needs to be determined.
 
 
'''The upgrade project was successful, a big thank you to everyone who worked hard on this! '''


= What =
= What =
We are several versions behind on Proxmox on [[Coherence]], as of writing the current version of Proxmox is 7.1-7 while we are still running 5.4-13(!). This means that we can't make any new LXC containers with newer distributions because they are simply not supported by Proxmox 5. Several attempts to upgrade Coherence have been made in the past, but I hope this time we can actually do it! It would also be nice if we could use this as an opportunity to clear old unused VMs and containers off Coherence.  
<s>We are several versions behind on Proxmox on [[Coherence]], as of writing the current version of Proxmox is 7.1-7 while we are still running 5.4-13(!). This means that we can't make any new LXC containers with newer distributions because they are simply not supported by Proxmox 5. Several attempts to upgrade Coherence have been made in the past, but I hope this time we can actually do it! It would also be nice if we could use this as an opportunity to clear old unused VMs and containers off Coherence.</s>
Done


== Upgrading Proxmox path ==
== Upgrading Proxmox path ==
A upgrade from 5 to 6 is needed, and from there on we can upgrade from 6 to 7.
<s>A upgrade from 5 to 6 is needed, and from there on we can upgrade from 6 to 7.
- [https://pve.proxmox.com/wiki/Upgrade_from_5.x_to_6.0]
- [https://pve.proxmox.com/wiki/Upgrade_from_5.x_to_6.0]
- [https://pve.proxmox.com/wiki/Upgrade_from_6.x_to_7.0]
- [https://pve.proxmox.com/wiki/Upgrade_from_6.x_to_7.0]</s>
 
Done \o/
== Upgrade stuff (can be done already when backups are possible) ==
== Upgrade stuff (can be done already when backups are possible) ==
<b>Please make backups first before you upgrade a VM or container</b>
<b>Please make backups first before you upgrade a VM or container</b>
Line 26: Line 29:
<del>* Backups - if we mess up, how do we bring things back?
<del>* Backups - if we mess up, how do we bring things back?
- Need at least 4Tb to do this.</del>
- Need at least 4Tb to do this.</del>
 
<s>
* Redundancy - Can we upgrade some other host and migrate? Would this be a good plan going forwards?
* Redundancy - Can we upgrade some other host and migrate? Would this be a good plan going forwards?
- Probably not required - Proxmox upgrade scripts should check containers before upgrades.
- Probably not required - Proxmox upgrade scripts should check containers before upgrades.
* Upgrades - All VkMs/Containers below need to be ticked off
* Upgrades - All VkMs/Containers below need to be ticked off</s>
Done
   
   
== Backup ==
== Backup ==
Line 60: Line 64:
| -
| -
| Critical - but this is a VM, so not blocking for proxmox upgrade
| Critical - but this is a VM, so not blocking for proxmox upgrade
|
| Feb 24th 2022
|}
|}


Line 105: Line 109:
| LXC
| LXC
| gitea.vm.nurd.space
| gitea.vm.nurd.space
| Debian 10
| Debian 11
| New
| New
| Niz
| Niz
| Feb 23th 2022
| No need
|-
|-
| 110
| 110
Line 116: Line 120:
| New
| New
| Flok
| Flok
|
| Feb 24th 2022
|-
|-
| 133
| 133
Line 124: Line 128:
| -
| -
| This is now Debian 10, but is a bit wacky. Might be a good idea to rebuild this one from scratch someday.
| This is now Debian 10, but is a bit wacky. Might be a good idea to rebuild this one from scratch someday.
|
| Feb 24th 2022
|-
|-
| 101
| 101
Line 132: Line 136:
| -
| -
| Critical - this is the main container that provides storage mounts to everywhere (egg, mpd). Update this one early.
| Critical - this is the main container that provides storage mounts to everywhere (egg, mpd). Update this one early.
|
| Feb 24th 2022
|-
|-
| 125
| 125
Line 140: Line 144:
| -
| -
| Petraea
| Petraea
|
| Feb 24th 2022
|-
|-
| 140
| 140
Line 148: Line 152:
| Update to Ubuntu 20.04.3 LTS
| Update to Ubuntu 20.04.3 LTS
| Critical
| Critical
|
| Feb 24th 2022
|-
|-
| 100
| 100
Line 172: Line 176:
| Previously
| Previously
|
|
|
| Feb 24th 2022
|-
|-
| 113
| 113
Line 180: Line 184:
| New
| New
| Replaces saml.nurd.space - using Keycloak
| Replaces saml.nurd.space - using Keycloak
|
| Feb 24th 2022
|-
| 114
| LXC
| irctvserver
| Debian 11
| New
| Flok
| Feb 24th 2022
|-
|-
| 123
| 123
Line 188: Line 200:
| -
| -
|
|
|
| Feb 24th 2022
|-
|-
| 124
| 124
Line 196: Line 208:
| OK
| OK
|
|
|
| Feb 23rd 2022
|-
|-
| 128
| 128
Line 204: Line 216:
| Previously
| Previously
|
|
|
| Feb 24th 2022
|-
|-
| 105
| 105
Line 212: Line 224:
| Previously
| Previously
|
|
|
| Feb 23th 2022
|-
|-
| 112
| 112
Line 220: Line 232:
| OK
| OK
| CAREFULNEXTTIME: see that the http://pkg.switch.ch/switchaai/debian repo also follows along well!!
| CAREFULNEXTTIME: see that the http://pkg.switch.ch/switchaai/debian repo also follows along well!!
|
| Feb 24th 2022
|}
|}


Line 316: Line 328:
| -
| -
|
|
|
| Feb 23rd 2022
|-
|-
| 118
| 118
Line 324: Line 336:
| OK
| OK
|
|
|
| Feb 23rd 2022
|-
|-
| 119
| 119
Line 348: Line 360:
| -
| -
| Petraea
| Petraea
| Not needed
| Feb 23rd 2022
|-
|-
| 122
| 122
Line 356: Line 368:
| stopped
| stopped
| Zarya has replaced this with 113
| Zarya has replaced this with 113
|
| Feb 23rd 2022
|-
|-
| 126
| 126
Line 364: Line 376:
| stopped
| stopped
|
|
|
| Feb 23rd 2022
|-
|-
| 127
| 127
Line 372: Line 384:
| -
| -
|
|
|
| Feb 23rd 2022
|-
|-
| 131
| 131
Line 378: Line 390:
| oldinflux.vm.nurd.space
| oldinflux.vm.nurd.space
|  
|  
| stopped
| Deleted
| New one is 105
| New one is 105
|
| Not needed
|-
|-
| 135
| 135
Line 404: Line 416:
| -
| -
| Petraea
| Petraea
|
| Feb 23rd 2022
|-
|-
| 143
| 143

Latest revision as of 12:47, 8 March 2022

Coherence update 2022
Name Coherence update 2022
Date 2022/01/06
DateEnd 2022/01/31
Location Space
Contact Melan
Attendees


The upgrade project was successful, a big thank you to everyone who worked hard on this!

What

We are several versions behind on Proxmox on Coherence, as of writing the current version of Proxmox is 7.1-7 while we are still running 5.4-13(!). This means that we can't make any new LXC containers with newer distributions because they are simply not supported by Proxmox 5. Several attempts to upgrade Coherence have been made in the past, but I hope this time we can actually do it! It would also be nice if we could use this as an opportunity to clear old unused VMs and containers off Coherence. Done

Upgrading Proxmox path

A upgrade from 5 to 6 is needed, and from there on we can upgrade from 6 to 7. - [1] - [2] Done \o/

Upgrade stuff (can be done already when backups are possible)

Please make backups first before you upgrade a VM or container

There should be a backup system available on backup-nfs before we start.

Debian containers should be Debian 10 at least before we can upgrade Proxmox, and Ubuntu 18.04 it seems.

Thinking steps required

* Backups - if we mess up, how do we bring things back? - Need at least 4Tb to do this.

  • Redundancy - Can we upgrade some other host and migrate? Would this be a good plan going forwards?

- Probably not required - Proxmox upgrade scripts should check containers before upgrades.

  • Upgrades - All VkMs/Containers below need to be ticked off

Done

Backup

A system called `notnotapp.lan.nurd.space` has been setup and has 4x 1TB in raid 5 storage, meaning we have 3TB available for backup with redundancy. Although, roughly 1.8TB has been used for the mp3 share and the user data. Which should leave enough for VMs however, it is advised to remove your backup once the VM has been successfully upgraded to leave enough room.

A update of the user directory and mp3 share has finished at 10 January, rsync should be ran from time to time to keep notnotapp in sync with notapp. There is 966GB left free for VM backups.

Restore

Make sure you don't check unprivileged checkbox if you plan to do NFS inside the container! Screen-2022-01-30-12-30-01.png

List of LXCs/VMs

LXCs/VMs in need of OS upgrade

VMID type Name OS Done Remarks Last backup
144 VM nurdservices.nurdspace.lan Debian 9 - Critical - but this is a VM, so not blocking for proxmox upgrade Feb 24th 2022

LXCs/VMs that are upgraded or are new

Some of these have been done previously

VMID type Name OS Done Remarks Last backup
102 LXC parts.vm.nurd.space Debian 10 OK A partkeepr frontend. Has php7.1 from https://deb.sury.org/ now. Feb 23th 2022
103 LXC postgresql.vm.nurd.space Debian 10 Dennis New container with Debian 10, will need some work later (newer postgres, auth stuff) Feb 23th 2022
106 LXC harkbot Debian 11 New r3boot, replacement for NURDbot No need
108 LXC gitea.vm.nurd.space Debian 11 New Niz No need
110 LXC IPFIXer Debian 11 New Flok Feb 24th 2022
133 LXC egg.vm.nurd.space Debian 10 - This is now Debian 10, but is a bit wacky. Might be a good idea to rebuild this one from scratch someday. Feb 24th 2022
101 LXC notapp.vm.nurd.space Debian 10 - Critical - this is the main container that provides storage mounts to everywhere (egg, mpd). Update this one early. Feb 24th 2022
125 LXC ipam.vm.nurd.space Debian 10 - Petraea Feb 24th 2022
140 LXC nurdbot.vm.nurd.space Ubuntu 16.04 LTS Update to Ubuntu 20.04.3 LTS Critical Feb 24th 2022
100 LXC spacesound.vm.nurd.space Ubuntu 20.04.3 LTS OK Used to be VM 105 but now it's LXC 100 Feb 23rd 2022
107 LXC nurdbotdev.vm.nurd.space Ubuntu 20.04 LTS OK Feb 23rd 2022
109 LXC asterisk Debian 10 Previously Feb 24th 2022
113 LXC auth.vm.nurd.space / auth.nurd.space Debian 10 New Replaces saml.nurd.space - using Keycloak Feb 24th 2022
114 LXC irctvserver Debian 11 New Flok Feb 24th 2022
123 VM jarvis.vm.nurd.space Hass OS 6.6 - Feb 24th 2022
124 LXC sdr.nurd.space Ubuntu 20.04 LTS OK Feb 23rd 2022
128 LXC revproxy01.nurd.space Debian 10 Previously Feb 24th 2022
105 LXC influx.vm.nurd.space Debian 10 Previously Feb 23th 2022
112 VM portal.nurd.space Debian 10 OK CAREFULNEXTTIME: see that the http://pkg.switch.ch/switchaai/debian repo also follows along well!! Feb 24th 2022

LXCs/VMs that are not running

These can possibly be deleted or archived.

VMID type Name OS Done Remarks Last backup
104 LXC status.vm.nurd.space Debian 10 Previously Feb 23rd 2022
106 VM jarvis-ng.vm.nurd.space ? Deleted Not needed
108 VM docker.vm.nurd.space ? Deleted Not needed
110 LXC bridger.lan.nurd.space ? Deleted Petraea - An old routing box for prototyping different network layers. Could be folded. Not needed
111 LXC Flunk ? - Feb 23rd 2022
113 LXC panopticon.vm.nurd.space ? Deleted Petraea - An old monitoring setup (zabbix). Could be folded. Not needed
114 LXC vinculum.vm.nurd.space Debian 8 Deleted Petraea - An old IoT processing system. Could be folded. Not needed
115 LXC wopr.vm.nurd.space ? Deleted Gaming VM. Noone knows whose it is so fuck it :p Not used since 2015 Not needed
116 LXC music.nurd.space ? Deleted Not needed
117 LXC snor.vm.nurd.space ? - Feb 23rd 2022
118 LXC gopher Debian 10 OK Feb 23rd 2022
119 LXC gallery.nurd.space Debian 10 Previously Feb 23rd 2022
120 LXC mailng.vm.nurd.space Debian 9 Deleted Not needed
121 LXC mercator.vm.nurd.space ? - Petraea Feb 23rd 2022
122 LXC saml.nurd.space CentOS 6.6 stopped Zarya has replaced this with 113 Feb 23rd 2022
126 LXC soundfx.dhcp.nurd.space stopped Feb 23rd 2022
127 LXC mail.vm.nurd.space ? - Feb 23rd 2022
131 oldinflux.vm.nurd.space Deleted New one is 105 Not needed
135 LXC lightsjam.vm.nurd.space ? Deleted backup has been transferred to Petraeas homedir Not needed
137 LXC wol-server.vm.nurd.space Debian 7 Deleted Petraea - Some central means of coordinating WoL handling with an API. Could be folded. Not needed
141 LXC pretender.dhcp.nurd.space ? - Petraea Feb 23rd 2022
143 LXC neural.vm.nurd.space ? Deleted Petraea - an old artistic neural network processor. Could be folded. Not needed
Retrieved from "https://nurdspace.nl/index.php?title=Coherence_update_2022&oldid=11172"
Last modified
This page was last edited on 8 March 2022, at 12:47.