Coherence update 2022: Difference between revisions

From NURDspace
No edit summary
 
(74 intermediate revisions by 6 users not shown)
Line 6: Line 6:
|Contact=Melan
|Contact=Melan
}}
}}
* Date still needs to be determined.
 
 
'''The upgrade project was successful, a big thank you to everyone who worked hard on this! '''


= What =
= What =
We are several versions behind on Proxmox on [[Coherence]], as of writing the current version of Proxmox is 7.1-7 while we are still running 5.4-13(!). This means that we can't make any new LXC containers with newer distributions because they are simply not supported by Proxmox 5. Several attempts to upgrade Coherence have been made in the past, but I hope this time we can actually do it! It would also be nice if we could use this as an opportunity to clear old unused VMs and containers off Coherence.  
<s>We are several versions behind on Proxmox on [[Coherence]], as of writing the current version of Proxmox is 7.1-7 while we are still running 5.4-13(!). This means that we can't make any new LXC containers with newer distributions because they are simply not supported by Proxmox 5. Several attempts to upgrade Coherence have been made in the past, but I hope this time we can actually do it! It would also be nice if we could use this as an opportunity to clear old unused VMs and containers off Coherence.</s>
Done


== Upgrading Proxmox path ==
== Upgrading Proxmox path ==
A upgrade from 5 to 6 is needed, and from there on we can upgrade from 6 to 7.
<s>A upgrade from 5 to 6 is needed, and from there on we can upgrade from 6 to 7.
- [https://pve.proxmox.com/wiki/Upgrade_from_5.x_to_6.0]
- [https://pve.proxmox.com/wiki/Upgrade_from_5.x_to_6.0]
- [https://pve.proxmox.com/wiki/Upgrade_from_6.x_to_7.0]
- [https://pve.proxmox.com/wiki/Upgrade_from_6.x_to_7.0]</s>
 
Done \o/
== Upgrade stuff (can be done already when backups are possible) ==
== Upgrade stuff (can be done already when backups are possible) ==
<b>Please make backups first before you upgrade a VM or container</b>
<b>Please make backups first before you upgrade a VM or container</b>
Line 26: Line 29:
<del>* Backups - if we mess up, how do we bring things back?
<del>* Backups - if we mess up, how do we bring things back?
- Need at least 4Tb to do this.</del>
- Need at least 4Tb to do this.</del>
 
<s>
* Redundancy - Can we upgrade some other host and migrate? Would this be a good plan going forwards?
* Redundancy - Can we upgrade some other host and migrate? Would this be a good plan going forwards?
- Probably not required - Proxmox upgrade scripts should check containers before upgrades.
- Probably not required - Proxmox upgrade scripts should check containers before upgrades.
* Upgrades - All VkMs/Containers below need to be ticked off
* Upgrades - All VkMs/Containers below need to be ticked off</s>
Done
   
   
== Backup ==
== Backup ==
A system called `notnotapp` has been setup and has 4x 1TB in raid 5 storage, meaning we have 3TB available for backup with redundancy. Although, roughly 1.8TB has been used for the mp3 share and the user data. Which should leave enough for VMs however, it is advised to remove your backup once the VM has been successfully upgraded to leave enough room.
A system called `notnotapp.lan.nurd.space` has been setup and has 4x 1TB in raid 5 storage, meaning we have 3TB available for backup with redundancy. Although, roughly 1.8TB has been used for the mp3 share and the user data. Which should leave enough for VMs however, it is advised to remove your backup once the VM has been successfully upgraded to leave enough room.


A update of the user directory and mp3 share has finished at 10 January, rsync should be ran from time to time to keep notnotapp in sync with notapp. There is 966GB left free for VM backups.
A update of the user directory and mp3 share has finished at 10 January, rsync should be ran from time to time to keep notnotapp in sync with notapp. There is 966GB left free for VM backups.
== Restore ==
Make sure you don't check unprivileged checkbox if you plan to do NFS inside the container!
[[File:screen-2022-01-30-12-30-01.png|400px]]


== List of LXCs/VMs ==
== List of LXCs/VMs ==
Line 47: Line 55:
!width="16%"| Done
!width="16%"| Done
!width="16%"| Remarks
!width="16%"| Remarks
!width="16%"| Last backup
|-
|-
| 100
| 144
| LXC
| VM
| rollout.vm.nurd.space
| nurdservices.nurdspace.lan
| Debian 9
| Debian 9
| Deleted
| -
| Petraea - a junky attempt at trying to come up with a common deployment standard for Nurdspace, and some mechanism of applying security standards. Could be folded.
| Critical - but this is a VM, so not blocking for proxmox upgrade
|-
| Feb 24th 2022
| 101
|}
| LXC
 
| notapp.vm.nurd.space
<span id="lxcsvms-that-are-upgraded"></span>
| Debian 9
 
| Upgraded to 10!
=== LXCs/VMs that are upgraded or are new ===
| Critical - this is the main container that provides storage mounts to everywhere (egg, mpd). Update this one early.
 
Some of these have been done previously
 
{| class="wikitable sortable"
! VMID
! type
! Name
! OS
! Done
! Remarks
! Last backup
|-
|-
| 102
| 102
| LXC
| LXC
| parts.vm.nurd.space
| parts.vm.nurd.space
| Debian 9
| Debian 10
|  
| OK
| A partkeepr frontend. Needs older php, 7.1 at max
| A partkeepr frontend. Has php7.1 from https://deb.sury.org/ now.
| Feb 23th 2022
|-
|-
| 103
| 103
| LXC
| LXC
| postgresql.vm.nurd.space
| postgresql.vm.nurd.space
| Debian 9
| Debian 10
| -
| Dennis
| The_Niz will try to get partkeepr db running on newly installed container
| New container with Debian 10, will need some work later (newer postgres, auth stuff)
| Feb 23th 2022
|-
| 106
| LXC
| harkbot
| Debian 11
| New
| r3boot, replacement for NURDbot
| No need
|-
| 108
| LXC
| gitea.vm.nurd.space
| Debian 11
| New
| Niz
| No need
|-
|-
| 112
| 110
| VM
| LXC
| portal.nurd.space
| IPFIXer
| Debian 8
| Debian 11
| -
| New
| Zarya
| Flok
| Feb 24th 2022
|-
|-
| 122
| 133
| LXC
| LXC
| saml.nurd.space
| egg.vm.nurd.space
| CentOS 6.6
| Debian 10
| -
| -
| Zarya
| This is now Debian 10, but is a bit wacky. Might be a good idea to rebuild this one from scratch someday.
| Feb 24th 2022
|-
|-
| 125
| 101
| LXC
| LXC
| ipam.nurd.space
| notapp.vm.nurd.space
| Debian 7
| Debian 10
| -
| -
| Buzz
| Critical - this is the main container that provides storage mounts to everywhere (egg, mpd). Update this one early.
| Feb 24th 2022
|-
|-
| 133
| 125
| LXC
| LXC
| egg.vm.nurd.space
| ipam.vm.nurd.space
| Debian 9
| Debian 10
| -
| -
| Critical
| Petraea
| Feb 24th 2022
|-
|-
| 140
| 140
Line 108: Line 150:
| nurdbot.vm.nurd.space
| nurdbot.vm.nurd.space
| Ubuntu 16.04 LTS
| Ubuntu 16.04 LTS
| Update to Ubuntu 18.04.6 LTS
| Update to Ubuntu 20.04.3 LTS
| Crticial
|-
| 144
| VM
| nurdservices.nurdspace.lan
| Debian 9
| -
| Critical
| Critical
|}
| Feb 24th 2022
 
<span id="lxcsvms-that-are-upgraded"></span>
 
=== LXCs/VMs that are upgraded ===
 
Some of these have been done previously
 
{| class="wikitable"
! VMID
! type
! Name
! OS
! Done
! Remarks
|-
|-
| 100
| 100
Line 139: Line 160:
| OK
| OK
| Used to be VM 105 but now it's LXC 100
| Used to be VM 105 but now it's LXC 100
| Feb 23rd 2022
|-
|-
| 107
| 107
Line 146: Line 168:
| OK
| OK
|
|
| Feb 23rd 2022
|-
|-
| 109
| 109
Line 153: Line 176:
| Previously
| Previously
|
|
| Feb 24th 2022
|-
|-
| 118
| 113
| LXC
| LXC
| gopher
| auth.vm.nurd.space / auth.nurd.space
| Debian 10
| Debian 10
| OK
| New
|
| Replaces saml.nurd.space - using Keycloak
| Feb 24th 2022
|-
|-
| 119
| 114
| LXC
| LXC
| gallery.nurd.space
| irctvserver
| Debian 10
| Debian 11
| Previously
| New
|
| Flok
| Feb 24th 2022
|-
|-
| 123
| 123
Line 174: Line 200:
| -
| -
|
|
| Feb 24th 2022
|-
|-
| 124
| 124
Line 181: Line 208:
| OK
| OK
|
|
| Feb 23rd 2022
|-
|-
| 128
| 128
Line 188: Line 216:
| Previously
| Previously
|
|
| Feb 24th 2022
|-
|-
| 131
| 105
| LXC
| LXC
| influx.vm.nurd.space
| influx.vm.nurd.space
Line 195: Line 224:
| Previously
| Previously
|
|
| Feb 23th 2022
|-
| 112
| VM
| portal.nurd.space
| Debian 10
| OK
| CAREFULNEXTTIME: see that the http://pkg.switch.ch/switchaai/debian repo also follows along well!!
| Feb 24th 2022
|}
|}


Line 203: Line 241:
These can possibly be deleted or archived.
These can possibly be deleted or archived.


{| class="wikitable"
{| class="wikitable sortable"
! VMID
! VMID
! type
! type
Line 210: Line 248:
! Done
! Done
! Remarks
! Remarks
! Last backup
|-
|-
| 104
| 104
Line 217: Line 256:
| Previously
| Previously
|
|
| Feb 23rd 2022
|-
|-
| 106
| 106
Line 224: Line 264:
| Deleted
| Deleted
|
|
| Not needed
|-
|-
| 108
| 108
Line 231: Line 272:
| Deleted
| Deleted
|
|
| Not needed
|-
|-
| 110
| 110
Line 238: Line 280:
| Deleted
| Deleted
| Petraea - An old routing box for prototyping different network layers. Could be folded.
| Petraea - An old routing box for prototyping different network layers. Could be folded.
| Not needed
|-
|-
| 111
| 111
Line 245: Line 288:
| -
| -
|
|
| Feb 23rd 2022
|-
|-
| 113
| 113
Line 252: Line 296:
| Deleted
| Deleted
| Petraea - An old monitoring setup (zabbix). Could be folded.
| Petraea - An old monitoring setup (zabbix). Could be folded.
| Not needed
|-
|-
| 114
| 114
Line 259: Line 304:
| Deleted
| Deleted
| Petraea - An old IoT processing system. Could be folded.
| Petraea - An old IoT processing system. Could be folded.
| Not needed
|-
|-
| 115
| 115
Line 266: Line 312:
| Deleted
| Deleted
| Gaming VM. Noone knows whose it is so fuck it :p Not used since 2015
| Gaming VM. Noone knows whose it is so fuck it :p Not used since 2015
| Not needed
|-
|-
| 116
| 116
Line 273: Line 320:
| Deleted
| Deleted
|
|
| Not needed
|-
|-
| 117
| 117
Line 280: Line 328:
| -
| -
|
|
| Feb 23rd 2022
|-
| 118
| LXC
| gopher
| Debian 10
| OK
|
| Feb 23rd 2022
|-
| 119
| LXC
| gallery.nurd.space
| Debian 10
| Previously
|
| Feb 23rd 2022
|-
|-
| 120
| 120
Line 287: Line 352:
| Deleted
| Deleted
|
|
| Not needed
|-
|-
| 121
| 121
Line 294: Line 360:
| -
| -
| Petraea
| Petraea
| Feb 23rd 2022
|-
| 122
| LXC
| saml.nurd.space
| CentOS 6.6
| stopped
| Zarya has replaced this with 113
| Feb 23rd 2022
|-
| 126
| LXC
| soundfx.dhcp.nurd.space
|
| stopped
|
| Feb 23rd 2022
|-
|-
| 127
| 127
Line 301: Line 384:
| -
| -
|
|
| Feb 23rd 2022
|-
| 131
|
| oldinflux.vm.nurd.space
|
| Deleted
| New one is 105
| Not needed
|-
|-
| 135
| 135
Line 306: Line 398:
| lightsjam.vm.nurd.space
| lightsjam.vm.nurd.space
| ?
| ?
| -
| Deleted
|
| backup has been transferred to Petraeas homedir
| Not needed
|-
|-
| 137
| 137
Line 315: Line 408:
| Deleted
| Deleted
| Petraea - Some central means of coordinating WoL handling with an API. Could be folded.
| Petraea - Some central means of coordinating WoL handling with an API. Could be folded.
| Not needed
|-
|-
| 141
| 141
Line 322: Line 416:
| -
| -
| Petraea
| Petraea
| Feb 23rd 2022
|-
|-
| 143
| 143
Line 329: Line 424:
| Deleted
| Deleted
| Petraea - an old artistic neural network processor. Could be folded.
| Petraea - an old artistic neural network processor. Could be folded.
| Not needed
|}
|}

Latest revision as of 12:47, 8 March 2022

Coherence update 2022
Name Coherence update 2022
Date 2022/01/06
DateEnd 2022/01/31
Location Space
Contact Melan
Attendees


The upgrade project was successful, a big thank you to everyone who worked hard on this!

What

We are several versions behind on Proxmox on Coherence, as of writing the current version of Proxmox is 7.1-7 while we are still running 5.4-13(!). This means that we can't make any new LXC containers with newer distributions because they are simply not supported by Proxmox 5. Several attempts to upgrade Coherence have been made in the past, but I hope this time we can actually do it! It would also be nice if we could use this as an opportunity to clear old unused VMs and containers off Coherence. Done

Upgrading Proxmox path

A upgrade from 5 to 6 is needed, and from there on we can upgrade from 6 to 7. - [1] - [2] Done \o/

Upgrade stuff (can be done already when backups are possible)

Please make backups first before you upgrade a VM or container

There should be a backup system available on backup-nfs before we start.

Debian containers should be Debian 10 at least before we can upgrade Proxmox, and Ubuntu 18.04 it seems.

Thinking steps required

* Backups - if we mess up, how do we bring things back? - Need at least 4Tb to do this.

  • Redundancy - Can we upgrade some other host and migrate? Would this be a good plan going forwards?

- Probably not required - Proxmox upgrade scripts should check containers before upgrades.

  • Upgrades - All VkMs/Containers below need to be ticked off

Done

Backup

A system called `notnotapp.lan.nurd.space` has been setup and has 4x 1TB in raid 5 storage, meaning we have 3TB available for backup with redundancy. Although, roughly 1.8TB has been used for the mp3 share and the user data. Which should leave enough for VMs however, it is advised to remove your backup once the VM has been successfully upgraded to leave enough room.

A update of the user directory and mp3 share has finished at 10 January, rsync should be ran from time to time to keep notnotapp in sync with notapp. There is 966GB left free for VM backups.

Restore

Make sure you don't check unprivileged checkbox if you plan to do NFS inside the container! Screen-2022-01-30-12-30-01.png

List of LXCs/VMs

LXCs/VMs in need of OS upgrade

VMID type Name OS Done Remarks Last backup
144 VM nurdservices.nurdspace.lan Debian 9 - Critical - but this is a VM, so not blocking for proxmox upgrade Feb 24th 2022

LXCs/VMs that are upgraded or are new

Some of these have been done previously

VMID type Name OS Done Remarks Last backup
102 LXC parts.vm.nurd.space Debian 10 OK A partkeepr frontend. Has php7.1 from https://deb.sury.org/ now. Feb 23th 2022
103 LXC postgresql.vm.nurd.space Debian 10 Dennis New container with Debian 10, will need some work later (newer postgres, auth stuff) Feb 23th 2022
106 LXC harkbot Debian 11 New r3boot, replacement for NURDbot No need
108 LXC gitea.vm.nurd.space Debian 11 New Niz No need
110 LXC IPFIXer Debian 11 New Flok Feb 24th 2022
133 LXC egg.vm.nurd.space Debian 10 - This is now Debian 10, but is a bit wacky. Might be a good idea to rebuild this one from scratch someday. Feb 24th 2022
101 LXC notapp.vm.nurd.space Debian 10 - Critical - this is the main container that provides storage mounts to everywhere (egg, mpd). Update this one early. Feb 24th 2022
125 LXC ipam.vm.nurd.space Debian 10 - Petraea Feb 24th 2022
140 LXC nurdbot.vm.nurd.space Ubuntu 16.04 LTS Update to Ubuntu 20.04.3 LTS Critical Feb 24th 2022
100 LXC spacesound.vm.nurd.space Ubuntu 20.04.3 LTS OK Used to be VM 105 but now it's LXC 100 Feb 23rd 2022
107 LXC nurdbotdev.vm.nurd.space Ubuntu 20.04 LTS OK Feb 23rd 2022
109 LXC asterisk Debian 10 Previously Feb 24th 2022
113 LXC auth.vm.nurd.space / auth.nurd.space Debian 10 New Replaces saml.nurd.space - using Keycloak Feb 24th 2022
114 LXC irctvserver Debian 11 New Flok Feb 24th 2022
123 VM jarvis.vm.nurd.space Hass OS 6.6 - Feb 24th 2022
124 LXC sdr.nurd.space Ubuntu 20.04 LTS OK Feb 23rd 2022
128 LXC revproxy01.nurd.space Debian 10 Previously Feb 24th 2022
105 LXC influx.vm.nurd.space Debian 10 Previously Feb 23th 2022
112 VM portal.nurd.space Debian 10 OK CAREFULNEXTTIME: see that the http://pkg.switch.ch/switchaai/debian repo also follows along well!! Feb 24th 2022

LXCs/VMs that are not running

These can possibly be deleted or archived.

VMID type Name OS Done Remarks Last backup
104 LXC status.vm.nurd.space Debian 10 Previously Feb 23rd 2022
106 VM jarvis-ng.vm.nurd.space ? Deleted Not needed
108 VM docker.vm.nurd.space ? Deleted Not needed
110 LXC bridger.lan.nurd.space ? Deleted Petraea - An old routing box for prototyping different network layers. Could be folded. Not needed
111 LXC Flunk ? - Feb 23rd 2022
113 LXC panopticon.vm.nurd.space ? Deleted Petraea - An old monitoring setup (zabbix). Could be folded. Not needed
114 LXC vinculum.vm.nurd.space Debian 8 Deleted Petraea - An old IoT processing system. Could be folded. Not needed
115 LXC wopr.vm.nurd.space ? Deleted Gaming VM. Noone knows whose it is so fuck it :p Not used since 2015 Not needed
116 LXC music.nurd.space ? Deleted Not needed
117 LXC snor.vm.nurd.space ? - Feb 23rd 2022
118 LXC gopher Debian 10 OK Feb 23rd 2022
119 LXC gallery.nurd.space Debian 10 Previously Feb 23rd 2022
120 LXC mailng.vm.nurd.space Debian 9 Deleted Not needed
121 LXC mercator.vm.nurd.space ? - Petraea Feb 23rd 2022
122 LXC saml.nurd.space CentOS 6.6 stopped Zarya has replaced this with 113 Feb 23rd 2022
126 LXC soundfx.dhcp.nurd.space stopped Feb 23rd 2022
127 LXC mail.vm.nurd.space ? - Feb 23rd 2022
131 oldinflux.vm.nurd.space Deleted New one is 105 Not needed
135 LXC lightsjam.vm.nurd.space ? Deleted backup has been transferred to Petraeas homedir Not needed
137 LXC wol-server.vm.nurd.space Debian 7 Deleted Petraea - Some central means of coordinating WoL handling with an API. Could be folded. Not needed
141 LXC pretender.dhcp.nurd.space ? - Petraea Feb 23rd 2022
143 LXC neural.vm.nurd.space ? Deleted Petraea - an old artistic neural network processor. Could be folded. Not needed
Retrieved from "https://nurdspace.nl/index.php?title=Coherence_update_2022&oldid=11172"
Last modified
This page was last edited on 8 March 2022, at 12:47.