View previous topic :: View next topic |
Author |
Message |
ExecutorElassus Veteran
Joined: 11 Mar 2004 Posts: 1435 Location: Berlin, Germany
|
Posted: Tue Oct 11, 2016 2:26 pm Post subject: Upgrades: LVM to SSD migration |
|
|
I have a rather substantial hardware upgrade on its way, and I'd like some advice on how to manage it without drinking myself into a coma or setting myself or my computer on fire. To wit, I'm replacing the mobo/CPU/RAM on my system, but also -- more significantly -- adding three SSDs to get a performance and boot-time improvement. My present hard-drive setup is somewhat complex, so I'd like some advice as to how best to manage the transition.
Here's what I have presently:
Three HDs are partitioned exactly the same: 100MB for /boot (RAID1/mirrored across all three), 10GB for / (also RAID1), 2GB for <swap> (three independent partitions), and all the rest of the drive part of one big RAID6 array. This RAID6 array is further partitioned to contain the following LVM partitions:
/portage
/portage/distfiles
/usr
/var
/var/tmp/
/opt
/home
and nine partitions as storage partitions varying in size from 100GB to 1.5TB
When finished with the transition, I want the following:
/boot, /, <swap>, /portage, /portage/distfiles, /usr, /var, /var/tmp, and /opt (as well as all other system partitions) all on two of the SSDs, mirrored as a RAID1 array.
/home and all the storage partitions (save one) and its subdirectories expanded to fill the entire three HDs, which will now be a single partition in a RAID6 array
that one storage subdirectory on the last SSD
I have a total of 6 SATA ports on the new mobo, so I could conceivably have all six drives attached at the same time. How, then, do I go about migrating from one setup to the other? Is my proposed target the best solution, or is there a better way to use the (upgraded) hardware that I'll have? What is the best way to copy an entire partition's contents, preserving file attributes like access/modification time, etc.?
Thanks in advance for the help. Huzzah for pimped-out machines!
Cheers,
EE
ADDED: furthermore, if at all possible, I would like to encrypt the system as much as possible while I'm transitioning over. At least /, and possibly also the /home partitions, I would like to have protected with encryption, meaning that I'll have to wipe the partitions (probably one at a time) as I remove them from and re-add them to the arrays.
ADDED 2: furthermore, as /var and /usr are on an LVM, I presently boot using an initrd (kindly shepherded into functioning by Neddy Seagoon) to pre-mount and scan them before transitioning to "real" root. Since this will no longer be necessary, how do I transition back to *not* using the initrd to boot? |
|
Back to top |
|
|
frostschutz Advocate
Joined: 22 Feb 2005 Posts: 2977 Location: Germany
|
Posted: Tue Oct 11, 2016 3:02 pm Post subject: |
|
|
Quote: | adding three SSDs to get a performance and boot-time improvement |
You only need one SSD for that
Quote: |
When finished with the transition, I want the following:
/boot, /, <swap>, /portage, /portage/distfiles, /usr, /var, /var/tmp, and /opt (as well as all other system partitions) all on two of the SSDs, mirrored as a RAID1 array.
/home and all the storage partitions (save one) and its subdirectories expanded to fill the entire three HDs, which will now be a single partition in a RAID6 array
that one storage subdirectory on the last SSD
|
No, no, no.
/home is on SSD. If you don't do this you spend a lot of moneys on SSD and still have HDD performance for all programs that have their config files, storage, etc. in /home.
HDD is only for big clunky stuff that does not benefit from SSD at all (your bluray rips).
You must have a looot of junk in your portage/distfiles if you manage to fill three SSDs with it. How much space do all your system partitions combined really need? Empty SSD is like free RAM... useless.
Everything you use often and should be fast: on to the SSD it goes.
Quote: |
ADDED: furthermore, if at all possible, I would like to encrypt the system as much as possible while I'm transitioning over. At least /, and possibly also the /home partitions, I would like to have protected with encryption, meaning that I'll have to wipe the partitions (probably one at a time) as I remove them from and re-add them to the arrays.
ADDED 2: furthermore, as /var and /usr are on an LVM, I presently boot using an initrd (kindly shepherded into functioning by Neddy Seagoon) to pre-mount and scan them before transitioning to "real" root. Since this will no longer be necessary, how do I transition back to *not* using the initrd to boot?
|
You are adding encryption and LVM, and think you no longer need an initramfs to boot? You're living in a dream world, Neo. |
|
Back to top |
|
|
ExecutorElassus Veteran
Joined: 11 Mar 2004 Posts: 1435 Location: Berlin, Germany
|
Posted: Tue Oct 11, 2016 9:18 pm Post subject: |
|
|
Code: | $ df
Filesystem 1K-blocks Used Available Use% Mounted on
/dev/md126 9481060 4201728 4791060 47% /
/dev/dm-0 20511356 14217300 5245480 74% /usr
/dev/dm-5 3997376 1316588 2471076 35% /var
tmpfs 405624 3432 402192 1% /run
dev 10240 4 10236 1% /dev
shm 2028104 137460 1890644 7% /dev/shm
cgroup_root 10240 0 10240 0% /sys/fs/cgroup
/dev/md1 94451 48405 41170 55% /boot
/dev/mapper/vg-portage 2030995 531043 1395095 28% /usr/portage
/dev/mapper/vg-distfiles 15723760 10876152 4061176 73% /usr/portage/distfiles
/dev/mapper/vg-home 61796348 43013200 15637420 74% /home
/dev/mapper/vg-opt 3997376 894908 2892756 24% /opt
/dev/mapper/vg-tmp 4128448 256516 3662220 7% /tmp
/dev/mapper/vg-vartmp 10321208 678432 9118488 7% /var/tmp
none 2028104 0 2028104 0% /run/user/0
none 2028104 8 2028096 1% /run/user/1000
/dev/mapper/vg-carrier1 103081248 19793604 78044764 21% /home/elassus/carrier1
/dev/mapper/vg-carrier2 103081248 69861812 27976556 72% /home/elassus/carrier2
/dev/mapper/vg-carrier3 103081248 83151900 14686468 85% /home/elassus/carrier3
/dev/mapper/vg-carrier4 103081248 73513572 24324796 76% /home/elassus/carrier4
/dev/mapper/vg-carrier5 103081248 61911672 35926696 64% /home/elassus/carrier5
/dev/mapper/vg-carrier6 103081248 71816016 26022352 74% /home/elassus/carrier6
/dev/mapper/vg-carrier7 103081248 78196392 19641976 80% /home/elassus/carrier7
/dev/mapper/vg-carrier8 103081248 58891200 38947168 61% /home/elassus/carrier8
/dev/mapper/vg-carrier9 928779720 709994156 171599644 81% /home/elassus/carrier9
|
I want to consolidate all of the system partition (except /home and its subdirectories) onto the SSDs that are in the RAID1 array (that is, mirrored for security). I'd estimate roughly that those all take about 50GB of space, all told. The *storage* partitions, however -- all those "carrier" partitions -- are about 1.3TB all told; there's no way I'll fit all that on the SSDs I have. So the main /home partition might conceivably also reside on an SSD, but the rest will have to stay on the HDD. /carrier2, however, and some parts of /carrier6, are all games, which is why I wanted the third SSD: to move all of them over to SSD, since they're the only real thing that needs fast i/o from disk (everything else is, as you rightfully predict, media files).
Given this present layout, what's the best use of the three 250GB SSDs that are apparently arriving Friday?
Cheers,
EE |
|
Back to top |
|
|
Roman_Gruber Advocate
Joined: 03 Oct 2006 Posts: 3846 Location: Austro Bavaria
|
Posted: Wed Oct 12, 2016 5:44 am Post subject: |
|
|
I have not read the full post.
I have three SSDs which I switch as backup or system drives. 120GB SSDs or 128GB SSDs. 2 Drives on the shelf, one in use. Its a rotation cycle, the backup drive is than mounted in my notebook and the system drive is than put on the shelf.
I have hte distfiles on an ordinary HDD.
Boot is unencrypted as the handbook wants it with 128MB on the SSD
root is LVM / LUKS on the SSD. Last backup revealed that i moved 32GB of data for root.
Some older User data resides on the 1TB 2.5" HDD, becuase its hardly used and I am too lazy to sort it out. Its not backuped because its very old, not that important
Disk Wise: 128GB / 120GB SSD is enough for root including home without the distfiles for a desctop user with a minimalistic desctop like i3wm + custom scripts.
Code: | df -h |grep \/root
/dev/mapper/root 110G 31G 73G 30% /
|
I still wonder why guys needs 256GB / 512 GB SSD drives ...
---
Quote: | (that is, mirrored for security). |
The topic about data redundancy, backups is too much discussed.
IMHO, use different brands, different models. And make backups
I have plextor, ADATA and Sandisk (western digital purchased sandisk recently)
Different age, different technology, different firmware.
I do not recommend buying three identical drives with the same firmware and hardware.
Samsung had for example firmware bugs (no commennt on Samsung "quality" ...)
--
I had before 8GB RAM and now 16GB RAM on a notebook with an ivybridge i7 cpu.
--
Quote: | What is the best way to copy an entire partition's contents, preserving file attributes like access/modification time, etc.? |
I moved my installation from different hardware with pvmove. This installation is very old, the hardware isn't
When you want ot backup your hole data / move your data.
Boot up a livecd and use cp -ar (archive and recursive)
Any backup scripts are confusing, useless in my expierience. Good old creating partitions, cp -ar, adapting the bootlaoder because lvm has restrictions to not allow the same volume name to be mounted at the same time.
I never had swap in use or a need for it.
There is also a way for a snapshot with lvm, but too complicated, not worth when I can deal with a backup in less than 2 hours...
Even on a penryn box with 4Gb of RAM which I sold 1.5 years ago I never had a need for swap, except google-chrome. google chrome has a memory bug. it fails whatever ...
Ditch the swap. I am quite sure you have enough RAM in your box. |
|
Back to top |
|
|
|
|
You cannot post new topics in this forum You cannot reply to topics in this forum You cannot edit your posts in this forum You cannot delete your posts in this forum You cannot vote in polls in this forum
|
|