[lug] Migrating /home...rsync?

[stimits at comcast.net]

Hi,
 
Just thought I'd post what I found out was getting in the way. The rsync was backing up a directory tree which had nothing mounted on it...or so I thought. When using a gnome application you can get what appears to be a file, but it is really a mounted pseudo file system: ".gvfs". In the middle of copy line logging (over 2.3 million lines of log) was a note about not being able to read something...it turned out that not even root can read the ".gvfs" directory. It can't be copied by root. It should not have been there, the system was in text-mode only, with the only login being from root...but it seems this can remain mounted with some form of a gnome application ending unexpectedly. It takes about 6 or 8 hours of down time for one rsync because there is so much data, but after a umount of .gvfs everything actually worked as expected! Now I see why I've seen examples specifically excluding ".gvfs" from rsync.
 
Hey, I do like ncdu, and thanks everyone for different notes on rsync options. This data includes things like complete file systems for embedded builds, so this is what I used which worked:
rsync -avcrltxXP --info=progress2,stats2 --delete-before --numeric-ids <source> <dest>
 
Next use I will also add "-A".
 
Thanks!
 
----- Original Message -----From: David L. Willson <DLWillson at TheGeek.NU>To: Boulder (Colorado) Linux Users Group -- General Mailing List <lug at lug.boulder.co.us>Sent: Wed, 28 Sep 2016 11:55:28 -0000 (UTC)Subject: Re: [lug] Migrating /home...rsync?

Looks like everyone has their favorite rsync command. Here's mine:

$ sudo rsync -avHP src/ dest/

"sudo" and "-aH" to replay metadata like link-state, ownership, perms, and timestamps.

"-v" for lights.

"-P" for lights and restarts.

add "--dry" for a dress-rehearsal.

add "--delete" to remove orphans, files on the destination that don't exist in the source.

To `du` lots of things, consider `ncdu`.

Please include a little of your output or a link to a full log or something.


--Willson



-------- Original message --------From: Lee Woodworth <blug-mail at duboulder.com> Date: 9/28/16 1:07 AM (GMT-07:00) To: "Boulder (Colorado) Linux Users Group -- General Mailing List" <lug at lug.boulder.co.us> Subject: Re: [lug] Migrating /home...rsync? 

Any luck yet?

I have in the last week used similar commands to copy 2TBw/o any problems (local & remote). The diffs found noproblems and the data is really there, although I am notcopying xattrs or acls:

    rsync --archive --one-file-system --stats /src/ /dest/

Since you have root diffs ok, but user access errors, itsuggests a permission issue. Maybe on /home itself.

On 09/27/2016 07:52 PM, stimits at comcast.net wrote:> Hi,>  > I've been trying to copy over my home to a new RAID partition, but cannot seem to do so. I just want to clone an exact copy of /home to the temporary mount point of /mnt. When I use recursive diff to test if the two match, they do. When I look at file sizes, names, so on, they match. In no case does any version of "du" match, and I can't find the location of the byte size differences...perhaps it is counting directory sizes different between the original and RAID partitions due to meta data differences, but both are regular drives withe 512 byte block size. If I mount my RAID on /home and log in to my regular user, it becomes obvious right away that my desktop and settings are completely gone...yet I can't find anything different in the file copies.>  > This is my command which seems to come closest to a good copy of /home to /mnt (performed as root in text mode on Fedora 23):> rsync -avcrxXl --delete /home /mnt/home>  > The above command fails to back up the directory correctly, so is rsync not suitable for this? Should I use something different? Perhaps just a different rsync argument? Does anyone recommend something like a backup program instead?>  > Thanks!> > > > _______________________________________________> Web Page:  http://lug.boulder.co.us> Mailing List: http://lists.lug.boulder.co.us/mailman/listinfo/lug> Join us on IRC: irc.hackingsociety.org port=6667 channel=#hackingsociety> 

_______________________________________________Web Page:  http://lug.boulder.co.usMailing List: http://lists.lug.boulder.co.us/mailman/listinfo/lugJoin us on IRC: irc.hackingsociety.org port=6667 channel=#hackingsociety
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lug.boulder.co.us/pipermail/lug/attachments/20160929/a0aff28a/attachment.html>