| View previous topic :: View next topic |
| Author |
Message |
piavlo
Tux's lil' helper
Joined: 21 Jun 2005
Posts: 141
|
 Posted: Mon Jul 31, 2006 9:14 am Post subject: how to speed up rsync on "receiving file list ..." |
 |
|
Hi i'm running rsync like this on a weekly basis | Code: | | rsync -caWHvx --delete rsync://server/music/ /music/ |
Since i don't have much changes 95% of the time is spent on receiving file list ...
How can i reduce this time.?
Can the file listing on the rsync server be precreated?
If i rermove the -c (chechksum)option should it help?
Thanks
Last edited by piavlo on Wed Aug 02, 2006 8:11 pm; edited 1 time in total |
|
| Back to top |
|
 |
Janne Pikkarainen
Veteran
Joined: 29 Jul 2003
Posts: 1143
Location: Helsinki, Finland
|
| Posted: Mon Jul 31, 2006 9:22 am Post subject: |
|
|
One hack is to force the server to keep those directory entries in cache. That can be done for example with a simple
| Code: | | ls -R /path/to/your/music/ |
And then make cron run that entry every 15 minutes or so.
This trick works if your music directory is not very large: tens of thousands or even 100 000 entries can be ok, but starts to really eat memory and other resources if you have millions of files or more.
_________________
Yes, I'm the man. Now it's your turn to decide if I meant "Yes, I'm the male." or "Yes, I am the Unix Manual Page.". |
|
| Back to top |
|
|
piavlo
Tux's lil' helper
Joined: 21 Jun 2005
Posts: 141
|
| Posted: Wed Aug 02, 2006 8:10 pm Post subject: |
|
|
| Well i've removed the -c option and the speedup in generating listing work more that 15 times faster now, |
|
| Back to top |
|
|
|
Networking & Security
