| View previous topic :: View next topic |
| Author |
Message |
Jackie Lin
Tux's lil' helper
Joined: 31 May 2017
Posts: 115
|
 Posted: Fri Jan 19, 2018 6:34 am Post subject: how to download all the files from a gentoo mirror |
 |
|
Hi, there.
I am trying to make a local gentoo mirror. I have learned how to make a rsync server.
but the nearest mirror for me does not support rsync. it support only http.
I wonder how I can copy all the files on the http server to local path.
Could anyone help me? Thanks in advance!
_________________
peace, focus. |
|
| Back to top |
|
 |
fedeliallalinea
Administrator
Joined: 08 Mar 2003
Posts: 31602
Location: here
|
| Posted: Fri Jan 19, 2018 7:46 am Post subject: |
|
|
An idea, but keep in mind you need much disk space and I don't know if the mirror where you download all packages will be happy
| Code: | for package in $(EIX_LIMIT=0 NAMEVERSION="=<category>/<name>-<version>\n" eix --format '<availableversions:NAMEVERSION>' --in-overlay gentoo '*' | head -n -4); do
emerge -f --nodeps ${package}
done |
_________________
Questions are guaranteed in life; Answers aren't. |
|
| Back to top |
|
|
NeddySeagoon
Administrator
Joined: 05 Jul 2003
Posts: 55186
Location: 56N 3W
|
| Posted: Fri Jan 19, 2018 12:30 pm Post subject: |
|
|
Jackie Lin,
A full mirror is about 250G, then you need to get the fetch restricted packages yourself.
Don't worry too much about distance to the mirrors, speed is more important.
Audition mirrors using mirrorselect.
Why do you need a full mirror?
Gentoo provides http-replicator so that you need only download source files once.
You point all your systems to your instance of http-replicator and it fetches things that it doesn't already have.
This saves a lot of internet bandwidth and your HDD space.
Be friendly to the mirror system too. Spread the load around a bit.
-- edit --
If you intend to copy just a single mirror, email the admin and ask first.
If the admin knows the load is expected and is happy with it, you won't get blocked.
_________________
Regards,
NeddySeagoon
Computer users fall into two groups:-
those that do backups
those that have never had a hard drive fail. |
|
| Back to top |
|
|
Jackie Lin
Tux's lil' helper
Joined: 31 May 2017
Posts: 115
|
| Posted: Sun Jan 21, 2018 8:08 am Post subject: |
|
|
Thanks a lot,fedeliallalinea 
_________________
peace, focus. |
|
| Back to top |
|
|
fedeliallalinea
Administrator
Joined: 08 Mar 2003
Posts: 31602
Location: here
|
| Posted: Sun Jan 21, 2018 8:36 am Post subject: |
|
|
| Jackie Lin wrote: | | Thanks a lot,fedeliallalinea |
Remember NeddySeagoon words
| NeddySeagoon wrote: | If you intend to copy just a single mirror, email the admin and ask first.
If the admin knows the load is expected and is happy with it, you won't get blocked. |
_________________
Questions are guaranteed in life; Answers aren't. |
|
| Back to top |
|
|
Jackie Lin
Tux's lil' helper
Joined: 31 May 2017
Posts: 115
|
| Posted: Mon Jan 22, 2018 2:22 am Post subject: |
|
|
Thanks, NeddySeagoon
_________________
peace, focus. |
|
| Back to top |
|
|
|
Other Things Gentoo
