How to set up a FULL Mirror

quakecon · n00b Joined: 31 May 2005 Posts: 6

Hey

I want to set up a FULL Gentoo Mirror in our company, so the server won't be public. I only found some instructions how to set up a local rsync mirror which is already running :-)

I don't like the proxy solution, it would be great if the mirror could sync the whole distfile directory at night.

What do I have to do? Is it just another entry in the rsyncd.conf file???

Thanks for your help

yaneurabeya · Veteran Joined: 13 May 2004 Posts: 1754 Location: Seattle

Uhm, in order to just serve distfiles, either add an rsync entry and then set the SYNC to be your rsync directory for your distfiles OR use an existing apache setup and share the directory, then add a SYNC reference in /etc/make.conf. Read man make.conf for more info.

quakecon · n00b Joined: 31 May 2005 Posts: 6

Thanks for your response...

Can you tell me how such an entry would look like?

Tell me if I'm wrong:

This is my config:

slycordinator · Advocate Joined: 31 Jan 2004 Posts: 3065 Location: Korea

Another way to do it is sharing through nfs.

http://gentoo-wiki.com/HOWTO_Using_a_shared_portage_via_NFS
http://gentoo-wiki.com/HOWTO_Share_Directories_via_NFS

quakecon · n00b Joined: 31 May 2005 Posts: 6

Thanks for your comment, but I'd like to set up a mirror that I only have to edit the make.conf file on all machines and enter my server as the source mirror.
--- EDIT ---

Ok I think I have an idea :

I just have to rsync the gentoo directory from a public mirror: that could be done with a single rsync command and a little cronjob, but the problem is i didn't found a public source server which has rsync enabled .?

Am I the first person who wants to set up his own local source mirror .....??????

slycordinator · Advocate Joined: 31 Jan 2004 Posts: 3065 Location: Korea

Maedhros · Posted: Wed Jun 01, 2005 3:37 pm Post subject:

Moved from Installing Gentoo to Networking & Security.

quakecon · n00b Joined: 31 May 2005 Posts: 6

Thanks for moving my post to the right position :-)

Yes it's also an approach to download the packages the first time from internet and cache them. But I want to cache all files and sync them over the night, if nobody can help me ( I know maybe it's a wired idea :-)

) I'll use the proxy solution for caching :-)

----- EDIT -----

I just tried the proxy out and i have to say it's absolutly not the solution which fits me :-(

I hope somebody can help me to set up a full or distfile mirror... :-)

yaneurabeya · Veteran Joined: 13 May 2004 Posts: 1754 Location: Seattle

Hmmm.. I thought I posted a solution before, but my browser must have crashed or something. Odd.

Do this:
Mirror's rsync.conf

quakecon · n00b Joined: 31 May 2005 Posts: 6

Thanks yaneurabey for your help

I want to download all files from a public mirror to serve it in my LAN the solution you gave me is to serve the distfile directory of my server, so only the packages i downloaded on the server will be served, but i want ALL packages....

but I think what i want is impossible/forbidden, or you have to sign up for a Public Gentoo Mirror.

Thanks for takin' time :-)

zeek · Posted: Sun Jun 05, 2005 3:58 am Post subject:

quakecon · n00b Joined: 31 May 2005 Posts: 6

AHHH ok

I thought all ebuilds are on all public servers, I didn't know that they are so widespreaded...

slycordinator · Advocate Joined: 31 Jan 2004 Posts: 3065 Location: Korea

yaneurabeya · Veteran Joined: 13 May 2004 Posts: 1754 Location: Seattle

Well, sly was mostly correct but I'll elaborate just a bit more. If your eyes gloss over a bit, just skip what I say

.

When you type in 'emerge sync' rsync checks to see if a file is up to date with your syncing server. Then it subsequently goes through and checks all ebuilds to see if they are up to date in the individual branches of your portage tree, and updates if necessary.

When you type emerge [package], emerge checks the ebuild and sees what the dependencies are for the program and also checks to see if the program can be built with whatever ACCEPT_KEYWORDS you have in your /etc/make.conf, /etc/portage/package.keywords, or ACCEPT_KEYWORDS variable defined at runtime. The reasoning behind the dependency building is if you don't already have program X, then the program won't run or worse won't even compile. So if everything goes well, emerge assigns dependencies that are required for the program to run/compile, and checks to see if the files exist in your distfiles directory. If not, it checks to see if the file is fetchable via some source (some 'source files' are fetchable while others are not, take Maya for example where there's a fetch restriction). If they are fetchable, then emerge tries every SRC_URI given by the ebuild (that is if the maintainer specified "download from sourceforge as opposed to 'mirror X'!") or a mirror given by the GENTOO_MIRRORS, in linear order from the first to last. Then if the file's MD5 hash checks out with the one specified in the portage branch that belongs to the ebuild, emerge runs an 'extract operation', and finally proceeds to do anything required to install the program. There's more to it than that, but my explanation was somewhat in-depth I think.

So, rsync_mirrors and distfiles mirrors are two mutually exclusive things, which can live in tandem with each other, or be separate entities, meaning that one is not required for the other to run. I just suggest running both as rsync because it reduces the amount of services you need running, possibly security risks, and is an overall better solution possibly.

My_World · Posted: Tue Jun 07, 2005 12:11 am Post subject:

How-To create your own Gentoo Mirror
Have a look in the above mentioned post for a very detailed How-To, even how to setup your client machines, etc.

Have a carefull read of the above wiki, do not emerge the rsync server, just edit /etc/rsyncd.conf and edit your other boxes accordingly!

_________________
"Ubuntu" - an African word meaning "Gentoo is too hard for me".