| View previous topic :: View next topic |
| Author |
Message |
aNtHrAx323
n00b
Joined: 03 Dec 2002
Posts: 48
Location: San Antonio, TX
|
 Posted: Mon Dec 09, 2002 11:49 pm Post subject: Setting up an installation/compilation cluster...? |
 |
|
I've built about 10 boxes out of scrap hardware (here at work), and was pondering the idea of setting up a cluster for all the other Gentoo users here to use for compiling. I'm still a Linux tard, and the guys who I could ask (and would be knowledgable about this sort of thing) are out, so I decided to ask you guys. What would be the best way to go about doing this? They all have 3Com 3C905CX-TXM NICs in them, so there shouldn't be a whole lot of variation between the systems... It would be great to be able to speed up the deployment times of machines running Gentoo using all these machines. Thanks!
_________________
-Campbell "aNtHrAx323" Krueger
http://www.flargen.com/
http://www.h2overclocking.com/ |
|
| Back to top |
|
 |
JimmyW
Tux's lil' helper
Joined: 28 Sep 2002
Posts: 119
Location: Sweden
|
| Posted: Tue Dec 10, 2002 1:00 am Post subject: Re: Setting up an installation/compilation cluster...? |
|
|
Take a look att www.mosix.org or www.openmosix.org.
| aNtHrAx323 wrote: | | I've built about 10 boxes out of scrap hardware (here at work), and was pondering the idea of setting up a cluster for all the other Gentoo users here to use for compiling. I'm still a Linux tard, and the guys who I could ask (and would be knowledgable about this sort of thing) are out, so I decided to ask you guys. What would be the best way to go about doing this? They all have 3Com 3C905CX-TXM NICs in them, so there shouldn't be a whole lot of variation between the systems... It would be great to be able to speed up the deployment times of machines running Gentoo using all these machines. Thanks! |
|
|
| Back to top |
|
|
phong
Bodhisattva
Joined: 16 Jul 2002
Posts: 778
Location: Michigan - 15 & Ryan
|
| Posted: Tue Dec 10, 2002 1:59 am Post subject: |
|
|
Also, for a more lightweight solution - check out distcc. A quick search for "distcc" on the forums will give you a few posts describing how to get it working with Gentoo.
_________________
"An empty head is not really empty; it is stuffed with rubbish. Hence the difficulty of forcing anything into an empty head."
-- Eric Hoffer |
|
| Back to top |
|
|
aNtHrAx323
n00b
Joined: 03 Dec 2002
Posts: 48
Location: San Antonio, TX
|
| Posted: Tue Dec 10, 2002 9:48 pm Post subject: |
|
|
Thanks. Yeah, I noticed after posting some info about distc... One thing I wasn't clear on, however, was whether or not distcc would be used automatically when emerging (all I saw was information regarding using it in conjunction with GCC and make, by setting the $CC variable as an argument). I appreciate your help, as this is quite a learning experience.
_________________
-Campbell "aNtHrAx323" Krueger
http://www.flargen.com/
http://www.h2overclocking.com/ |
|
| Back to top |
|
|
aNtHrAx323
n00b
Joined: 03 Dec 2002
Posts: 48
Location: San Antonio, TX
|
| Posted: Tue Dec 10, 2002 11:07 pm Post subject: |
|
|
Ok, I found information on how to use it with emerge  . However, will distcc honor my USE and CFLAGS variables? Say I'm emerging system on a P4-based machine, and the cluster I want to utilize for assistance in compiling consists of Athlons, P2's, P3's, and even a couple lowly K6-III's and Pentium Pros. It's a genuinely mixed x86 environment (at least as far as different CFLAGS are concerned). Would these other machines appropriately compile with SSE2 optimizations, or all the USE variables I set? Please forgive any stupid questions .
_________________
-Campbell "aNtHrAx323" Krueger
http://www.flargen.com/
http://www.h2overclocking.com/ |
|
| Back to top |
|
|
phong
Bodhisattva
Joined: 16 Jul 2002
Posts: 778
Location: Michigan - 15 & Ryan
|
| Posted: Wed Dec 11, 2002 12:26 am Post subject: |
|
|
| aNtHrAx323 wrote: | | Ok, I found information on how to use it with emerge . However, will distcc honor my USE and CFLAGS variables? |
Yes, it handles this all correctly. In short, all binaries produced are the same as if compilation were done localy. All the preprocessing, linking, gcc flag selection, etc. occurs on the target machine (i.e. the machine the program is being compiled for). The only thing that gets distributed to the other machines is the actual compilation and assembly steps. CFLAGS are passed from the target machine to the other machines as part of the gcc command line. USE variables are handled entirely by portage (gcc does not know, nor care about them,) and since all portage activity occurs on the target machine, the other machines don't need to even know about them.
_________________
"An empty head is not really empty; it is stuffed with rubbish. Hence the difficulty of forcing anything into an empty head."
-- Eric Hoffer |
|
| Back to top |
|
|
|
|
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
|
|
Installing Gentoo
