View previous topic :: View next topic |
Author |
Message |
soluzar Tux's lil' helper
Joined: 30 Aug 2004 Posts: 81 Location: England
|
Posted: Sun Jan 02, 2005 4:44 pm Post subject: Does mirrorselect always do more harm than good? |
|
|
This is my 4th time or so of installing Gentoo linux, on various boxes, twice from stage one, so I'm starting to get a pretty good feel for the way the install process works. Every time I have done the 'mirrorselect' part of the installation, it has caused problems, and on one occasion inserted random garbage into my make.conf.
The only solution which ever allowed me to progress to the end of the install process was to remove or comment the mirrors line from my make.conf.
I now ask if it is not advisable to remove this troublesome utility from the install handbook altogether. Opinions? _________________ Soluzar |
|
Back to top |
|
|
cyrillic Watchman
Joined: 19 Feb 2003 Posts: 7313 Location: Groton, Massachusetts USA
|
Posted: Sun Jan 02, 2005 4:50 pm Post subject: |
|
|
I always add the mirrors I want manually to /etc/make.conf
Just pick a couple that work well for you from this list : Gentoo Linux Mirrors |
|
Back to top |
|
|
taurus l33t
Joined: 21 Sep 2004 Posts: 657 Location: I need to be somewhere...
|
Posted: Sun Jan 02, 2005 7:46 pm Post subject: |
|
|
I've never used that command to add a mirror site to my /etc/make.conf because it trashes my /etc/make.conf every single time!!! I add it in my hand
GENTOO_MIRRORS="http:<whichever the closest to you>"
taurus |
|
Back to top |
|
|
cfaun n00b
Joined: 25 Dec 2004 Posts: 63
|
Posted: Sun Jan 02, 2005 7:55 pm Post subject: |
|
|
When I run it, it adds mirrors that don't work... _________________ This sig intentionally left blank |
|
Back to top |
|
|
forkboy Apprentice
Joined: 24 Nov 2004 Posts: 200 Location: Blackpool, UK
|
Posted: Sun Jan 02, 2005 8:34 pm Post subject: |
|
|
It worked perfectly for me when I used it. |
|
Back to top |
|
|
racoontje Veteran
Joined: 19 Jul 2004 Posts: 1290
|
Posted: Sun Jan 02, 2005 10:13 pm Post subject: |
|
|
Worked fine for me too, but I manually selected my servers afterwards and they were faster than the ones mirrorselect thought I needed. |
|
Back to top |
|
|
kimchi_sg Advocate
Joined: 26 Nov 2004 Posts: 2969
|
Posted: Sun Jan 02, 2005 11:37 pm Post subject: |
|
|
racoontje wrote: | Worked fine for me too, but I manually selected my servers afterwards and they were faster than the ones mirrorselect thought I needed. |
I agree. I know of a very fast server in my own country. But when i run mirrorselect and check the GENTOO_MIRRORS line later, all the servers are in other countries. It didn't even see my fast local server. |
|
Back to top |
|
|
theprez98 n00b
Joined: 02 Jan 2005 Posts: 6
|
Posted: Sun Jan 02, 2005 11:57 pm Post subject: installation problems |
|
|
During the install process, when gentoo 'fetches' the source files from various servers (emerge --fetchonly system) the connections often abort and sometimes timeout (and take a long time to timeout). Is this a mirrorselect problem?
It has often ended up aborting the process. I have had a little bit of luck starting it again, but it ends up stalling on several servers.
How can I fix this process?
Thanks in advance for any help you may be able to provide. |
|
Back to top |
|
|
kimchi_sg Advocate
Joined: 26 Nov 2004 Posts: 2969
|
Posted: Mon Jan 03, 2005 12:03 am Post subject: Re: installation problems |
|
|
theprez98 wrote: | During the install process, when gentoo 'fetches' the source files from various servers (emerge --fetchonly system) the connections often abort and sometimes timeout (and take a long time to timeout). Is this a mirrorselect problem? |
Most likely.
And the remedy, as some have already said, is to manually insert mirrors into make.conf.- Edit make.conf and remove the GENTOO_MIRRORS line totally.
- Using links, go to http://www.gentoo.org/main/en/mirrors.xml and search for a mirror in your country, or the one nearest to yours.
- Edit make.conf again and insert the GENTOO_MIRRORS line in the form of
Code: | GENTOO_MIRRORS="ftp://mirror1 http://mirror2 ftp://mirror3" |
|
|
Back to top |
|
|
theprez98 n00b
Joined: 02 Jan 2005 Posts: 6
|
Posted: Mon Jan 03, 2005 12:24 am Post subject: |
|
|
Thanks for the help. I figured this was the problem, I just wanted some further advice before I started again. I'll try again... |
|
Back to top |
|
|
Crucis n00b
Joined: 07 Sep 2004 Posts: 65 Location: Singapore
|
Posted: Mon Jan 03, 2005 1:19 pm Post subject: |
|
|
Try
and pick the servers nearer to you |
|
Back to top |
|
|
rkasting n00b
Joined: 12 Jan 2005 Posts: 30
|
Posted: Wed Jan 12, 2005 10:13 pm Post subject: |
|
|
Get rid of it, unless someone wants to make it really work. It almost made me give up on the distro, until I realized that it was all just messed up from mirrorselect.
Now I've gotten the system up and running with no problem.. only I'm going to rebuild from stage1 because I misguidedly gave up on it because of mirrorselect issues.
Do you know how I feel? LOL... |
|
Back to top |
|
|
Rudy1066 n00b
Joined: 30 Jan 2004 Posts: 8 Location: Athens, OH
|
Posted: Wed Jan 12, 2005 11:44 pm Post subject: |
|
|
For me, mirrorselect has been a unneeded pain-in-the butt. The last time I tried, it inserted 45,000 lines of garbage into my make.conf. It is much easier to manually select a mirror based on your experience and geographical location. _________________ HP Pavilion ze4560
AMD Athlon XP-M
1 Gb RAM; 60 Gb Hardrive
Gentoo Linux |
|
Back to top |
|
|
beandog Bodhisattva
Joined: 04 May 2003 Posts: 2072 Location: /usa/utah
|
Posted: Wed Jan 12, 2005 11:48 pm Post subject: |
|
|
Crucis wrote: | Try
and pick the servers nearer to you |
Thats exactly what I was going to say too.
Once I found out about that option, I won't do anything else!
For those of you too lazy to try it ... the -i means interactive mode. It pops up a nice little ncurses interface with the mirrors and what countries they are in. You select the ones you want and it drops it in make.conf.
Nice.
Steve _________________ If it ain't broke, tweak it. dvds | blurays | blog | wiki |
|
Back to top |
|
|
Bob P Advocate
Joined: 20 Oct 2004 Posts: 3355 Location: Jackass! Development Labs
|
Posted: Thu Jan 13, 2005 2:33 am Post subject: |
|
|
Crucis wrote: | Try
and pick the servers nearer to you |
if you do this, remember that there can be a significant difference between mirrors that are geographically close to you, and mirrors that are close to you in terms of IP hops.
i'm sitting on top of one of the big internet pipes in Chicago, and i'm closer to some mirrors in Europe than I am to ones that are 15 miles away from me. _________________ .
Stage 1/3 | Jackass! | Rockhopper! | Thanks | Google Sucks |
|
Back to top |
|
|
Earthwings Bodhisattva
Joined: 14 Apr 2003 Posts: 7753 Location: Germany
|
Posted: Fri Jan 14, 2005 10:24 am Post subject: |
|
|
Moved from Installing Gentoo. |
|
Back to top |
|
|
cazort Guru
Joined: 19 Sep 2004 Posts: 343 Location: Lancaster, PA
|
Posted: Wed Jan 26, 2005 8:17 pm Post subject: |
|
|
OK, now my beef. MIRRORSELECT IS SO SLOW!!! Why? Is there some ridiculous timeout period? From my perspective, if a server hasn't responded in 15 seconds, why does it sit waiting for it?
How can I change the timeout? I ran mirrorselect 5 minutes ago, and it's still only about a third the way through checking the mirrors. Most mirrors respond instantly, but occasionally they trip it up.
Also, I've run into a more serious problem with mirrorselect: often, it'll check a mirror as fast that has a small number of allowed connections. I then try to run emerge at a different time of day, and there's no way in hell I can get onto that ftp site. Often, because the fast sites are the ones that only allow a few users on, I've had it be that mirrorselect picks a handful of such sites, and then when I actually come to start building a system, none of the mirrors it picks work at all, and then it defaults back to some extremely slow mirrors.
Argh. I agree. It's terrible. Why can't we fix these issues? |
|
Back to top |
|
|
Bose-Einstein n00b
Joined: 17 Oct 2004 Posts: 43
|
Posted: Sun Apr 03, 2005 5:47 pm Post subject: |
|
|
Yep, anyone know why it just fills make.conf with unreadable characters (every single time) |
|
Back to top |
|
|
Shadow Skill Veteran
Joined: 04 Dec 2004 Posts: 1023
|
Posted: Mon Apr 04, 2005 2:10 am Post subject: |
|
|
Wow I must be really lucky as I do not remember ever having to use Mirrorselect even when installing my system [Perhaps I did use it and I just kinda glazed over it.I get pretty much maximum download speed as well, it is definetly a shame that Mirrorselect has a way of screwing up make.conf though. But why is it even adding mirrors to that particular file, that does not seem to make sense what about the rest of you, does it seem logical at all? I would think you would have a seperate mirrors file and leave make.conf for configuring portage features alone. _________________ Ware wa mutekinari.
Wa ga kage waza ni kanau mono nashi.
Wa ga ichigeki wa mutekinari.
"First there was nothing, so the lord gave us light. There was still nothing, but at least you could see it." |
|
Back to top |
|
|
StringCheesian l33t
Joined: 21 Oct 2003 Posts: 887
|
Posted: Mon Apr 04, 2005 2:30 am Post subject: |
|
|
Whenever a few mirrors are down or don't respond, it fools mirrorselect into thinking they're the fastest ones. It should verify that it actually got the number of bytes it was supposed to download. |
|
Back to top |
|
|
Shadow Skill Veteran
Joined: 04 Dec 2004 Posts: 1023
|
Posted: Mon Apr 04, 2005 4:17 am Post subject: |
|
|
StringCheesian wrote: | Whenever a few mirrors are down or don't respond, it fools mirrorselect into thinking they're the fastest ones. It should verify that it actually got the number of bytes it was supposed to download. | Your not serious are you? Please tell me you are joking, because if you are not that is probably one of the worst bugs I have ever heard of. _________________ Ware wa mutekinari.
Wa ga kage waza ni kanau mono nashi.
Wa ga ichigeki wa mutekinari.
"First there was nothing, so the lord gave us light. There was still nothing, but at least you could see it." |
|
Back to top |
|
|
StringCheesian l33t
Joined: 21 Oct 2003 Posts: 887
|
Posted: Mon Apr 04, 2005 4:43 pm Post subject: |
|
|
Shadow Skill wrote: | StringCheesian wrote: | Whenever a few mirrors are down or don't respond, it fools mirrorselect into thinking they're the fastest ones. It should verify that it actually got the number of bytes it was supposed to download. | Your not serious are you? Please tell me you are joking, because if you are not that is probably one of the worst bugs I have ever heard of. |
I'm serious. It happened to me when I tried mirrorselect a few months ago. mirrorselect -i was putting at the top all the mirrors that didn't respond, such that portage would try to download from them first.
It's probably just timing the download attempt - a "host not found" error happens faster than a 100k download. |
|
Back to top |
|
|
gentoo_lan l33t
Joined: 08 Sep 2004 Posts: 891 Location: Charles Town, WV
|
Posted: Mon Apr 04, 2005 7:16 pm Post subject: |
|
|
Shadow Skill wrote: | StringCheesian wrote: | Whenever a few mirrors are down or don't respond, it fools mirrorselect into thinking they're the fastest ones. It should verify that it actually got the number of bytes it was supposed to download. | Your not serious are you? Please tell me you are joking, because if you are not that is probably one of the worst bugs I have ever heard of. |
It has worked well for me in the past. However I have noticed some mirrors that don't appear to work when using it. |
|
Back to top |
|
|
tercel Retired Dev
Joined: 17 Apr 2005 Posts: 2 Location: Rochester NY
|
Posted: Mon Jun 13, 2005 10:14 pm Post subject: Mirrorselect rewritten |
|
|
I just thought that the people on this thread would be intereseted to know, I have rewritten mirrorselect from the ground up. I have fixed all the bugs mentioned here, including the "mirrorselect puts garbage in my make.conf" bug, and the issue with selecting broken mirrors as the fastest. (althought that particular bug was corrected in a previous release before my rewrite). In addition the whole thing is much more cleanly coded, so I should be able to keep on top of bug fixes and feature upgrades realtively easily, and its all a lot faster.
Most noteworthy is the algorithmic improvement I made to the "deep" mode, which downloads a test file off the mirrors. Mirrorselect will no longer waste time trying to download from a mirror after it has already become clear that the mirror in question will not be chosen.
It in package.mask right now, feel free to test it at your own risk. I welcome bug reports, and I'd like to get it stable as soon as possible _________________ tercel on irc.freenode.net |
|
Back to top |
|
|
screwloose Tux's lil' helper
Joined: 07 Feb 2004 Posts: 94 Location: Toon Town, Canada
|
Posted: Fri Jun 17, 2005 3:12 pm Post subject: |
|
|
I tried out your new version of mirrorselect and found it to be perfect. Faster than before, doesn't trash my make.conf, picks good working mirrors. Good job!! _________________ If something can go wrong it probably already has. You just don't know it yet. ~Henry's Modified version of Murphy's Law |
|
Back to top |
|
|
|