View previous topic :: View next topic |
Author |
Message |
GetCool Guru
Joined: 23 Nov 2003 Posts: 324 Location: Madison, Wisconsin
|
Posted: Thu Mar 11, 2004 9:34 pm Post subject: Poor performance with my gigabit card? |
|
|
I have a Gentoo box running samba and a Windows XP machine directly connected with a crossover cable. Both machines have SMC9452TX V.2 gigabit NICs (I compiled support for the "Marvell Yukon / SysKonnect SK-98xx" chipset into my kernel, which specifically lists this card in the help screen). The cable is cat 5e, and I made it myself; the machines are sitting right next to each other so it's only about 2' long. I doubt that is the problem because I make cables all the time at my job and I am very careful, but I am not ruling out this possibility.
Anyway, I am getting (what I think is) poor performance. I'm using the latest Windows drivers for the card and I compiled support for this chipset into my 2.6.4-rc2-love1 kernel. I don't know if it can be trusted, but the task manager in Windows never shows higher than 12% network utilization when I am copying large amounts of data from my Windows machine to my samba share. Anyhow, I just copied ~12 GB of FLAC files over and it took approximately 14-15 minutes.
I am definitely going to try changing the cable, but I just wanted to know if this could be some sort of hardware issue. Also, it would be nice to find some linux utility that can monitor network utilization - any suggestions?
Thanks. |
|
Back to top |
|
|
rockfly Apprentice
Joined: 27 Apr 2003 Posts: 179
|
Posted: Thu Mar 11, 2004 10:01 pm Post subject: |
|
|
copying with windows can slow down the proces, try to copy from a linux system to a linux system |
|
Back to top |
|
|
GetCool Guru
Joined: 23 Nov 2003 Posts: 324 Location: Madison, Wisconsin
|
Posted: Thu Mar 11, 2004 10:05 pm Post subject: |
|
|
rockfly wrote: | copying with windows can slow down the proces, try to copy from a linux system to a linux system |
Aye, I am going to be doing that eventually, but for now I can't. I'm getting ready to dual-boot my Windows machine, but right now I'm just copying all my data over to samba shares.
I look forward to seeing the performance between two Gentoo boxes, but it would sure be nice to have decent performance now between Gentoo and Windows. |
|
Back to top |
|
|
sigSEGV2003 Tux's lil' helper
Joined: 11 Mar 2003 Posts: 81 Location: Kansas
|
Posted: Fri Mar 12, 2004 4:34 am Post subject: |
|
|
IMO, that seems fairly good. Would be about 133Mbps. How fast are your hard drives? |
|
Back to top |
|
|
sigSEGV2003 Tux's lil' helper
Joined: 11 Mar 2003 Posts: 81 Location: Kansas
|
Posted: Fri Mar 12, 2004 4:36 am Post subject: |
|
|
Try bwmon or iftop to monitor your utilization. |
|
Back to top |
|
|
GetCool Guru
Joined: 23 Nov 2003 Posts: 324 Location: Madison, Wisconsin
|
Posted: Fri Mar 12, 2004 5:28 am Post subject: |
|
|
sigSEGV2003 wrote: | IMO, that seems fairly good. Would be about 133Mbps. How fast are your hard drives? |
It's definitely not slow, but these are gigabit NICs. If I'm not mistaken the theoretical efficiency of a cat 5(e) network tops out somewhere around 80% (I remember reading that somewhere, but I don't know how true it is), which would mean I could potentially be squeezing out at least a little more. But what do I know.
BTW I'm using a 10,000rpm SATA WD "raptor" HD. According to Storage Review it's transfer rate tops out at ~60MBps on the outer edge and bottoms at ~45MBps on the inner.
sigSEGV2003 wrote: | Try bwmon or iftop to monitor your utilization. |
Thanks, I will give one of these a try. |
|
Back to top |
|
|
eNTi Veteran
Joined: 20 Oct 2002 Posts: 1011 Location: Salzburg, Austria
|
Posted: Thu Apr 29, 2004 10:47 pm Post subject: |
|
|
lol? i'm getting 5-7MByte/s on my gigabit network!!! _________________ If you fall off a cliff, you might as well try to fly. After all, you got nothing to lose.
-- John Sheridan - Babylon 5, Season 4 |
|
Back to top |
|
|
Mnemia Guru
Joined: 17 May 2002 Posts: 476
|
Posted: Thu Apr 29, 2004 11:00 pm Post subject: |
|
|
How slow are the machines? On some fast machines I was able to get the Gigabit network to transfer up to about 750 Mbps, but on some older 600 MHz PIII machines I could only get the transfer rate up to about 350-400 Mbps. Things like the speed of your memory bus might make a difference.
You also might consider looking into some TCP performance tuning stuff, but I kinda doubt that that is the problem. Since your "network" probably has almost no latency it's probably not exceeding the TCP window size etc.
Try using tcpdump/Ethereal and trying to see if any weird stuff is going on, like heavy fragmentation. |
|
Back to top |
|
|
MrMullen n00b
Joined: 24 Jan 2003 Posts: 27
|
Posted: Thu Apr 29, 2004 11:16 pm Post subject: Advise |
|
|
The default networking tuning was not setup for 1000 Mbit. You should really tune out the TCP/IP stack before you conduct tests. I have worked with 1000Mbit in a enterprise eviroment and the default tuning for Linux is pretty bad. However, the good news is that there is a buttload of information to be found and it easy to get this tuning information in the stack without rebooting. |
|
Back to top |
|
|
Pax-UX n00b
Joined: 20 Feb 2004 Posts: 65
|
Posted: Mon Aug 02, 2004 12:56 am Post subject: |
|
|
I'm currently have the same problem with my linux 2.4 server running PIII 750 and 1Gb card, ATA100/133 a mix of each. Max speed for a file transfer is 5.7MB sometimes up to 7MB max, but mostly 5.7.
Did you manage to fix your problem with speed? As I don't think its a hard drive issue on my system. Do you know the links to any good TCP stack tunning guides? |
|
Back to top |
|
|
Pax-UX n00b
Joined: 20 Feb 2004 Posts: 65
|
Posted: Tue Aug 10, 2004 6:16 am Post subject: |
|
|
I found my problem, all the transfers were going through the SSH daemon for some reason, so I was maxing out my CPU 100% on my 750Mhz PIII. I ran iftop and then checked the normal top at the same time and saw that it was a CPU limitation. I'm going to look into removing the need for SSH on the transfers, as I do most of this stuff with rsync. |
|
Back to top |
|
|
Paladine01 Tux's lil' helper
Joined: 17 Dec 2003 Posts: 131 Location: Phoenix AZ
|
Posted: Tue Aug 10, 2004 2:53 pm Post subject: |
|
|
Try to enable Jumbo Frames on your card. An mtu around 9000 is desirable. It will ease the burden on your CPU and increase your network utilization. |
|
Back to top |
|
|
Pax-UX n00b
Joined: 20 Feb 2004 Posts: 65
|
Posted: Wed Aug 11, 2004 5:43 am Post subject: |
|
|
I have a 1Gb CNet 5 Port hub for the servers with a link to a normal 24 port 100Mb hub. Would this change effect all comunication with them, as I have little experence chaning the MTU setting? Also do you know if you need to have a hub that will support this? (i.e. is this non-standard? or just a new way of looking at network optimization? I've read a little before about Jumbo packets but was unsure if it would be compatable) |
|
Back to top |
|
|
|