MSI K9N SLI platinum high latencies on eth1

[rmcarlsson]

Dear forum,

I have MSI K9N SLI platinum.

lscpi is:

voldemort ~ # lspci
00:00.0 RAM memory: nVidia Corporation MCP55 Memory Controller (rev a1) 00:01.0 ISA bridge: nVidia Corporation MCP55 LPC Bridge (rev a2)
00:01.1 SMBus: nVidia Corporation MCP55 SMBus (rev a2) 00:02.0 USB Controller: nVidia Corporation MCP55 USB Controller (rev a1)
00:02.1 USB Controller: nVidia Corporation MCP55 USB Controller (rev a2) 00:04.0 IDE interface: nVidia Corporation MCP55 IDE (rev a1)
00:05.0 IDE interface: nVidia Corporation MCP55 SATA Controller (rev a2)
00:05.1 IDE interface: nVidia Corporation MCP55 SATA Controller (rev a2)
00:05.2 IDE interface: nVidia Corporation MCP55 SATA Controller (rev a2)
00:06.0 PCI bridge: nVidia Corporation MCP55 PCI bridge (rev a2)
00:08.0 Bridge: nVidia Corporation MCP55 Ethernet (rev a2)
00:09.0 Bridge: nVidia Corporation MCP55 Ethernet (rev a2)
00:0a.0 PCI bridge: nVidia Corporation MCP55 PCI Express bridge (rev a2)
00:0b.0 PCI bridge: nVidia Corporation MCP55 PCI Express bridge (rev a2)
00:0c.0 PCI bridge: nVidia Corporation MCP55 PCI Express bridge (rev a2)
00:0d.0 PCI bridge: nVidia Corporation MCP55 PCI Express bridge (rev a2)
00:0e.0 PCI bridge: nVidia Corporation MCP55 PCI Express bridge (rev a2)
00:0f.0 PCI bridge: nVidia Corporation MCP55 PCI Express bridge (rev a2)
00:18.0 Host bridge: Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] HyperTransport Technology Configuration
00:18.1 Host bridge: Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] Address Map
00:18.2 Host bridge: Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] DRAM Controller
00:18.3 Host bridge: Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] Miscellaneous Control
07:00.0 VGA compatible controller: nVidia Corporation NV41.1 [GeForce 6800] (rev a2)

As you can see I have dual onboard LAN. eth0 is working just fine, but I am experiencing high latencies on eth1. Typically ssh will hang for a couple of seconds and typically when I do commands that give "high output" like "dmesg". The machine is a home server and I have tried to strip down the kernel, I have tried to remove all boards (v4l, promise, DVB, 1-wire) and disks. Still the same problem. I have tried to enable MSI. I have switched the nic's (green->red and red->green) but the problem is still there, still on eth1.

mcelog and dmesg says nothing.

Does anyone have a clue?

I have read on the forum that this board is excellent for Linux and that there are several useful tweaks in bios. If someone has any useful information about this I would appreciate it.



/ Mikael Carlsson

[snIP3r]

hi mikael!

i have the same hardware on an ASUS M2N SLI Deluxe with no problems, so we can perhaps compare our configs and settings. please post your kernel and net config and perhaps also the output of dmesg.

HTH
snIP3r
_________________
Intel i3-4130T on ASUS P9D-X
Kernel 5.15.88-gentoo SMP
-----------------------------------------------
if your problem is fixed please add something like [solved] to the topic!

[rmcarlsson]

dmesg

[snIP3r]

hi!

i have additionally enabled the

[rmcarlsson]

Hi

thanks, I have already tried it. Will try it again though, thanks.

Any ideas about possible tweaks in bios, DMA, IRQ? Anything else?

Is there any way to tell if the board might be broken?


/ Mikael

[snIP3r]

hi!

i can only tell you about my config and i had nothing special set up. bios settings are default.

it might sound simple: bur have you checked the cable too??

HTH
snIP3r
_________________
Intel i3-4130T on ASUS P9D-X
Kernel 5.15.88-gentoo SMP
-----------------------------------------------
if your problem is fixed please add something like [solved] to the topic!

[rmcarlsson]

Good thinking but I have already checked it.

Is it possible to enable some kind of kernel debugging to detect possible problems, IRQ conflict or other resource sharing conflicts? Also is there any way to track down a possible hardware fault, lets say that my problem is broken hardware, can I detect this or test the hardware in any way?

One other thing, when I enable NAPI (rx-polling) I noticed some improvement. I still have latencies though.

/ Mikael

[snIP3r]

hmmm, you can check /proc/interrupts for errors, and also lspci -v shows some more detailed information about your hardware. -vv more than more.

also the ifconfig command can show you errors while transmitting packets...

good to hear that enabling NAPI improves the situation...

HTH
snIP3r
_________________
Intel i3-4130T on ASUS P9D-X
Kernel 5.15.88-gentoo SMP
-----------------------------------------------
if your problem is fixed please add something like [solved] to the topic!

[rmcarlsson]

[snIP3r]

hi!

looks ok for me. i see you have 3 nic's in your system. which one is the one that makes the trouble? have you tried the other one instead?

HTH
snIP3r
_________________
Intel i3-4130T on ASUS P9D-X
Kernel 5.15.88-gentoo SMP
-----------------------------------------------
if your problem is fixed please add something like [solved] to the topic!

[rmcarlsson]

The troublesome nic is this:

[snIP3r]

hmmmm, this remembers me to my own problem with the same nic (on an asus m2n-sli deluxe) but may not have any correlation to your problem. i had similar problems also with the second internal nic and resolved it the same way - by putting another nic into my server...
have you experienced the problem till first usage??

have you ever thought about a hardware defect?

HTH
snIP3r
_________________
Intel i3-4130T on ASUS P9D-X
Kernel 5.15.88-gentoo SMP
-----------------------------------------------
if your problem is fixed please add something like [solved] to the topic!

[rmcarlsson]

[snIP3r]

ok, lets give it another try: are you able to boot from a (gentoo) live-cd and check the latencies with this one?

you can e.g. boot from cd and then start the ssh server, then check for the latencies.

HTH
snIP3r
_________________
Intel i3-4130T on ASUS P9D-X
Kernel 5.15.88-gentoo SMP
-----------------------------------------------
if your problem is fixed please add something like [solved] to the topic!

[rmcarlsson]

[snIP3r]

[rmcarlsson]

Hi, I am not so sure. Have anyone seen a working system with iptables and NAT based on two nforce onboard nic's?

If I read about the nForce chipset there is a function in the chipset called dualnet. This can by used in several ways. The first mode is very similar to what I have learned is a "bridge". Two nic's and one logical interface. It should improve the bandwidth. The second mode was referred to as router. One nic for WAN and one for lan. That's how I use it (but I call mine red and green).

There is also some kind of firewall inside the chipset. "FirstPacket".

Are you sure the nForce linux driver is cabable of utilizing two onboard nforce nic's?


/ Mikael

[snIP3r]

[rmcarlsson]

Hi,

thank you so much for you time. I will send my board back to the retailer and refer to a broken nic.


/ Mikael

[snIP3r]

[rmcarlsson]

Hi,

as I stated I sent my board back. I got a replacement board within 2 weeks. The new board have a different version than the old one. Unfortunately I can not recall the revision on the old board, but I do know that the boards are different (different heat sink on NB). I can check the revision on the new board if you like.

The board is now working just fine using ip tables and nat with red and green nic onboard. I must say that this board is excellent, no problem what so ever, no driver configuration issues, no stability issues, low temperature.

So either the board was broken or the specific revision on my old board had some kind of design problem.

It is possible get the board working with our chipset, so my advice is to you to send your board back.


/ Mikael

[snIP3r]