View previous topic :: View next topic |
Author |
Message |
Zucca Moderator
Joined: 14 Jun 2007 Posts: 3928 Location: Rasi, Finland
|
Posted: Tue Jan 21, 2025 5:12 pm Post subject: Pro GPU? - Gentoo (used) workstation build |
|
|
This is a bit like a continuation to my earlier topic of if I should choose dual CPU or not.
I chose to go with dual CPU. For the base, I bought a used Dell Precision Tower 7810.
This is good opportunity to learn the possible quirks of such system. I stuffed it with 8x32GB of RAM.
I also found a pair of Xeon E5-2697 V4s just for 70€ (about the same in USD). I'll install them later. It now has Xeon E5-2620v3s (Which I probably move to my server later... that's another story).
I plan to use at least two 4k displays with the workstation. I'll maybe add third display there (1600x1920).
I've been looking at used Radeon Pro GPUs, but also non-pro.
Now... If I buy, say Radeon WX9100, will it work just fine with amdgpu drivers? Can I utilize GPGPU just like if it was a "consumer" GPU?
Any suggestions for a (better) gpu for my setup? PCIe in this workstation is 3.0 and the setup can generally accept a GPU of around 300W of power.
I don't want to fight with nvidia GPUs. I use wayland and it seems nvidia isn't there yet. I also don't like to use their closed source drivers. So the other ones would be Intel GPUs. But does my PCIe 3.0 bottleneck them? _________________ ..: Zucca :..
My gentoo installs: | init=/sbin/openrc-init
-systemd -logind -elogind seatd |
Quote: | I am NaN! I am a man! |
Last edited by Zucca on Thu Jan 30, 2025 7:52 am; edited 1 time in total |
|
Back to top |
|
|
NeddySeagoon Administrator
Joined: 05 Jul 2003 Posts: 54820 Location: 56N 3W
|
Posted: Fri Jan 24, 2025 1:30 pm Post subject: |
|
|
Zucca,
Before your topic sinks to oblivion, I'll post what I know.
When I put together my bucket list PC at the end of 2021 I looked at second hand AMD Pro graphics cards.
Consumer graphics cards were like hens teeth and stupid prices at the time.
I was not considering a second hand consumer graphics card, as they tend to be thrashed within an inch of their lives by 'miners'.
In the end, I kept my old graphics card for a while.
None of the rest of this is tested.
My research suggested that the Pro cards use consumer GPUs. They are not supposed to support gaming. So that's OK.
The inference is that they will work with AMDGPU, but as I say, I did not put my money on that.
Some supporting cirumstantial evidence can be found on cateee.net
Code: | vendor: 1002 ("Advanced Micro Devices, Inc. [AMD/ATI]"), device: 73a2 ("Navi 21 Pro-XTA [Radeon Pro W6900X]")
vendor: 1002 ("Advanced Micro Devices, Inc. [AMD/ATI]"), device: 73a3 ("Navi 21 GL-XL [Radeon PRO W6800]")
vendor: 1002 ("Advanced Micro Devices, Inc. [AMD/ATI]"), device: 73a5 ("Navi 21 [Radeon RX 6950 XT]")
vendor: 1002 ("Advanced Micro Devices, Inc. [AMD/ATI]"), device: 73a8
vendor: 1002 ("Advanced Micro Devices, Inc. [AMD/ATI]"), device: 73a9
vendor: 1002 ("Advanced Micro Devices, Inc. [AMD/ATI]"), device: 73ab ("Navi 21 Pro-XLA [Radeon Pro W6800X/Radeon Pro W6800X Duo]") |
and the Pro series usually use W in their names, as per the above snippet.
The Radeon Pro W6800X is on ebay just now for more that I paid for the rest of my PC.
Beware 'engineering samples' they may be slow and defective in other ways. _________________ Regards,
NeddySeagoon
Computer users fall into two groups:-
those that do backups
those that have never had a hard drive fail. |
|
Back to top |
|
|
Zucca Moderator
Joined: 14 Jun 2007 Posts: 3928 Location: Rasi, Finland
|
Posted: Fri Jan 24, 2025 9:35 pm Post subject: |
|
|
Thanks Neddy.
I already bought Radeon Pro 320V, which is a data center GPU, but it's also same as WX 8200, I believe.
The price was around 170€ with postage. It's pretty the same as WX 9100, but has half the VRAM - 8GB. I may regret this choice.
Oh well.. I can put it on my server if I were to buy WX 9100...
I'll update this topic when I have tested the GPU. _________________ ..: Zucca :..
My gentoo installs: | init=/sbin/openrc-init
-systemd -logind -elogind seatd |
Quote: | I am NaN! I am a man! |
|
|
Back to top |
|
|
ian.au l33t
Joined: 07 Apr 2011 Posts: 609 Location: Australia
|
Posted: Sat Jan 25, 2025 12:44 am Post subject: |
|
|
Zucca wrote: | Thanks Neddy.
I already bought Radeon Pro 320V, which is a data center GPU, but it's also same as WX 8200, I believe.
The price was around 170€ with postage. It's pretty the same as WX 9100, but has half the VRAM - 8GB. I may regret this choice.
Oh well.. I can put it on my server if I were to buy WX 9100...
I'll update this topic when I have tested the GPU. |
I'm just subbing in really, as I like these projects - they remind me of how I got started with Gentoo.
Re the Radeon Pro320V I'm almost certain you'll get that running without too many issues, and won't be surprised if it works out of the box tbh.
Why do you think you'll regret this choice? |
|
Back to top |
|
|
Zucca Moderator
Joined: 14 Jun 2007 Posts: 3928 Location: Rasi, Finland
|
Posted: Sat Jan 25, 2025 6:53 am Post subject: |
|
|
ian.au wrote: | Why do you think you'll regret this choice? | Because WX 9100 has 16GB of HBM. _________________ ..: Zucca :..
My gentoo installs: | init=/sbin/openrc-init
-systemd -logind -elogind seatd |
Quote: | I am NaN! I am a man! |
|
|
Back to top |
|
|
ian.au l33t
Joined: 07 Apr 2011 Posts: 609 Location: Australia
|
Posted: Mon Jan 27, 2025 1:08 am Post subject: |
|
|
Zucca wrote: | ian.au wrote: | Why do you think you'll regret this choice? | Because WX 9100 has 16GB of HBM. |
For a build/VM host would it matter, though? Or is the brief evolving? |
|
Back to top |
|
|
Zucca Moderator
Joined: 14 Jun 2007 Posts: 3928 Location: Rasi, Finland
|
Posted: Mon Jan 27, 2025 8:39 am Post subject: 2 |
|
|
This build has been a workstation from the start. But, yes, I do plan to run all kinds of containers and VMs in there, mainly to test out different programs etc on different environments. Also (when up) it could serve binaries.
But I'd like to have as much VRAM as possible (preferably HBM2), because I have two 4k displays.
Anyway... If I find myself in a need for more VRAM I can always upgrade later. V320 will suffice until that time comes. _________________ ..: Zucca :..
My gentoo installs: | init=/sbin/openrc-init
-systemd -logind -elogind seatd |
Quote: | I am NaN! I am a man! |
|
|
Back to top |
|
|
NeddySeagoon Administrator
Joined: 05 Jul 2003 Posts: 54820 Location: 56N 3W
|
Posted: Mon Jan 27, 2025 10:11 am Post subject: |
|
|
Zucca,
A 4k display is 3840 × 2160 pixels, each pixel requires 4 bytes of VRAM. That's a total of 33,177,600 bytes.
For double buffering of a single display, that's 66,355,200 bytes.
Twice as much for two displays or just over 128MB. Say 256MB for cash and some leg room.
What will you use the rest of the VRAM for?
Not textures unless you do 3D gaming.
Some extra VRAM is good so that the GPU can compose 'tiles' outside the pixel buffers then 'blit' them into the right place, _________________ Regards,
NeddySeagoon
Computer users fall into two groups:-
those that do backups
those that have never had a hard drive fail. |
|
Back to top |
|
|
Zucca Moderator
Joined: 14 Jun 2007 Posts: 3928 Location: Rasi, Finland
|
Posted: Mon Jan 27, 2025 6:41 pm Post subject: |
|
|
NeddySeagoon wrote: | each pixel requires 4 bytes of VRAM. | Ok. Bytes. So that's 8x in bits. Seems like I have little to worry about. Even if using some HDR (10-bit) mode.
But then there's OpenCL and other GPGPU things. I'll never know how much those like VRAM. But I have to admit, my R9 Nano with 4GB of HBM(1) likely never exceeded it's VRAM limit.
My philosophy with PC upgrades has been to "go overkill" with memory. This time I've found that (current) used workstations can provide enough performance for me, especially in the memory department. But with GPUs... I'm not actually sure, so I doubted with the 8GB model as my previous was 4GB.
Oh well. I guess I'll upgrade if I start to hit the limit. _________________ ..: Zucca :..
My gentoo installs: | init=/sbin/openrc-init
-systemd -logind -elogind seatd |
Quote: | I am NaN! I am a man! |
|
|
Back to top |
|
|
NeddySeagoon Administrator
Joined: 05 Jul 2003 Posts: 54820 Location: 56N 3W
|
Posted: Mon Jan 27, 2025 7:21 pm Post subject: |
|
|
Zucca,
Even HDR 10bit, fits in four bytes. The Alpha channel is reduced to two bits. _________________ Regards,
NeddySeagoon
Computer users fall into two groups:-
those that do backups
those that have never had a hard drive fail. |
|
Back to top |
|
|
Zucca Moderator
Joined: 14 Jun 2007 Posts: 3928 Location: Rasi, Finland
|
Posted: Wed Jan 29, 2025 7:34 am Post subject: |
|
|
Wait?
Alpha channel?
I always thought that - SDR is 8-bits + 8-bits + 8-bits == 24-bits per pixel
- HDR is 10-bits + 10-bits + 10-bits == 30-bits per pixel
... So yes. HDR is just two bits off of full 4 bytes. But then SDR would be exactly 3 bytes.
... at least when we're speaking of RGB. I'm not too familiar with the other pixel formats and how much memory they take. _________________ ..: Zucca :..
My gentoo installs: | init=/sbin/openrc-init
-systemd -logind -elogind seatd |
Quote: | I am NaN! I am a man! |
|
|
Back to top |
|
|
NeddySeagoon Administrator
Joined: 05 Jul 2003 Posts: 54820 Location: 56N 3W
|
Posted: Wed Jan 29, 2025 5:37 pm Post subject: |
|
|
Zucca,
For 8 bit colour you have 8 bits per pixel, plus 8 bits for transparency, also known as Alpha. That gives 32 bits per pixel
For 10 bit HDR 30 bits are used for the colours 10 bits each) and only 2 bits left for transparency. Its the same 32 bits per pixel.
The 80x6 range of CPUs have never had any instructions to work with 3 byte wide data elements, so pixels have always been 1, 8, 16 or 32 bits. _________________ Regards,
NeddySeagoon
Computer users fall into two groups:-
those that do backups
those that have never had a hard drive fail. |
|
Back to top |
|
|
Zucca Moderator
Joined: 14 Jun 2007 Posts: 3928 Location: Rasi, Finland
|
Posted: Wed Jan 29, 2025 7:46 pm Post subject: |
|
|
NeddySeagoon wrote: | The 80x6 range of CPUs have never had any instructions to work with 3 byte wide data elements, so pixels have always been 1, 8, 16 or 32 bits. | Now that makes sense...
I'm still baffled about the alpha channel... I mean, image formats can have alpha channel, like PNG, but raw RGB? _________________ ..: Zucca :..
My gentoo installs: | init=/sbin/openrc-init
-systemd -logind -elogind seatd |
Quote: | I am NaN! I am a man! |
|
|
Back to top |
|
|
NeddySeagoon Administrator
Joined: 05 Jul 2003 Posts: 54820 Location: 56N 3W
|
Posted: Wed Jan 29, 2025 7:52 pm Post subject: |
|
|
Zucca,
RGB and the like waste the 'spare' byte or two bits, in every pixel. _________________ Regards,
NeddySeagoon
Computer users fall into two groups:-
those that do backups
those that have never had a hard drive fail. |
|
Back to top |
|
|
wanne32 Tux's lil' helper
Joined: 11 Nov 2023 Posts: 85
|
Posted: Wed Jan 29, 2025 9:17 pm Post subject: |
|
|
The problem will be not so much the FirePro part than its age. While CGN 2 is the first officially supported Generation of the amdgpu-driver and AMD Radeon FirePro W9100s pci-device code 67A0 is explicitely listed as supported I would expect some hick ups. amdgpu was not around when the W9100 was released and AMD still recommends the old AMD Pro drivers. (It is very common for AMD that they support one GPU in 2 or 3 different drivers and the recommendations are often not very accurate.) On the other hand even the even older W4100 is reported to work unofficially but fine with amdgpu.
Quote: | But then there's OpenCL and other GPGPU things. I'll never know how much those like VRAM. | It depends very much on what you are doing. For molecular simulations double-FLOPS is all that counts and Memory is measured in double digit Megabytes. Most non scientific applications won't use double at all. For CAD-Rendering Memory and its speed is the much more relevant part and if you are running image filters you won't have to care about anythong than PCI-Speed. This is a mayor drawback of the W9100: PCIe 3.0 is only half the speed of PCIe 4.0. But since your CPU doesn't support any higher speed any way it doesn't make a difference. Double speed Tops even the RX 7900 XTX by factor 2.5. But it is 10 times slower on single precision and it can not do half precision at all, wich will make many Deep Learning things not run at all.
So if your only application is showing an desktop I would go for a much cheaper variant and upgrade according to my needs. |
|
Back to top |
|
|
Zucca Moderator
Joined: 14 Jun 2007 Posts: 3928 Location: Rasi, Finland
|
Posted: Thu Jan 30, 2025 7:51 am Post subject: |
|
|
wanne32,
Thanks for your input, but It seems I've typoed the model I mentioned in my first post. I meant WX9100 not W9100 (AMD is really bad at naming its products).
I'll fix this in the original post. _________________ ..: Zucca :..
My gentoo installs: | init=/sbin/openrc-init
-systemd -logind -elogind seatd |
Quote: | I am NaN! I am a man! |
|
|
Back to top |
|
|
wanne32 Tux's lil' helper
Joined: 11 Nov 2023 Posts: 85
|
Posted: Sun Feb 02, 2025 9:42 pm Post subject: |
|
|
Zucca wrote: | Thanks for your input, but It seems I've typoed the model I mentioned in my first post. I meant WX9100 not W9100 |
The WX9100 should work flawlessly with the amdgpu-driver.
Zucca wrote: | (AMD is really bad at naming its products). | yes!
GeForce PCX 5900 vs. GeForce GTX 590 vs GeForce RTX 5090 is barely better. Pretty sure there are even more similar names. We are just more used to it. |
|
Back to top |
|
|
Zucca Moderator
Joined: 14 Jun 2007 Posts: 3928 Location: Rasi, Finland
|
Posted: Sun Feb 02, 2025 11:09 pm Post subject: |
|
|
wanne32 wrote: | The WX9100 should work flawlessly with the amdgpu-driver. | So should the V320, which I bought. It's pretty similar, but with 8GB of HBM2 instead of 16. _________________ ..: Zucca :..
My gentoo installs: | init=/sbin/openrc-init
-systemd -logind -elogind seatd |
Quote: | I am NaN! I am a man! |
|
|
Back to top |
|
|
Zucca Moderator
Joined: 14 Jun 2007 Posts: 3928 Location: Rasi, Finland
|
Posted: Wed Feb 05, 2025 6:49 pm Post subject: I accidentally bought a Google Stadia developer GPU |
|
|
Oh boy what a ride it has been for the last two days...
So at first I didn't get any display output, no matter what. Did a CMOS reset and all.
After a bit of digging around the internet I found several clues to what's been going on: I've accidentally bought a Google Stadia developer workstation GPU.
Normally these GPUs are part of a (customized for Google?) Lenovo P520 ThinkStation. One source for this claim.
I believe this GPU doesn't differ from WX 8200 in any other way than BIOS/firmware being slightly different.
I fitted my workstation with R7 250E to get some display output. And it worked fine. I Adjusted few setting in the BIOS and specifically set PCIe slot 2 as the main "VGA slot". Then swapped the V320 back.
Then after a lot of troubleshooting I realized that SATA0 port needs to be populated or else the PC won't boot very far (I believe there's a fix for that If update the BIOS).
Ok now I finally see the GRUB menu with the V320. But I only see the very first kernel message and then the screen freezes. The boot process continues and I can see it getting an ip.
So back goes the R7 250E.
Then booting into Gentoo Live and I get past the GRUB. Yay! Things are working now, but... V320 is now on the shelf. :D
I've encountered this kind of incompatibility before.
A HP prebuilt - If I changed the GPU from the original I couldn't get any display output until kernel had loaded the drivers. So to access bios I needed to swap the original GPU back.
After inspecting the output of lspci -k I saw that Gentoo live media doesn't include amdgpu (why would it, really). So I have hopes that when I get to load amdgpu things that to work.
One thing that was interesting is that the boot up to GRUB (before kernel) I could get 4k signal out of the V320. But after kernel loads the display output freezes. So If I could keep the graphics as-is after kernel loads, I could be using the V320 already now.
Now. Enough rambling. I think I'll try some graphical live iso to test out if amdgpu can bring the display output back.
Now if anyone has any experiences with issues like this... please speak up. Or even if you have some sort of guesses what might solve the screen freezing... please seak up. ;)
P.S. If all fails, I might as well try to flash WX 8200 firmware onto V320. _________________ ..: Zucca :..
My gentoo installs: | init=/sbin/openrc-init
-systemd -logind -elogind seatd |
Quote: | I am NaN! I am a man! |
|
|
Back to top |
|
|
NeddySeagoon Administrator
Joined: 05 Jul 2003 Posts: 54820 Location: 56N 3W
|
Posted: Wed Feb 05, 2025 8:20 pm Post subject: |
|
|
Zucca,
Missing firmware?
amdgpu built in and not as a module?
What does say about the card?
If you can't get anything on the console, ssh in and get lspci, dmesg and friends. _________________ Regards,
NeddySeagoon
Computer users fall into two groups:-
those that do backups
those that have never had a hard drive fail. |
|
Back to top |
|
|
Zucca Moderator
Joined: 14 Jun 2007 Posts: 3928 Location: Rasi, Finland
|
Posted: Wed Feb 05, 2025 8:37 pm Post subject: |
|
|
Neddy,
Currently I have the R7 250E installed. V320 on the shelf. :)
Anyways: *snip* of lspci -nnk: | 03:00.0 VGA compatible controller [0300]: Advanced Micro Devices, Inc. [AMD/ATI] Cape Verde PRO [Radeon HD 7750/8740 / R7 250E] [1002:683f] | I don't see amdgpu there. Also Code: | zfgrep -i amdgpu /proc/config.gz | does not return any lines... not even # <KCONF> is not set.
That's all on Gentoo livecd. _________________ ..: Zucca :..
My gentoo installs: | init=/sbin/openrc-init
-systemd -logind -elogind seatd |
Quote: | I am NaN! I am a man! |
|
|
Back to top |
|
|
NeddySeagoon Administrator
Joined: 05 Jul 2003 Posts: 54820 Location: 56N 3W
|
Posted: Wed Feb 05, 2025 8:48 pm Post subject: |
|
|
Zucca,
Its the V320 we need the lspci -nnk from. Or more exactly, is it listed on cateee.net
The amdgpu driver and all its various firmware is huge. Hence its not on a minimal ISO.
However, EFI_FB should work on on EFI system or VESA_FB on a BIOS system. _________________ Regards,
NeddySeagoon
Computer users fall into two groups:-
those that do backups
those that have never had a hard drive fail. |
|
Back to top |
|
|
Zucca Moderator
Joined: 14 Jun 2007 Posts: 3928 Location: Rasi, Finland
|
Posted: Wed Feb 05, 2025 9:04 pm Post subject: |
|
|
NeddySeagoon wrote: | Its the V320 we need the lspci -nnk from. Or more exactly, is it listed on cateee.net | If I boot Gentoo livecd (the minimal one) with V320 installed the screen freezes at some point between grub and kernel loading.
So I either need to - boot with some other live media which includes amdgpu
- install Gentoo using R7 250E and swap the V320 in afterwards and hoping it works
- try to tell grub and/or kernel not to touch any display setting after grub exits when booting Gentoo minimal livecd
_________________ ..: Zucca :..
My gentoo installs: | init=/sbin/openrc-init
-systemd -logind -elogind seatd |
Quote: | I am NaN! I am a man! |
|
|
Back to top |
|
|
NeddySeagoon Administrator
Joined: 05 Jul 2003 Posts: 54820 Location: 56N 3W
|
Posted: Wed Feb 05, 2025 9:17 pm Post subject: |
|
|
Zucca,
Fit both GPUs with the console on the R7 250E. Just so you can get the lspci?
grub has a GRAPHICS_MODE option, or something like that. If you set it to "keep" grub passes its framebuffer onto the kernel, so that the kernel can use SIMPLE_FB. That's not to say it will, just that it can.
That may not be there though.
I've only ever used grub on arm64. Its horrible there. It beats EFI stub ... just. _________________ Regards,
NeddySeagoon
Computer users fall into two groups:-
those that do backups
those that have never had a hard drive fail. |
|
Back to top |
|
|
Zucca Moderator
Joined: 14 Jun 2007 Posts: 3928 Location: Rasi, Finland
|
Posted: Wed Feb 05, 2025 9:32 pm Post subject: |
|
|
NeddySeagoon wrote: | Fit both GPUs with the console on the R7 250E. Just so you can get the lspci? | Good tip.
NeddySeagoon wrote: | grub has a GRAPHICS_MODE option, or something like that. If you set it to "keep" grub passes its framebuffer onto the kernel, so that the kernel can use SIMPLE_FB. That's not to say it will, just that it can.
That may not be there though. | I might as well try. I think it's LINUX_GFX_PAYLOAD=keep, but that needs to be set as an environment variable rather than an argument to linux (kernel). I think by pressing 'e' I could add a line before the line where linux is loaded.
NeddySeagoon wrote: | I've only ever used grub on arm64. Its horrible there. It beats EFI stub ... just. | I've planned to hand write grub config (script) for a long time. I just don't like the mess grub bash scripts do when they update the config (script). So far I've been using limited, but simple, rEFInd.
However, it's getting late here. If I don't reply soon, I've fallen asleep. :) _________________ ..: Zucca :..
My gentoo installs: | init=/sbin/openrc-init
-systemd -logind -elogind seatd |
Quote: | I am NaN! I am a man! |
|
|
Back to top |
|
|
|