Gentoo Forums
Gentoo Forums
Gentoo Forums
Quick Search: in
Pro GPU? - Gentoo (used) workstation build
View unanswered posts
View posts from last 24 hours

 
Reply to topic    Gentoo Forums Forum Index Other Things Gentoo
View previous topic :: View next topic  
Author Message
Zucca
Moderator
Moderator


Joined: 14 Jun 2007
Posts: 3928
Location: Rasi, Finland

PostPosted: Tue Jan 21, 2025 5:12 pm    Post subject: Pro GPU? - Gentoo (used) workstation build Reply with quote

This is a bit like a continuation to my earlier topic of if I should choose dual CPU or not.

I chose to go with dual CPU. For the base, I bought a used Dell Precision Tower 7810.
This is good opportunity to learn the possible quirks of such system. I stuffed it with 8x32GB of RAM.
I also found a pair of Xeon E5-2697 V4s just for 70€ (about the same in USD). I'll install them later. It now has Xeon E5-2620v3s (Which I probably move to my server later... that's another story).

I plan to use at least two 4k displays with the workstation. I'll maybe add third display there (1600x1920).
I've been looking at used Radeon Pro GPUs, but also non-pro.

Now... If I buy, say Radeon WX9100, will it work just fine with amdgpu drivers? Can I utilize GPGPU just like if it was a "consumer" GPU?

Any suggestions for a (better) gpu for my setup? PCIe in this workstation is 3.0 and the setup can generally accept a GPU of around 300W of power.
I don't want to fight with nvidia GPUs. I use wayland and it seems nvidia isn't there yet. I also don't like to use their closed source drivers. So the other ones would be Intel GPUs. But does my PCIe 3.0 bottleneck them?
_________________
..: Zucca :..

My gentoo installs:
init=/sbin/openrc-init
-systemd -logind -elogind seatd

Quote:
I am NaN! I am a man!


Last edited by Zucca on Thu Jan 30, 2025 7:52 am; edited 1 time in total
Back to top
View user's profile Send private message
NeddySeagoon
Administrator
Administrator


Joined: 05 Jul 2003
Posts: 54820
Location: 56N 3W

PostPosted: Fri Jan 24, 2025 1:30 pm    Post subject: Reply with quote

Zucca,

Before your topic sinks to oblivion, I'll post what I know.

When I put together my bucket list PC at the end of 2021 I looked at second hand AMD Pro graphics cards.
Consumer graphics cards were like hens teeth and stupid prices at the time.
I was not considering a second hand consumer graphics card, as they tend to be thrashed within an inch of their lives by 'miners'.
In the end, I kept my old graphics card for a while.

None of the rest of this is tested.
My research suggested that the Pro cards use consumer GPUs. They are not supposed to support gaming. So that's OK.
The inference is that they will work with AMDGPU, but as I say, I did not put my money on that.

Some supporting cirumstantial evidence can be found on cateee.net
Code:
vendor: 1002 ("Advanced Micro Devices, Inc. [AMD/ATI]"), device: 73a2 ("Navi 21 Pro-XTA [Radeon Pro W6900X]")
vendor: 1002 ("Advanced Micro Devices, Inc. [AMD/ATI]"), device: 73a3 ("Navi 21 GL-XL [Radeon PRO W6800]")
vendor: 1002 ("Advanced Micro Devices, Inc. [AMD/ATI]"), device: 73a5 ("Navi 21 [Radeon RX 6950 XT]")
vendor: 1002 ("Advanced Micro Devices, Inc. [AMD/ATI]"), device: 73a8
vendor: 1002 ("Advanced Micro Devices, Inc. [AMD/ATI]"), device: 73a9
vendor: 1002 ("Advanced Micro Devices, Inc. [AMD/ATI]"), device: 73ab ("Navi 21 Pro-XLA [Radeon Pro W6800X/Radeon Pro W6800X Duo]")

and the Pro series usually use W in their names, as per the above snippet.

The Radeon Pro W6800X is on ebay just now for more that I paid for the rest of my PC.
Beware 'engineering samples' they may be slow and defective in other ways.
_________________
Regards,

NeddySeagoon

Computer users fall into two groups:-
those that do backups
those that have never had a hard drive fail.
Back to top
View user's profile Send private message
Zucca
Moderator
Moderator


Joined: 14 Jun 2007
Posts: 3928
Location: Rasi, Finland

PostPosted: Fri Jan 24, 2025 9:35 pm    Post subject: Reply with quote

Thanks Neddy.
I already bought Radeon Pro 320V, which is a data center GPU, but it's also same as WX 8200, I believe.
The price was around 170€ with postage. It's pretty the same as WX 9100, but has half the VRAM - 8GB. I may regret this choice.
Oh well.. I can put it on my server if I were to buy WX 9100...

I'll update this topic when I have tested the GPU.
_________________
..: Zucca :..

My gentoo installs:
init=/sbin/openrc-init
-systemd -logind -elogind seatd

Quote:
I am NaN! I am a man!
Back to top
View user's profile Send private message
ian.au
l33t
l33t


Joined: 07 Apr 2011
Posts: 609
Location: Australia

PostPosted: Sat Jan 25, 2025 12:44 am    Post subject: Reply with quote

Zucca wrote:
Thanks Neddy.
I already bought Radeon Pro 320V, which is a data center GPU, but it's also same as WX 8200, I believe.
The price was around 170€ with postage. It's pretty the same as WX 9100, but has half the VRAM - 8GB. I may regret this choice.
Oh well.. I can put it on my server if I were to buy WX 9100...

I'll update this topic when I have tested the GPU.


I'm just subbing in really, as I like these projects - they remind me of how I got started with Gentoo.

Re the Radeon Pro320V I'm almost certain you'll get that running without too many issues, and won't be surprised if it works out of the box tbh.

Why do you think you'll regret this choice?
Back to top
View user's profile Send private message
Zucca
Moderator
Moderator


Joined: 14 Jun 2007
Posts: 3928
Location: Rasi, Finland

PostPosted: Sat Jan 25, 2025 6:53 am    Post subject: Reply with quote

ian.au wrote:
Why do you think you'll regret this choice?
Because WX 9100 has 16GB of HBM.
_________________
..: Zucca :..

My gentoo installs:
init=/sbin/openrc-init
-systemd -logind -elogind seatd

Quote:
I am NaN! I am a man!
Back to top
View user's profile Send private message
ian.au
l33t
l33t


Joined: 07 Apr 2011
Posts: 609
Location: Australia

PostPosted: Mon Jan 27, 2025 1:08 am    Post subject: Reply with quote

Zucca wrote:
ian.au wrote:
Why do you think you'll regret this choice?
Because WX 9100 has 16GB of HBM.

For a build/VM host would it matter, though? Or is the brief evolving? ;)
Back to top
View user's profile Send private message
Zucca
Moderator
Moderator


Joined: 14 Jun 2007
Posts: 3928
Location: Rasi, Finland

PostPosted: Mon Jan 27, 2025 8:39 am    Post subject: 2 Reply with quote

This build has been a workstation from the start. But, yes, I do plan to run all kinds of containers and VMs in there, mainly to test out different programs etc on different environments. Also (when up) it could serve binaries.

But I'd like to have as much VRAM as possible (preferably HBM2), because I have two 4k displays.
Anyway... If I find myself in a need for more VRAM I can always upgrade later. V320 will suffice until that time comes.
_________________
..: Zucca :..

My gentoo installs:
init=/sbin/openrc-init
-systemd -logind -elogind seatd

Quote:
I am NaN! I am a man!
Back to top
View user's profile Send private message
NeddySeagoon
Administrator
Administrator


Joined: 05 Jul 2003
Posts: 54820
Location: 56N 3W

PostPosted: Mon Jan 27, 2025 10:11 am    Post subject: Reply with quote

Zucca,

A 4k display is 3840 × 2160 pixels, each pixel requires 4 bytes of VRAM. That's a total of 33,177,600 bytes.
For double buffering of a single display, that's 66,355,200 bytes.
Twice as much for two displays or just over 128MB. Say 256MB for cash and some leg room.

What will you use the rest of the VRAM for?
Not textures unless you do 3D gaming.
Some extra VRAM is good so that the GPU can compose 'tiles' outside the pixel buffers then 'blit' them into the right place,
_________________
Regards,

NeddySeagoon

Computer users fall into two groups:-
those that do backups
those that have never had a hard drive fail.
Back to top
View user's profile Send private message
Zucca
Moderator
Moderator


Joined: 14 Jun 2007
Posts: 3928
Location: Rasi, Finland

PostPosted: Mon Jan 27, 2025 6:41 pm    Post subject: Reply with quote

NeddySeagoon wrote:
each pixel requires 4 bytes of VRAM.
Ok. Bytes. So that's 8x in bits. Seems like I have little to worry about. Even if using some HDR (10-bit) mode.

But then there's OpenCL and other GPGPU things. I'll never know how much those like VRAM. But I have to admit, my R9 Nano with 4GB of HBM(1) likely never exceeded it's VRAM limit.
My philosophy with PC upgrades has been to "go overkill" with memory. This time I've found that (current) used workstations can provide enough performance for me, especially in the memory department. But with GPUs... I'm not actually sure, so I doubted with the 8GB model as my previous was 4GB.

Oh well. I guess I'll upgrade if I start to hit the limit.
_________________
..: Zucca :..

My gentoo installs:
init=/sbin/openrc-init
-systemd -logind -elogind seatd

Quote:
I am NaN! I am a man!
Back to top
View user's profile Send private message
NeddySeagoon
Administrator
Administrator


Joined: 05 Jul 2003
Posts: 54820
Location: 56N 3W

PostPosted: Mon Jan 27, 2025 7:21 pm    Post subject: Reply with quote

Zucca,

Even HDR 10bit, fits in four bytes. The Alpha channel is reduced to two bits.
_________________
Regards,

NeddySeagoon

Computer users fall into two groups:-
those that do backups
those that have never had a hard drive fail.
Back to top
View user's profile Send private message
Zucca
Moderator
Moderator


Joined: 14 Jun 2007
Posts: 3928
Location: Rasi, Finland

PostPosted: Wed Jan 29, 2025 7:34 am    Post subject: Reply with quote

Wait?
Alpha channel?

I always thought that
  • SDR is 8-bits + 8-bits + 8-bits == 24-bits per pixel
  • HDR is 10-bits + 10-bits + 10-bits == 30-bits per pixel

... So yes. HDR is just two bits off of full 4 bytes. But then SDR would be exactly 3 bytes.

... at least when we're speaking of RGB. I'm not too familiar with the other pixel formats and how much memory they take.
_________________
..: Zucca :..

My gentoo installs:
init=/sbin/openrc-init
-systemd -logind -elogind seatd

Quote:
I am NaN! I am a man!
Back to top
View user's profile Send private message
NeddySeagoon
Administrator
Administrator


Joined: 05 Jul 2003
Posts: 54820
Location: 56N 3W

PostPosted: Wed Jan 29, 2025 5:37 pm    Post subject: Reply with quote

Zucca,

For 8 bit colour you have 8 bits per pixel, plus 8 bits for transparency, also known as Alpha. That gives 32 bits per pixel
For 10 bit HDR 30 bits are used for the colours 10 bits each) and only 2 bits left for transparency. Its the same 32 bits per pixel.

The 80x6 range of CPUs have never had any instructions to work with 3 byte wide data elements, so pixels have always been 1, 8, 16 or 32 bits.
_________________
Regards,

NeddySeagoon

Computer users fall into two groups:-
those that do backups
those that have never had a hard drive fail.
Back to top
View user's profile Send private message
Zucca
Moderator
Moderator


Joined: 14 Jun 2007
Posts: 3928
Location: Rasi, Finland

PostPosted: Wed Jan 29, 2025 7:46 pm    Post subject: Reply with quote

NeddySeagoon wrote:
The 80x6 range of CPUs have never had any instructions to work with 3 byte wide data elements, so pixels have always been 1, 8, 16 or 32 bits.
Now that makes sense...

I'm still baffled about the alpha channel... I mean, image formats can have alpha channel, like PNG, but raw RGB?
_________________
..: Zucca :..

My gentoo installs:
init=/sbin/openrc-init
-systemd -logind -elogind seatd

Quote:
I am NaN! I am a man!
Back to top
View user's profile Send private message
NeddySeagoon
Administrator
Administrator


Joined: 05 Jul 2003
Posts: 54820
Location: 56N 3W

PostPosted: Wed Jan 29, 2025 7:52 pm    Post subject: Reply with quote

Zucca,

RGB and the like waste the 'spare' byte or two bits, in every pixel.
_________________
Regards,

NeddySeagoon

Computer users fall into two groups:-
those that do backups
those that have never had a hard drive fail.
Back to top
View user's profile Send private message
wanne32
Tux's lil' helper
Tux's lil' helper


Joined: 11 Nov 2023
Posts: 85

PostPosted: Wed Jan 29, 2025 9:17 pm    Post subject: Reply with quote

The problem will be not so much the FirePro part than its age. While CGN 2 is the first officially supported Generation of the amdgpu-driver and AMD Radeon FirePro W9100s pci-device code 67A0 is explicitely listed as supported I would expect some hick ups. amdgpu was not around when the W9100 was released and AMD still recommends the old AMD Pro drivers. (It is very common for AMD that they support one GPU in 2 or 3 different drivers and the recommendations are often not very accurate.) On the other hand even the even older W4100 is reported to work unofficially but fine with amdgpu.
Quote:
But then there's OpenCL and other GPGPU things. I'll never know how much those like VRAM.
It depends very much on what you are doing. For molecular simulations double-FLOPS is all that counts and Memory is measured in double digit Megabytes. Most non scientific applications won't use double at all. For CAD-Rendering Memory and its speed is the much more relevant part and if you are running image filters you won't have to care about anythong than PCI-Speed. This is a mayor drawback of the W9100: PCIe 3.0 is only half the speed of PCIe 4.0. But since your CPU doesn't support any higher speed any way it doesn't make a difference. Double speed Tops even the RX 7900 XTX by factor 2.5. But it is 10 times slower on single precision and it can not do half precision at all, wich will make many Deep Learning things not run at all.

So if your only application is showing an desktop I would go for a much cheaper variant and upgrade according to my needs.
Back to top
View user's profile Send private message
Zucca
Moderator
Moderator


Joined: 14 Jun 2007
Posts: 3928
Location: Rasi, Finland

PostPosted: Thu Jan 30, 2025 7:51 am    Post subject: Reply with quote

wanne32,
Thanks for your input, but It seems I've typoed the model I mentioned in my first post. I meant WX9100 not W9100 (AMD is really bad at naming its products).

I'll fix this in the original post.
_________________
..: Zucca :..

My gentoo installs:
init=/sbin/openrc-init
-systemd -logind -elogind seatd

Quote:
I am NaN! I am a man!
Back to top
View user's profile Send private message
wanne32
Tux's lil' helper
Tux's lil' helper


Joined: 11 Nov 2023
Posts: 85

PostPosted: Sun Feb 02, 2025 9:42 pm    Post subject: Reply with quote

Zucca wrote:
Thanks for your input, but It seems I've typoed the model I mentioned in my first post. I meant WX9100 not W9100

The WX9100 should work flawlessly with the amdgpu-driver.
Zucca wrote:
(AMD is really bad at naming its products).
yes!
GeForce PCX 5900 vs. GeForce GTX 590 vs GeForce RTX 5090 is barely better. Pretty sure there are even more similar names. We are just more used to it.
Back to top
View user's profile Send private message
Zucca
Moderator
Moderator


Joined: 14 Jun 2007
Posts: 3928
Location: Rasi, Finland

PostPosted: Sun Feb 02, 2025 11:09 pm    Post subject: Reply with quote

wanne32 wrote:
The WX9100 should work flawlessly with the amdgpu-driver.
So should the V320, which I bought. It's pretty similar, but with 8GB of HBM2 instead of 16.
_________________
..: Zucca :..

My gentoo installs:
init=/sbin/openrc-init
-systemd -logind -elogind seatd

Quote:
I am NaN! I am a man!
Back to top
View user's profile Send private message
Zucca
Moderator
Moderator


Joined: 14 Jun 2007
Posts: 3928
Location: Rasi, Finland

PostPosted: Wed Feb 05, 2025 6:49 pm    Post subject: I accidentally bought a Google Stadia developer GPU Reply with quote

Oh boy what a ride it has been for the last two days...

So at first I didn't get any display output, no matter what. Did a CMOS reset and all.
After a bit of digging around the internet I found several clues to what's been going on: I've accidentally bought a Google Stadia developer workstation GPU.
Normally these GPUs are part of a (customized for Google?) Lenovo P520 ThinkStation. One source for this claim.
I believe this GPU doesn't differ from WX 8200 in any other way than BIOS/firmware being slightly different.

I fitted my workstation with R7 250E to get some display output. And it worked fine. I Adjusted few setting in the BIOS and specifically set PCIe slot 2 as the main "VGA slot". Then swapped the V320 back.
Then after a lot of troubleshooting I realized that SATA0 port needs to be populated or else the PC won't boot very far (I believe there's a fix for that If update the BIOS).
Ok now I finally see the GRUB menu with the V320. But I only see the very first kernel message and then the screen freezes. The boot process continues and I can see it getting an ip.
So back goes the R7 250E.
Then booting into Gentoo Live and I get past the GRUB. Yay! Things are working now, but... V320 is now on the shelf. :D

I've encountered this kind of incompatibility before.
A HP prebuilt - If I changed the GPU from the original I couldn't get any display output until kernel had loaded the drivers. So to access bios I needed to swap the original GPU back.

After inspecting the output of lspci -k I saw that Gentoo live media doesn't include amdgpu (why would it, really). So I have hopes that when I get to load amdgpu things that to work.
One thing that was interesting is that the boot up to GRUB (before kernel) I could get 4k signal out of the V320. But after kernel loads the display output freezes. So If I could keep the graphics as-is after kernel loads, I could be using the V320 already now.

Now. Enough rambling. I think I'll try some graphical live iso to test out if amdgpu can bring the display output back.

Now if anyone has any experiences with issues like this... please speak up. Or even if you have some sort of guesses what might solve the screen freezing... please seak up. ;)

P.S. If all fails, I might as well try to flash WX 8200 firmware onto V320.
_________________
..: Zucca :..

My gentoo installs:
init=/sbin/openrc-init
-systemd -logind -elogind seatd

Quote:
I am NaN! I am a man!
Back to top
View user's profile Send private message
NeddySeagoon
Administrator
Administrator


Joined: 05 Jul 2003
Posts: 54820
Location: 56N 3W

PostPosted: Wed Feb 05, 2025 8:20 pm    Post subject: Reply with quote

Zucca,

Missing firmware?

amdgpu built in and not as a module?

What does
Code:
lspci -nnk
say about the card?
If you can't get anything on the console, ssh in and get lspci, dmesg and friends.
_________________
Regards,

NeddySeagoon

Computer users fall into two groups:-
those that do backups
those that have never had a hard drive fail.
Back to top
View user's profile Send private message
Zucca
Moderator
Moderator


Joined: 14 Jun 2007
Posts: 3928
Location: Rasi, Finland

PostPosted: Wed Feb 05, 2025 8:37 pm    Post subject: Reply with quote

Neddy,

Currently I have the R7 250E installed. V320 on the shelf. :)
Anyways:
*snip* of lspci -nnk:
03:00.0 VGA compatible controller [0300]: Advanced Micro Devices, Inc. [AMD/ATI] Cape Verde PRO [Radeon HD 7750/8740 / R7 250E] [1002:683f]
I don't see amdgpu there. Also
Code:
zfgrep -i amdgpu /proc/config.gz
does not return any lines... not even # <KCONF> is not set.
That's all on Gentoo livecd.
_________________
..: Zucca :..

My gentoo installs:
init=/sbin/openrc-init
-systemd -logind -elogind seatd

Quote:
I am NaN! I am a man!
Back to top
View user's profile Send private message
NeddySeagoon
Administrator
Administrator


Joined: 05 Jul 2003
Posts: 54820
Location: 56N 3W

PostPosted: Wed Feb 05, 2025 8:48 pm    Post subject: Reply with quote

Zucca,

Its the V320 we need the lspci -nnk from. Or more exactly, is it listed on cateee.net

The amdgpu driver and all its various firmware is huge. Hence its not on a minimal ISO.
However, EFI_FB should work on on EFI system or VESA_FB on a BIOS system.
_________________
Regards,

NeddySeagoon

Computer users fall into two groups:-
those that do backups
those that have never had a hard drive fail.
Back to top
View user's profile Send private message
Zucca
Moderator
Moderator


Joined: 14 Jun 2007
Posts: 3928
Location: Rasi, Finland

PostPosted: Wed Feb 05, 2025 9:04 pm    Post subject: Reply with quote

NeddySeagoon wrote:
Its the V320 we need the lspci -nnk from. Or more exactly, is it listed on cateee.net
If I boot Gentoo livecd (the minimal one) with V320 installed the screen freezes at some point between grub and kernel loading.
So I either need to
  • boot with some other live media which includes amdgpu
  • install Gentoo using R7 250E and swap the V320 in afterwards and hoping it works
  • try to tell grub and/or kernel not to touch any display setting after grub exits when booting Gentoo minimal livecd

_________________
..: Zucca :..

My gentoo installs:
init=/sbin/openrc-init
-systemd -logind -elogind seatd

Quote:
I am NaN! I am a man!
Back to top
View user's profile Send private message
NeddySeagoon
Administrator
Administrator


Joined: 05 Jul 2003
Posts: 54820
Location: 56N 3W

PostPosted: Wed Feb 05, 2025 9:17 pm    Post subject: Reply with quote

Zucca,

Fit both GPUs with the console on the R7 250E. Just so you can get the lspci?

grub has a GRAPHICS_MODE option, or something like that. If you set it to "keep" grub passes its framebuffer onto the kernel, so that the kernel can use SIMPLE_FB. That's not to say it will, just that it can.
That may not be there though.
I've only ever used grub on arm64. Its horrible there. It beats EFI stub ... just.
_________________
Regards,

NeddySeagoon

Computer users fall into two groups:-
those that do backups
those that have never had a hard drive fail.
Back to top
View user's profile Send private message
Zucca
Moderator
Moderator


Joined: 14 Jun 2007
Posts: 3928
Location: Rasi, Finland

PostPosted: Wed Feb 05, 2025 9:32 pm    Post subject: Reply with quote

NeddySeagoon wrote:
Fit both GPUs with the console on the R7 250E. Just so you can get the lspci?
Good tip.

NeddySeagoon wrote:
grub has a GRAPHICS_MODE option, or something like that. If you set it to "keep" grub passes its framebuffer onto the kernel, so that the kernel can use SIMPLE_FB. That's not to say it will, just that it can.
That may not be there though.
I might as well try. I think it's LINUX_GFX_PAYLOAD=keep, but that needs to be set as an environment variable rather than an argument to linux (kernel). I think by pressing 'e' I could add a line before the line where linux is loaded.
NeddySeagoon wrote:
I've only ever used grub on arm64. Its horrible there. It beats EFI stub ... just.
I've planned to hand write grub config (script) for a long time. I just don't like the mess grub bash scripts do when they update the config (script). So far I've been using limited, but simple, rEFInd.

However, it's getting late here. If I don't reply soon, I've fallen asleep. :)
_________________
..: Zucca :..

My gentoo installs:
init=/sbin/openrc-init
-systemd -logind -elogind seatd

Quote:
I am NaN! I am a man!
Back to top
View user's profile Send private message
Display posts from previous:   
Reply to topic    Gentoo Forums Forum Index Other Things Gentoo All times are GMT
Page 1 of 1

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum