Gentoo Forums
Gentoo Forums
Gentoo Forums
Quick Search: in
merging servers into one
View unanswered posts
View posts from last 24 hours

 
Reply to topic    Gentoo Forums Forum Index Other Things Gentoo
View previous topic :: View next topic  
Author Message
Gentoopc
Guru
Guru


Joined: 25 Dec 2017
Posts: 403

PostPosted: Tue Jan 14, 2025 8:23 am    Post subject: merging servers into one Reply with quote

Hello forum. Tell me, for example, there are three servers that I rented. Each of them has a 96-core CPU. Is there any software that will allow me to combine these servers into one and work with it as a 288-core server? Is it possible to install any desktop operating system on such a 288-core server?
Back to top
View user's profile Send private message
loravis
n00b
n00b


Joined: 29 Dec 2024
Posts: 4

PostPosted: Tue Jan 14, 2025 9:22 am    Post subject: Reply with quote

I don't think that's possible, at least I wasn't able to find something like this on the internet. What would you need this kind of setup for?
Back to top
View user's profile Send private message
alamahant
Advocate
Advocate


Joined: 23 Mar 2019
Posts: 3948

PostPosted: Tue Jan 14, 2025 9:25 am    Post subject: Reply with quote

Try Openstack and create your own personal cloud.
It will create a pool of resources and then you can create a tenant or VM with all these resources.
Or maybe VmWare has some solution for you.You have to check it out.
_________________
:)
Back to top
View user's profile Send private message
Banana
Moderator
Moderator


Joined: 21 May 2004
Posts: 1851
Location: Germany

PostPosted: Tue Jan 14, 2025 10:13 am    Post subject: Reply with quote

In short: You need to "combine" them. Like using them for virtualiziation. They would be the hosts and running on top of them would be VMs which could use the resources from the hosts.
_________________
Forum Guidelines

PFL - Portage file list - find which package a file or command belongs to.
My delta-labs.org snippets do expire
Back to top
View user's profile Send private message
pingtoo
Veteran
Veteran


Joined: 10 Sep 2021
Posts: 1456
Location: Richmond Hill, Canada

PostPosted: Tue Jan 14, 2025 11:45 am    Post subject: Re: merging servers into one Reply with quote

Gentoopc wrote:
Hello forum. Tell me, for example, there are three servers that I rented. Each of them has a 96-core CPU. Is there any software that will allow me to combine these servers into one and work with it as a 288-core server? Is it possible to install any desktop operating system on such a 288-core server?


Yes, this is will know, it is know as Distributed Computing. It is not one software, it is usually several software combined to make it work. Please see the Wikipedia reference I linked in previous sentence.
Back to top
View user's profile Send private message
Ralphred
l33t
l33t


Joined: 31 Dec 2013
Posts: 707

PostPosted: Tue Jan 14, 2025 1:48 pm    Post subject: Reply with quote

The only thing I've come across that did this was a pre-ESXi version of VMWare, it was very niche, the overhead was ridiculous (as was the infrastructure for it), and whilst it did what you are suggesting it's goal was uncommonly high "HA".
The paradigm has inverted since then, now we have promox and ceph et al running/shifting a bunch of "small" containers amongst "large" machines, instead of a bunch of "small" machines under a "large" hypervisor.
Back to top
View user's profile Send private message
szatox
Advocate
Advocate


Joined: 27 Aug 2013
Posts: 3478

PostPosted: Sun Jan 26, 2025 4:09 pm    Post subject: Reply with quote

Distributing the workload at application level is one thing; it is how people usually handle it.
Actually, when I was checking out OpenMP, I had an impression it should be able to run a single application across several physical servers. I never had enough reason to actually use it myself though. "HPC" should be a good search keyword.

However, I also vaguely remember a huge Nutanix fanboy fawning over it's ability to pool resources from multiple physical servers into a single, virtual ESX host. Like a decade ago. So I guess the answer to the original question actually is "yes". Too bad, they're now advertising their wokeness rather than technical prowess. Still, if it has been done before, chances are you could find a usable implementation of this idea.


Quote:
The only thing I've come across that did this was a pre-ESXi version of VMWare, it was very niche, the overhead was ridiculous
Are you talking about that that thing which existed before hardware support for virtualization?
Emulating a full CPU in software already wastes like 90% of its power, so yeah, it must have been slow. The goal was to make better use of hardware by stuffing multiple independent applications into a single server rather than speeding things up by throwing more hardware at the problem, so the opposite of what the OP wants.
_________________
Make Computing Fun Again
Back to top
View user's profile Send private message
NeddySeagoon
Administrator
Administrator


Joined: 05 Jul 2003
Posts: 54776
Location: 56N 3W

PostPosted: Sun Jan 26, 2025 5:03 pm    Post subject: Reply with quote

Gentoopc,

Yes its possible. How useful it would be depends on the speed of the link between the physical servers and how much data needs to be moved about.
Normally, such systems are very closely physically located and have insanely fast interconnects.

Think supercomputers running lots of nodes consisting of commodity hardware. My favourite was The Stone SouperComputer
You probably want a Beowulf cluster of some sort.

Not all problems scale well, so it would only suit the class of problems that scale to suit.
If you run say open office on 288 cores, 287.995 cores will be waiting for your input. :)
Desktops don't scale.

== edit ==

The original article from Scientific American is behind a paywall :(
This page looks close.
_________________
Regards,

NeddySeagoon

Computer users fall into two groups:-
those that do backups
those that have never had a hard drive fail.
Back to top
View user's profile Send private message
Display posts from previous:   
Reply to topic    Gentoo Forums Forum Index Other Things Gentoo All times are GMT
Page 1 of 1

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum