View previous topic :: View next topic |
Author |
Message |
eccerr0r Watchman
![Watchman Watchman](/images/ranks/rank-G-2-watchman.gif)
Joined: 01 Jul 2004 Posts: 9752 Location: almost Mile High in the USA
|
Posted: Mon Jul 08, 2024 1:19 pm Post subject: emerge --jobs>1, distcc, and different PORTAGE_TMPDIR ... |
|
|
I was wondering about this anomaly which has been vexing me, though it still seems to be "working" somewhat...
I'm currently building chromium and qtwebengine at the same time due to emerge --jobs=2 . I have PORTAGE_TMPDIR set to different directories with different environments.
However both emerges have separate DISTCC_DIRs because DISTCC_DIR is based off of PORTAGE_TMPDIR ? So basically, the two builds don't know about the jobs that the other build is doing as they have separate scoreboards.
I'm just trying to investigate why some of my distcc machines are actually idle while both merges are happening. My guess is that as usual, the load average of the job submitter is constantly getting exceeded but this doesn't appear to be the case.
Anyway I was trying to see what I can do with distcc and my new to me 10 core/20 thread/64GiB distcc helper that can definitely handle 20 huge c++ jobs at the same time.
--
hmm qtwebengine just finished and chromium is still building...
2024-07-08T04:28:27 >>> dev-qt/qtwebengine-5.15.14_p20240510: 2:38:46
2024-07-08T03:22:54 >>> www-client/chromium-126.0.6478.126: 3:48:41... (686 of 712) ETA: 2:18:51 (average run)
So far the additional cores does not look like it's helping much as both the distcc and distccd box have idle cores despite build.log seemingly having jobs ready to submit...
--
Okay this is probably the smoking gun, I see that chromium is failing a lot of distcc jobs:
distcc[84379] (dcc_build_somewhere) Warning: failed to distribute, running locally instead
maybe a helper somewhere that's killing the whole system...?
--
Chromium is now the last job of 712 that needs to complete and only now I'm seeing full CPU utilization...
--
and it finished.
2024-07-08T03:22:54 >>> www-client/chromium-126.0.6478.126: 7:18:50 _________________ Intel Core i7 2700K/Radeon R7 250/24GB DDR3/256GB SSD
What am I supposed watching? |
|
Back to top |
|
![](templates/gentoo/images/spacer.gif) |
Zucca Moderator
![Moderator Moderator](/images/ranks/rank-mod.gif)
![](images/avatars/1241878214609aa5b503437.gif)
Joined: 14 Jun 2007 Posts: 3617 Location: Rasi, Finland
|
Posted: Mon Aug 19, 2024 5:50 pm Post subject: |
|
|
I wonder if this is related... _________________ ..: Zucca :..
Gentoo IRC channels reside on Libera.Chat.
--
Quote: | I am NaN! I am a man! |
|
|
Back to top |
|
![](templates/gentoo/images/spacer.gif) |
eccerr0r Watchman
![Watchman Watchman](/images/ranks/rank-G-2-watchman.gif)
Joined: 01 Jul 2004 Posts: 9752 Location: almost Mile High in the USA
|
Posted: Mon Aug 19, 2024 6:05 pm Post subject: |
|
|
Yeah, the job failures are probably related to that bug. Seems the llvm/clang versions are really not compatible with each other and mixing doesn't work. So to update machines with old llvm/clang I need to have the "fresher" machines retain the old llvm/clang to help out the machines that are updated later...
Unfortunately some machines disk space is at a premium... _________________ Intel Core i7 2700K/Radeon R7 250/24GB DDR3/256GB SSD
What am I supposed watching? |
|
Back to top |
|
![](templates/gentoo/images/spacer.gif) |
|
|
You cannot post new topics in this forum You cannot reply to topics in this forum You cannot edit your posts in this forum You cannot delete your posts in this forum You cannot vote in polls in this forum
|
|