View previous topic :: View next topic |
Author |
Message |
myga Tux's lil' helper
Joined: 12 Jun 2023 Posts: 121
|
Posted: Sat Dec 09, 2023 5:33 am Post subject: post your build times and specs |
|
|
Hello,
***Disclaimer: this post is just to chat about packages' build time and collect information that might help others searching for it.***
I know that the wiki provide some hints about build times and RAM needed for them, but that info is not applicable to everyone and might be outdated. So, I starter searching around for anyone posting or blogging about any packages' build time and the specs used, but there is none. I was hesitant for awhile to build big packages, but today I decided to test my machine by building thunderbird and I expected it to take about 3 hrs. However, it took a lot less than that!
So, I'm hoping that you guys participate by posting your build times and specs for anyone seeking a general idea about their hardware and its capabilities.
Here are the build times of thunderbird & friends, and specs of my machine:
Code: | root@~ # genlop -t thunderbird
* mail-client/thunderbird
Fri Dec 8 23:06:02 2023 >>> mail-client/thunderbird-115.5.0
merge time: 32 minutes and 31 seconds.
root@~ # genlop -t nodejs
* net-libs/nodejs
Fri Dec 8 22:28:32 2023 >>> net-libs/nodejs-20.6.1
merge time: 27 minutes and 33 seconds.
root@~ # genlop -t openh264
* media-libs/openh264
Fri Dec 8 22:00:39 2023 >>> media-libs/openh264-2.3.1-r3
merge time: 15 seconds.
root@~ # genlop -t botan
* dev-libs/botan
Fri Dec 8 22:29:45 2023 >>> dev-libs/botan-2.19.3-r2
merge time: 1 minute and 6 seconds.
|
Code: | Host: ThinkPad P52
Kernel: 6.1.66-gentoo
CPU: Intel i7-8850H (12) @ 4.300GHz
GPU: NVIDIA Quadro P2000 Mobile
Memory: 2639MiB / 31793MiB
|
|
|
Back to top |
|
|
rfx Tux's lil' helper
Joined: 19 Apr 2023 Posts: 142 Location: de-by
|
Posted: Sat Dec 09, 2023 6:57 am Post subject: |
|
|
Code: | Kernel: 6.6.5-gentoo
CPU: Intel Core i5-6200u (4) @ 2.3 GHz
Ram: 8 GB |
Big Stuff like Thunderbird Firefox & Co. i build over night without display-manager, so i have more free Ram for compiling
Code: | genlop -t firefox thunderbird nodejs openh264 botan
* www-client/firefox
Tue Nov 14 12:31:50 2023 >>> www-client/firefox-115.4.0
merge time: 1 hour, 44 minutes.
Fri Nov 24 04:44:04 2023 >>> www-client/firefox-115.5.0
merge time: 1 hour, 36 minutes and 51 seconds.
* mail-client/thunderbird
Wed Nov 15 02:25:16 2023 >>> mail-client/thunderbird-115.4.1
merge time: 1 hour, 44 minutes and 22 seconds.
Fri Nov 24 03:07:13 2023 >>> mail-client/thunderbird-115.5.0
merge time: 1 hour, 44 minutes and 37 seconds.
* net-libs/nodejs
Tue Nov 14 10:42:49 2023 >>> net-libs/nodejs-20.6.1
merge time: 1 hour, 41 minutes and 29 seconds.
* media-libs/openh264
Mon Nov 13 13:30:50 2023 >>> media-libs/openh264-2.3.1-r3
merge time: 34 seconds.
* dev-libs/botan
Wed Nov 15 00:40:01 2023 >>> dev-libs/botan-2.19.3-r2
merge time: 3 minutes and 22 seconds.
Mon Nov 20 13:39:33 2023 >>> dev-libs/botan-2.19.3-r2
merge time: 3 minutes and 34 seconds.
|
|
|
Back to top |
|
|
eeckwrk99 Apprentice
Joined: 14 Mar 2021 Posts: 231 Location: Gentoo forums
|
Posted: Sat Dec 09, 2023 9:53 am Post subject: |
|
|
- CPU: Intel i7-5820K (12) @ 3.80 GHz
- RAM: 32 GB
- COMMON_FLAGS="-march=haswell -O2 -pipe"
- CPU_FLAGS_X86="aes avx avx2 f16c fma3 mmx mmxext pclmul popcnt rdrand sse sse2 sse3 sse4_1 sse4_2 ssse3"
-j12 -l10.8
Code: | $ emlop l -e sys-devel/llvm
2023-01-07 01:49:31 1:00:50 sys-devel/llvm-15.0.6-r1
2023-01-13 17:23:31 1:01:45 sys-devel/llvm-15.0.7
2023-03-18 17:46:50 1:12:53 sys-devel/llvm-16.0.0
2023-04-06 14:38:40 1:12:26 sys-devel/llvm-16.0.1
2023-04-20 11:04:19 1:10:53 sys-devel/llvm-16.0.2
2023-05-04 10:58:23 1:08:54 sys-devel/llvm-16.0.3
2023-05-18 08:21:09 1:06:19 sys-devel/llvm-16.0.4
2023-06-03 09:49:04 1:14:12 sys-devel/llvm-16.0.5
2023-06-14 14:04:00 1:28:26 sys-devel/llvm-16.0.6
2023-09-20 10:59:44 1:04:41 sys-devel/llvm-17.0.1
2023-10-04 18:20:05 1:03:23 sys-devel/llvm-17.0.2
2023-10-05 10:29:23 1:08:44 sys-devel/llvm-17.0.2-r1
2023-10-18 09:27:44 1:06:03 sys-devel/llvm-17.0.3
2023-10-31 22:33:13 1:07:16 sys-devel/llvm-17.0.4
2023-11-15 18:06:21 1:08:41 sys-devel/llvm-17.0.5
2023-11-29 12:53:24 1:06:17 sys-devel/llvm-17.0.6 |
Code: | $ emlop l -e www-client/firefox
2022-10-26 14:29:13 32:38 www-client/firefox-106.0.2
2022-11-03 15:56:14 30:54 www-client/firefox-106.0.4
2022-11-05 15:11:00 30:58 www-client/firefox-106.0.5
2022-11-15 20:41:14 29:38 www-client/firefox-107.0
2022-12-06 05:05:57 1:13:53 www-client/firefox-107.0.1
2022-12-14 14:34:15 26:47 www-client/firefox-108.0
2022-12-17 12:23:05 59:39 www-client/firefox-108.0
2022-12-18 11:41:50 29:23 www-client/firefox-108.0.1
2023-01-05 12:51:14 27:14 www-client/firefox-108.0.2
2023-01-17 12:10:54 27:08 www-client/firefox-109.0
2023-01-31 12:14:18 30:45 www-client/firefox-109.0.1
2023-02-14 19:27:00 31:44 www-client/firefox-109.0.1-r1
2023-02-20 15:35:01 26:43 www-client/firefox-110.0
2023-02-28 21:56:43 3:15:23 www-client/firefox-110.0.1
2023-03-14 14:48:10 29:35 www-client/firefox-111.0 |
Code: | $ emlop l -e app-office/libreoffice
2022-08-16 00:40:53 1:03:46 app-office/libreoffice-7.3.5.2
2022-09-09 08:42:14 55:10 app-office/libreoffice-7.3.6.2
2022-09-09 14:58:59 1:04:20 app-office/libreoffice-7.3.6.2
2022-10-21 12:01:30 1:34:38 app-office/libreoffice-7.3.6.2
2022-11-04 11:23:26 58:12 app-office/libreoffice-7.3.7.2
2022-12-06 05:34:17 1:42:00 app-office/libreoffice-7.3.7.2
2022-12-17 12:44:49 1:26:26 app-office/libreoffice-7.3.7.2
2022-12-18 00:15:18 51:44 app-office/libreoffice-7.3.7.2
2022-12-27 11:25:04 54:29 app-office/libreoffice-7.4.3.2
2023-01-10 10:46:05 59:57 app-office/libreoffice-7.4.3.2
2023-01-12 18:45:05 1:07:00 app-office/libreoffice-7.4.4.2
2023-02-01 23:48:10 1:04:42 app-office/libreoffice-7.4.5.1
2023-02-04 10:00:14 1:02:28 app-office/libreoffice-7.4.5.1
2023-03-10 16:41:31 1:10:25 app-office/libreoffice-7.4.6.2 |
|
|
Back to top |
|
|
NeddySeagoon Administrator
Joined: 05 Jul 2003 Posts: 54578 Location: 56N 3W
|
Posted: Sat Dec 09, 2023 10:13 am Post subject: |
|
|
Code: | Pi5 ~ # genlop -t thunderbird
* mail-client/thunderbird
Tue Nov 28 21:15:57 2023 >>> mail-client/thunderbird-115.5.1
merge time: 1 hour, 49 minutes and 4 seconds.
Tue Dec 5 01:37:04 2023 >>> mail-client/thunderbird-115.5.1
merge time: 1 hour, 52 minutes and 34 seconds. |
and for a biggie ...
Code: | Pi5 ~ # genlop -t chromium
* www-client/chromium
Thu Nov 30 10:22:16 2023 >>> www-client/chromium-119.0.6045.159-r1
merge time: 1 day, 5 minutes and 3 seconds. |
That's an 8G Raspberry Pi 5 with 4G swap. The interesting part of make.conf is
Code: | CPU_FLAGS_ARM="edsp neon thumb vfp vfpv3 vfpv4 vfp-d32 aes sha1 sha2 crc32 v4 v5 v6 v7 v8 thumb2"
COMMON_FLAGS="-mcpu=cortex-a76+crc+crypto -O2 -pipe -mtune=cortex-a76"
CFLAGS="${COMMON_FLAGS}"
CXXFLAGS="${COMMON_FLAGS}"
FCFLAGS="${COMMON_FLAGS}"
FFLAGS="${COMMON_FLAGS}"
# WARNING: Changing your CHOST is not something that should be done lightly.
# Please consult https://wiki.gentoo.org/wiki/Changing_the_CHOST_variable before changing.
CHOST="aarch64-unknown-linux-gnu"
# NOTE: This stage was built with the bindist Use flag enabled
ACCEPT_KEYWORDS="~arm64"
ACCEPT_LICENSE="linux-fw-redistributable" |
_________________ Regards,
NeddySeagoon
Computer users fall into two groups:-
those that do backups
those that have never had a hard drive fail. |
|
Back to top |
|
|
apiaio Guru
Joined: 04 Dec 2008 Posts: 426
|
Posted: Sat Dec 09, 2023 3:08 pm Post subject: |
|
|
Code: | Sat Sep 30 15:23:05 2023 >>> net-libs/nodejs-20.6.1
merge time: 9 minutes and 49 seconds.
Tue Sep 26 16:55:39 2023 >>> sys-devel/gcc-13.2.1_p20230826
merge time: 23 minutes and 1 second.
Wed Nov 22 18:17:36 2023 >>> dev-qt/qtwebengine-5.15.11_p20231120
merge time: 40 minutes and 20 seconds. |
Code: | RAM Kingston 2x32GB DDR4 3600MHz
5.15.80-gentoo
CPU Intel Core i7-12700 (4,9 GHz, LGA 1700), Alder Lake
|
|
|
Back to top |
|
|
myga Tux's lil' helper
Joined: 12 Jun 2023 Posts: 121
|
Posted: Sun Dec 10, 2023 2:49 am Post subject: |
|
|
NeddySeagoon wrote: |
and for a biggie ...
Code: | Pi5 ~ # genlop -t chromium
* www-client/chromium
Thu Nov 30 10:22:16 2023 >>> www-client/chromium-119.0.6045.159-r1
merge time: 1 day, 5 minutes and 3 seconds. |
|
All the posts so far seem to have consistent merge times, but that is excessive! I bet you if you merge chromium multiple times a week, that ARM CPU is going to cease functioning. Those little computers are not meant for compiling software, at least not large projects, but thank you for experimenting. |
|
Back to top |
|
|
gorg86 Guru
Joined: 20 May 2011 Posts: 315
|
Posted: Sun Dec 10, 2023 6:37 pm Post subject: |
|
|
It's always interesting to see compile times of big packages on different machines, but I'd suggest adding at least LTO and PGO useflags, too. |
|
Back to top |
|
|
NeddySeagoon Administrator
Joined: 05 Jul 2003 Posts: 54578 Location: 56N 3W
|
Posted: Sun Dec 10, 2023 7:16 pm Post subject: |
|
|
myga,
It never goes over a CPU temp of 60C.
gorg86,
PGO will at least double the build time as the package will be built twice.
LTO will drive a lot more swapping as its a memory hog.
I do use LTO on my Pi4 build system (with 128G RAM) but it won't run code built for the Pi5 which makes building Pi5 optimised code a bit tedious.
All the Pi5 code on my binhost is actually built on the Pi5 just now.
distcc would help a bit, maybe, but that's a double edged sword.
The rest, is Pi4 optimised with LTO but not PGO.
Code: | # genlop -t chromium
* www-client/chromium
Wed Nov 15 15:06:07 2023 >>> www-client/chromium-119.0.6045.123
merge time: 17 hours, 43 minutes and 1 second. |
That's with 32 3.3GHz cores, 128G RAM and LTO.
On an 8G Pi4 ...
Code: | #genlop -t chromium
* www-client/chromium
Thu Oct 26 23:08:54 2023 >>> www-client/chromium-119.0.6045.21
merge time: 3 days, 10 hours, 26 minutes and 57 seconds. |
I was looking for a build error but it built. No LTO or PGO there either. _________________ Regards,
NeddySeagoon
Computer users fall into two groups:-
those that do backups
those that have never had a hard drive fail. |
|
Back to top |
|
|
mss n00b
Joined: 11 Dec 2023 Posts: 1
|
Posted: Mon Dec 11, 2023 3:10 am Post subject: |
|
|
I used Gentoo for ~5 years, and it was the first OS I installed on my last computer: https://www.cpubenchmark.net/compare/4814vs1920/AMD-Ryzen-7-5700X-vs-AMD-A10-5750M-APU
That machine was my daily driver for ten years, up until last week. I had been using OpenBSD for awhile, but switched back to Linux for the hardware support, and so Gentoo is the first install on this machine as well. The specs:
Ryzen 7 5700X
32x2 GB @ 3600
Radeon RX 6600 (8 GB VRAM)
As for build times, my old machine took several hours to build Rust, Clang, GHC, etc. As the benchmark numbers suggest, builds are ~14 times faster on this machine.
I think the increases in build time are because I added the LTO and vectorization flags a few days ago.
Code: | COMMON_FLAGS="-O2 -pipe -march=native -flto=auto -ftree-vectorize -fvect-cost-model=very-cheap"
USE="archive opencv gme alsa elogind X jpeg bzip2 png webp ffmpeg mp4 aac dbus unicode cjk"
*/* CPU_FLAGS_X86: aes avx avx2 f16c fma3 mmx mmxext pclmul popcnt rdrand sha sse sse2 sse3 sse4_1 sse4_2 sse4a ssse3
|
Code: | * sys-devel/gcc
Sun Dec 10 10:11:29 2023 >>> sys-devel/gcc-13.2.1_p20231014
merge time: 19 minutes and 16 seconds.
* sys-devel/clang
Sun Dec 3 22:08:00 2023 >>> sys-devel/clang-16.0.6
merge time: 14 minutes and 42 seconds.
Mon Dec 4 02:06:18 2023 >>> sys-devel/clang-15.0.7-r3
merge time: 14 minutes.
Thu Dec 7 20:48:05 2023 >>> sys-devel/clang-17.0.6
merge time: 18 minutes and 5 seconds.
* virtual/rust
Thu Dec 7 16:52:58 2023 >>> dev-lang/rust-1.73.0
merge time: 27 minutes and 40 seconds.
* dev-lang/ghc
Sun Dec 3 23:37:46 2023 >>> dev-lang/ghc-9.0.2-r4
merge time: 17 minutes and 9 seconds.
Thu Dec 7 18:38:31 2023 >>> dev-lang/ghc-9.2.8
merge time: 20 minutes and 32 seconds.
* dev-qt/qtwebengine
Mon Dec 4 22:07:33 2023 >>> dev-qt/qtwebengine-6.5.3
merge time: 1 hour, 8 minutes and 30 seconds.
* sys-devel/llvm
Mon Dec 4 01:51:20 2023 >>> sys-devel/llvm-15.0.7-r3
merge time: 13 minutes and 48 seconds.
Tue Dec 5 02:26:17 2023 >>> sys-devel/llvm-16.0.6
merge time: 29 minutes and 51 seconds.
Thu Dec 7 20:29:54 2023 >>> sys-devel/llvm-17.0.6
merge time: 32 minutes and 47 seconds.
|
|
|
Back to top |
|
|
greyspoke Apprentice
Joined: 08 Jan 2010 Posts: 171
|
Posted: Tue Dec 12, 2023 11:48 am Post subject: |
|
|
Quote: |
Mon Sep 4 20:27:56 2023 >>> sys-devel/gcc-12.3.1_p20230526
merge time: 1 day, 5 hours, 5 minutes and 42 seconds. |
This is on my home server, 32 bit Intel Atom processor (1 core, 1.6GHz, 2GiB memory). gcc doesn't get upgraded very often! |
|
Back to top |
|
|
eccerr0r Watchman
Joined: 01 Jul 2004 Posts: 9824 Location: almost Mile High in the USA
|
Posted: Tue Dec 12, 2023 7:26 pm Post subject: |
|
|
Code: | $ sudo qlop -mtv gcc
Password:
2023-11-21T22:52:29 >>> sys-devel/gcc-11.4.1_p20230622: 2:04:14
$ uname -a
Linux milly 6.1.66-gentoo #2 SMP PREEMPT_DYNAMIC Sat Dec 9 23:45:40 MST 2023 x86_64 AMD A6-3420M APU with Radeon(tm) HD Graphics AuthenticAMD GNU/Linux |
This is USE="-pgo -lto +fortran". My build times are all suspect as I use distcc and --jobs > 1 ... With careful planning, even my rust qlop times are not completely indicative of the local machine's build speed.
milly "new to me" was a "Free Stuff" Craigslist computer... _________________ Intel Core i7 2700K/Radeon R7 250/24GB DDR3/256GB SSD
What am I supposed watching? |
|
Back to top |
|
|
myga Tux's lil' helper
Joined: 12 Jun 2023 Posts: 121
|
Posted: Fri Dec 15, 2023 3:19 am Post subject: |
|
|
greyspoke wrote: | Quote: |
Mon Sep 4 20:27:56 2023 >>> sys-devel/gcc-12.3.1_p20230526
merge time: 1 day, 5 hours, 5 minutes and 42 seconds. |
This is on my home server, 32 bit Intel Atom processor (1 core, 1.6GHz, 2GiB memory). gcc doesn't get upgraded very often! |
My God! That's a long time to wait. I remember when I used to compile Firefox on FreeBSD, I leave it overnight too.
How were you able to compile GCC anyway? This is a quote from the Wiki:
Quote: | More than 4 GBs (will fail with <= 4 GBs), and even more if Java and Objective C are also included. |
eccerr0r wrote: | This is USE="-pgo -lto +fortran". My build times are all suspect as I use distcc and --jobs > 1 ... With careful planning, even my rust qlop times are not completely indicative of the local machine's build speed.
milly "new to me" was a "Free Stuff" Craigslist computer... |
That's not bad at all. But if you attempt to emerge Chromium, you will be waiting a while and from my experience with AMD, it'll generate more heat than a motorcycle on a hot summer day.
BTW, I got two old computers, one is Dell Vostro 220s (32bit) with Pentium 2200 CPU and the other is Compaq (64bit) with an Athlon II CPU. Yall are welcome to take them for your labs. |
|
Back to top |
|
|
eccerr0r Watchman
Joined: 01 Jul 2004 Posts: 9824 Location: almost Mile High in the USA
|
Posted: Fri Dec 15, 2023 4:26 am Post subject: |
|
|
My Pentium-M 1.6GHz (1.5GiB RAM) and Atom N270 (2GiB RAM) haven't quite reached their Gentoo refresh cycle yet... For kicks I tend to update them (both 32 bit) to latest about once a year. The N270 with distcc help still takes 5 days 24h/day compiling, and the Pentium-M is not far behind - both building firefox and its dependencies...
Luckily I really don't need these machines up so they can just build in the background.
Incidentally I've had LTO going for rust and I had the rust RSS go to almost 7GiB.
My A6-3420 (quad core):
2023-11-04T02:48:08 >>> dev-lang/rust-1.71.1: 3:14:27
It only has 7.5GiB RAM because 512MB is swallowed up by the on-die graphics (wish I could reduce it, I don't do graphics that much on this machine. Can't wait until I could do open CL on it so that 512MB could actually be useful...) Again this is with distcc help... My dual core i5-3317 with 16GiB RAM actually was significantly faster (about 2 hours) probably because of the lack of need to swap, I figure. _________________ Intel Core i7 2700K/Radeon R7 250/24GB DDR3/256GB SSD
What am I supposed watching? |
|
Back to top |
|
|
krumpf Apprentice
Joined: 15 Jul 2018 Posts: 187
|
Posted: Fri Dec 15, 2023 8:16 am Post subject: |
|
|
Last summer I changed CPU from a Ryzen 3600 (6C/12T - 3.6 to 4.2 GHz) to a Ryzen 5700X (8C/16T - 3.4 to 4.6 GHz), here are a few qlop stats :
Firefox (with USE=lto)
Ryzen 3600 (-j12)
Code: | 2023-02-15T23:54:25 >>> www-client/firefox-102.7.0-r1: 21 minutes, 8 seconds
2023-02-23T13:13:21 >>> www-client/firefox-102.8.0: 21 minutes, 12 seconds
2023-03-19T21:30:56 >>> www-client/firefox-102.9.0: 21 minutes, 30 seconds
2023-04-13T00:28:10 >>> www-client/firefox-102.10.0: 22 minutes, 21 seconds
2023-05-15T21:37:56 >>> www-client/firefox-102.11.0: 21 minutes, 34 seconds
2023-06-11T11:08:30 >>> www-client/firefox-102.12.0: 22 minutes, 22 seconds
2023-07-09T23:40:50 >>> www-client/firefox-102.13.0: 23 minutes, 4 seconds
2023-07-21T21:15:25 >>> www-client/firefox-102.13.0: 22 minutes, 2 seconds |
Ryzen 5700X (-j16)
Code: | 2023-08-04T08:00:52 >>> www-client/firefox-102.14.0: 17 minutes, 32 seconds
2023-09-03T20:25:53 >>> www-client/firefox-102.15.0: 18 minutes, 34 seconds
2023-09-17T19:54:22 >>> www-client/firefox-102.15.1: 18 minutes, 20 seconds
2023-09-27T20:57:26 >>> www-client/firefox-115.2.1: 19 minutes, 10 seconds
2023-09-29T11:26:30 >>> www-client/firefox-115.3.0: 18 minutes, 42 seconds
2023-10-01T20:06:06 >>> www-client/firefox-115.3.1: 19 minutes, 25 seconds
2023-10-29T23:30:36 >>> www-client/firefox-115.4.0: 18 minutes, 48 seconds
2023-11-26T19:36:23 >>> www-client/firefox-115.5.0: 18 minutes, 43 seconds |
Thunderbird (with USE=lto)
Ryzen 3600 (-j12)
Code: | 2023-01-19T00:23:07 >>> mail-client/thunderbird-102.6.0: 23 minutes, 38 seconds
2023-01-22T23:32:56 >>> mail-client/thunderbird-102.6.1: 23 minutes, 55 seconds
2023-02-15T23:30:41 >>> mail-client/thunderbird-102.6.1-r1: 23 minutes, 44 seconds
2023-02-23T12:47:57 >>> mail-client/thunderbird-102.8.0: 25 minutes, 24 seconds
2023-03-19T21:05:13 >>> mail-client/thunderbird-102.9.0: 25 minutes, 43 seconds
2023-04-19T14:08:15 >>> mail-client/thunderbird-102.10.0: 26 minutes, 15 seconds
2023-05-15T23:58:01 >>> mail-client/thunderbird-102.11.0: 24 minutes, 12 seconds
2023-06-11T13:30:22 >>> mail-client/thunderbird-102.12.0: 24 minutes, 13 seconds
2023-07-09T23:15:51 >>> mail-client/thunderbird-102.13.0: 24 minutes, 59 seconds
|
Ryzen 5700X (-j16)
Code: | 2023-08-04T08:20:22 >>> mail-client/thunderbird-102.14.0: 18 minutes, 38 seconds
2023-09-03T20:05:11 >>> mail-client/thunderbird-102.15.0: 20 minutes, 42 seconds
2023-09-17T19:34:33 >>> mail-client/thunderbird-102.15.1: 19 minutes, 49 seconds
2023-09-29T11:06:19 >>> mail-client/thunderbird-115.3.0: 20 minutes, 11 seconds
2023-10-01T19:45:38 >>> mail-client/thunderbird-115.3.1: 20 minutes, 28 seconds
2023-10-29T23:49:24 >>> mail-client/thunderbird-115.4.1: 19 minutes, 9 seconds
2023-11-28T08:52:22 >>> mail-client/thunderbird-115.5.0: 20 minutes, 12 seconds
|
GCC (with USE=lto)
Ryzen 3600 (-j12)
Code: | 2023-05-16T10:58:35 >>> sys-devel/gcc-12.2.1_p20230428-r1: 53 minutes, 17 seconds
2023-06-29T00:06:28 >>> sys-devel/gcc-12.3.1_p20230526: 54 minutes, 22 seconds |
Ryzen 5700X (-j16)
Code: | 2023-08-03T20:22:50 >>> sys-devel/gcc-12.3.1_p20230526: 41 minutes, 33 seconds
2023-09-27T19:46:53 >>> sys-devel/gcc-13.2.1_p20230826: 51 minutes, 26 seconds |
|
|
Back to top |
|
|
rfx Tux's lil' helper
Joined: 19 Apr 2023 Posts: 142 Location: de-by
|
Posted: Tue Dec 19, 2023 12:02 pm Post subject: |
|
|
@krumpf thank you, the comparison of the two CPU's with differenct Cores was very interesting, even if a different gcc and kernelversion also impact on build times.
Here my little workstation:
Quote: | Kernel: 6.6.7
CPU: Intel Celeron N5105 (4x 2.9 GHz)
RAM: 16GB (50% as tmpfs) |
Code: | rene@gentoo ~ $ genlop -t firefox thunderbird nodejs
* www-client/firefox
Sat Dec 16 15:34:14 2023 >>> www-client/firefox-115.5.0
merge time: 1 hour, 37 minutes and 17 seconds.
* mail-client/thunderbird
Sat Dec 16 10:52:55 2023 >>> mail-client/thunderbird-115.5.0
merge time: 1 hour, 44 minutes and 4 seconds.
* net-libs/nodejs
Thu Dec 14 06:51:30 2023 >>> net-libs/nodejs-20.6.1
merge time: 1 hour, 29 minutes and 20 seconds. |
I was interested in testing the impact of different kernel versions on a larger package. The result surprised me; I expected a larger difference over time.
##updating #5 and #6
#1 = gentoo-sources-6.6.6
#2 = gentoo-kernel-bin-6.1.67
#3 = gentoo-kernel-bin-6.6.7
#4 = gentoo-sources-6.6.7
#5 = gentoo-kernel-6.1.67
#6 = gentoo-kernel-6.6.8
Code: | genlop -t firefox thunderbird
* www-client/firefox
Thu Dec 14 21:53:50 2023 >>> www-client/firefox-115.5.0
#1 merge time: 1 hour, 38 minutes and 51 seconds.
Fri Dec 15 21:32:34 2023 >>> www-client/firefox-115.5.0
#2 merge time: 1 hour, 37 minutes and 44 seconds.
Sat Dec 16 06:06:17 2023 >>> www-client/firefox-115.5.0
#3 merge time: 1 hour, 37 minutes and 41 seconds.
Sat Dec 16 15:34:14 2023 >>> www-client/firefox-115.5.0
#4 merge time: 1 hour, 37 minutes and 17 seconds.
Tue Dec 19 18:28:42 2023 >>> www-client/firefox-115.5.0
#5 merge time: 1 hour, 37 minutes and 52 seconds.
Thu Dec 21 16:25:28 2023 >>> www-client/firefox-115.5.0
#6 merge time: 1 hour, 38 minutes and 54 seconds.
* mail-client/thunderbird
Thu Dec 14 08:45:34 2023 >>> mail-client/thunderbird-115.5.0
#1 merge time: 1 hour, 45 minutes and 21 seconds.
Fri Dec 15 16:48:16 2023 >>> mail-client/thunderbird-115.5.0
#2 merge time: 1 hour, 45 minutes and 3 seconds.
Sat Dec 16 01:22:00 2023 >>> mail-client/thunderbird-115.5.0
#3 merge time: 1 hour, 45 minutes and 10 seconds.
Sat Dec 16 10:52:55 2023 >>> mail-client/thunderbird-115.5.0
#4 merge time: 1 hour, 44 minutes and 4 seconds.
Tue Dec 19 20:13:18 2023 >>> mail-client/thunderbird-115.5.0
#5 merge time: 1 hour, 44 minutes and 36 seconds.
Thu Dec 21 14:46:34 2023 >>> mail-client/thunderbird-115.5.0
#6 merge time: 1 hour, 46 minutes. |
Last edited by rfx on Fri Dec 22, 2023 8:32 am; edited 1 time in total |
|
Back to top |
|
|
Spanik Veteran
Joined: 12 Dec 2003 Posts: 1003 Location: Belgium
|
Posted: Tue Dec 19, 2023 3:20 pm Post subject: |
|
|
The only ones I find that have already passed here:
Code: | ~ $ emlop l -e sys-devel/gcc
2021-08-22 16:38:45 37:52 sys-devel/gcc-10.3.0-r2
2021-11-08 13:10:59 35:57 sys-devel/gcc-11.2.0
2022-03-12 10:43:40 34:19 sys-devel/gcc-11.2.1_p20220115
2022-06-11 10:34:29 32:42 sys-devel/gcc-11.3.0
2023-01-07 13:05:31 33:29 sys-devel/gcc-11.3.1_p20221209
2023-01-09 19:11:28 3:58:55 sys-devel/gcc-11.3.1_p20221209
2023-01-09 21:01:11 56:58 sys-devel/gcc-11.3.1_p20221209
2023-01-29 13:49:03 49:37 sys-devel/gcc-12.2.1_p20230121-r1
2023-04-27 15:57:17 49:59 sys-devel/gcc-12.2.1_p20230304
2023-05-26 17:28:04 53:08 sys-devel/gcc-12.2.1_p20230428-r1
2023-07-14 22:21:36 53:37 sys-devel/gcc-12.3.1_p20230526
2023-11-17 16:17:46 35:52 sys-devel/gcc-13.2.1_p20230826 |
The one that took 4 hours is funny. No idea why it takes a bit more than 30 minutes one time and almost an hour the other time. I would think it would always be similar on the same pc when you don't change things like cpu or memory.
Code: | emlop l -e www-client/firefox
2021-12-09 13:01:03 15:25 www-client/firefox-91.3.0 |
Code: | emlop l -e dev-lang/rust
2021-08-22 18:05:29 27:29 dev-lang/rust-1.53.0
2021-12-16 17:16:13 22:20 dev-lang/rust-1.56.1
2022-01-26 15:43:35 21:43 dev-lang/rust-1.58.1
2022-05-01 11:57:11 21:17 dev-lang/rust-1.59.0
2022-06-11 10:55:24 20:55 dev-lang/rust-1.60.0
2022-08-21 11:39:31 21:51 dev-lang/rust-1.62.1
2022-10-21 08:51:29 22:48 dev-lang/rust-1.64.0-r1
2022-12-03 12:28:27 22:09 dev-lang/rust-1.65.0
2023-01-29 14:36:06 21:09 dev-lang/rust-1.66.1
2023-07-14 23:41:02 21:29 dev-lang/rust-1.69.0-r1
2023-09-25 10:18:17 39:59 dev-lang/rust-1.71.1 |
Code: | emlop l -e sys-devel/clang
2021-12-09 12:33:50 9:41 sys-devel/clang-12.0.1
2023-01-09 22:01:37 14:44 sys-devel/clang-15.0.6-r1
2023-01-29 15:00:04 11:09 sys-devel/clang-15.0.7-r1
2023-05-26 18:19:21 11:06 sys-devel/clang-15.0.7-r1
2023-07-15 03:12:18 12:03 sys-devel/clang-16.0.5
2023-09-25 11:15:35 11:56 sys-devel/clang-16.0.6
|
Code: | emlop l -e net-libs/nodejs
2021-12-09 12:43:52 5:19 net-libs/nodejs-14.17.6
|
Code: | uname -a
Linux daw 6.1.57-gentoo #1 SMP PREEMPT_DYNAMIC Sun Nov 19 11:45:26 CET 2023 x86_64 AMD EPYC 7401P 24-Core Processor AuthenticAMD GNU/Linux |
Looks like a need an update for some of those things _________________ Expert in non-working solutions |
|
Back to top |
|
|
myga Tux's lil' helper
Joined: 12 Jun 2023 Posts: 121
|
Posted: Sat Dec 23, 2023 3:30 am Post subject: |
|
|
Today I realized that www-client/thunderbird was built with clang USE FLAG and caused a build error. I removed it and emerged again and it looks it took longer to build this time.
Code: | # genlop -t thunderbird
* mail-client/thunderbird
Fri Dec 8 23:06:02 2023 >>> mail-client/thunderbird-115.5.0
merge time: 32 minutes and 31 seconds.
Fri Dec 22 20:18:34 2023 >>> mail-client/thunderbird-115.6.0
merge time: 40 minutes and 20 seconds.
|
|
|
Back to top |
|
|
eccerr0r Watchman
Joined: 01 Jul 2004 Posts: 9824 Location: almost Mile High in the USA
|
Posted: Sat Dec 23, 2023 5:17 am Post subject: |
|
|
More Atom 1.6GHz (N270 i686 1C2T, 2GiB RAM, mPCIe SSD):
2023-07-25T06:42:38 >>> sys-devel/gcc-12.3.1_p20230526: 17:44:15
2023-07-26T11:12:24 >>> dev-lang/rust-1.69.0-r1: 15:57:01
2022-08-30T02:50:57 >>> dev-util/cbindgen-0.24.3: 38′15″
2023-07-27T20:38:35 >>> gnome-base/librsvg-2.56.0: 1:15:42
I would hope these are not as corrupted by distcc but they may well still be due to --jobs ... _________________ Intel Core i7 2700K/Radeon R7 250/24GB DDR3/256GB SSD
What am I supposed watching? |
|
Back to top |
|
|
sdauth l33t
Joined: 19 Sep 2018 Posts: 651 Location: Ásgarðr
|
Posted: Sat Dec 23, 2023 5:59 am Post subject: |
|
|
A funny one (A106800K @ 4.1Ghz Piledriver)
Code: | Tue Jun 27 04:00:07 2023 >>> sys-devel/gcc-12.3.1_p20230526
merge time: 10 hours, 7 minutes and 25 seconds.
Thu Oct 19 01:02:37 2023 >>> sys-devel/gcc-12.3.1_p20230825
merge time: 4 hours, 33 minutes and 27 seconds. |
I was very surprised (and pleased) to see the speed improvement. What happened ? Same use flags (ada, lto, pgo, objc..) and both compiled while nothing else was running. |
|
Back to top |
|
|
myga Tux's lil' helper
Joined: 12 Jun 2023 Posts: 121
|
Posted: Sun Dec 24, 2023 3:38 am Post subject: |
|
|
sdauth wrote: | A funny one (A106800K @ 4.1Ghz Piledriver)
Code: | Tue Jun 27 04:00:07 2023 >>> sys-devel/gcc-12.3.1_p20230526
merge time: 10 hours, 7 minutes and 25 seconds.
Thu Oct 19 01:02:37 2023 >>> sys-devel/gcc-12.3.1_p20230825
merge time: 4 hours, 33 minutes and 27 seconds. |
I was very surprised (and pleased) to see the speed improvement. What happened ? Same use flags (ada, lto, pgo, objc..) and both compiled while nothing else was running. |
the flags lto and pgo quadruple build time and I don't see a reason for me to use them. Your build time was reduced significantly due to gcc not needing to rebuild most or all of its code and only the code that was committed is what was built. |
|
Back to top |
|
|
superjaded l33t
Joined: 05 Jul 2002 Posts: 802
|
Posted: Mon Dec 25, 2023 2:01 am Post subject: |
|
|
Code: | 2023-09-25T05:07:47 >>> sys-devel/gcc-13.2.1_p20230826: 18 minutes, 13 seconds
2023-11-02T16:49:06 >>> sys-devel/clang-16.0.6: 7 minutes, 31 seconds
2023-02-04T18:11:01 >>> www-client/firefox-109.0.1: 17 minutes, 47 seconds |
AMD Ryzen 9 7950X 16-Core Processor (-j16 since this system only has 32GB of memory)
Code: | 2023-09-25T21:48:48 >>> sys-devel/gcc-13.2.1_p20230826: 51 minutes, 21 seconds
2023-12-16T16:28:42 >>> sys-devel/clang-16.0.6: 18 minutes, 17 seconds
2023-02-10T05:27:50 >>> www-client/firefox-102.7.0: 52 minutes, 14 seconds
|
2x Intel(R) Xeon(R) CPU E5-2670 0 @ 2.60GHz (-j32, 192GB of memory)
Firefox examples probably aren't great since I normally use www-client/librewolf-bin for my browser which is why those are crazy old versions, but those were compiled with lto and pgo fwiw. |
|
Back to top |
|
|
mid-kid n00b
Joined: 24 Aug 2014 Posts: 16
|
Posted: Sat Dec 30, 2023 5:01 pm Post subject: |
|
|
I suggest using a command like:
Code: | qlist -Iv | xargs sudo qlop -Mma | sort -k 2 -nr | head -n 10 |
In order to obtain the 10 longest-to-compile packages on any given system.
For me, that is:
Code: | dev-qt/qtwebengine: 16327 average for 1 merge
sys-devel/gcc: 12383 average for 1 merge
app-office/libreoffice: 7795 average for 1 merge
sys-devel/llvm: 6484 average for 6 merges
www-client/firefox: 5410 average for 1 merge
dev-lang/rust: 5098 average for 1 merge
sys-devel/clang: 4253 average for 3 merges
app-doc/doxygen: 4154 average for 1 merge
net-libs/nodejs: 4027 average for 1 merge
dev-util/mingw64-toolchain: 3676 average for 1 merge
|
Some averages here are skewed due to the occasional binary merge (downgrading llvm or gcc, primarily).
Code: | $ sudo genlop -t dev-qt/qtwebengine sys-devel/gcc app-office/libreoffice sys-devel/llvm www-client/firefox
* dev-qt/qtwebengine
Tue Dec 19 04:13:49 2023 >>> dev-qt/qtwebengine-5.15.11_p20231120
merge time: 4 hours, 32 minutes and 7 seconds.
* sys-devel/gcc
Wed Dec 20 02:28:40 2023 >>> sys-devel/gcc-12.3.1_p20230825
merge time: 3 hours, 45 minutes and 9 seconds.
* app-office/libreoffice
Fri Dec 22 00:07:56 2023 >>> app-office/libreoffice-7.5.6.2
merge time: 2 hours, 9 minutes and 55 seconds.
* sys-devel/llvm
Tue Aug 1 08:08:28 2023 >>> sys-devel/llvm-16.0.6
merge time: 2 hours, 22 minutes and 9 seconds.
* www-client/firefox
Sat Dec 16 16:32:04 2023 >>> www-client/firefox-115.5.0
merge time: 1 hour, 30 minutes and 10 seconds.
|
Code: | Host: 20MUCTO1WW ThinkPad A485
Kernel: 6.1.60
CPU: AMD Ryzen 5 PRO 2500U w/ Radeon Vega Mobile Gfx (8) @ 2.000GHz
Memory: 22919MiB
|
USE="pgo lto"; CFLAGS="-pipe -march=znver1 -O3 -fuse-linker-plugin -flto=4 --param=lto-max-streaming-parallelism=4 -fgraphite-identity -floop-nest-optimize -fdevirtualize-at-ltrans -fipa-pta -fno-semantic-interposition"
Though I disable USE=pgo for firefox these days. Updates too often and takes too long.[/code] |
|
Back to top |
|
|
eeckwrk99 Apprentice
Joined: 14 Mar 2021 Posts: 231 Location: Gentoo forums
|
Posted: Sat Dec 30, 2023 5:25 pm Post subject: |
|
|
mid-kid wrote: | I suggest using a command like:
Code: | qlist -Iv | xargs sudo qlop -Mma | sort -k 2 -nr | head -n 10 |
In order to obtain the 10 longest-to-compile packages on any given system. |
Nice one. You don't need sudo for qlop though.
Edit: Nevermind, you actually do. My current user was still in the Portage group when I wrote this
Last edited by eeckwrk99 on Sun Dec 31, 2023 10:09 pm; edited 2 times in total |
|
Back to top |
|
|
DavidF n00b
Joined: 12 Jan 2004 Posts: 45 Location: Rocky Mountains
|
Posted: Sat Dec 30, 2023 7:30 pm Post subject: |
|
|
Code: |
i9-13900k
Mon Sep 25 10:22:49 2023 >>> sys-devel/gcc-13.2.1_p20230826
merge time: 17 minutes and 46 seconds
Thu Dec 28 08:02:29 2023 >>> mail-client/thunderbird-115.6.0
merge time: 6 minutes and 54 seconds.
| [/code] |
|
Back to top |
|
|
pietinger Moderator
Joined: 17 Oct 2006 Posts: 5109 Location: Bavaria
|
Posted: Sat Dec 30, 2023 9:51 pm Post subject: |
|
|
DavidF,
do you have running many other tasks when you do your emerge world ?
I have also an i9-13900K - using only -j24 (instead of possible -j32 ... because of CPU heat) =>
Code: | * sys-devel/gcc
Tue Nov 21 14:11:13 2023 >>> sys-devel/gcc-13.2.1_p20230826
merge time: 12 minutes and 37 seconds. |
with a manually configured kernel where almost every security feature is ENABLED ... so it should be slower than yours ... ? _________________ https://wiki.gentoo.org/wiki/User:Pietinger |
|
Back to top |
|
|
|
|
You cannot post new topics in this forum You cannot reply to topics in this forum You cannot edit your posts in this forum You cannot delete your posts in this forum You cannot vote in polls in this forum
|
|