Gentoo Forums
Gentoo Forums
Gentoo Forums
Quick Search: in
post your build times and specs
View unanswered posts
View posts from last 24 hours

Goto page 1, 2  Next  
Reply to topic    Gentoo Forums Forum Index Gentoo Chat
View previous topic :: View next topic  
Author Message
myga
Tux's lil' helper
Tux's lil' helper


Joined: 12 Jun 2023
Posts: 121

PostPosted: Sat Dec 09, 2023 5:33 am    Post subject: post your build times and specs Reply with quote

Hello,

***Disclaimer: this post is just to chat about packages' build time and collect information that might help others searching for it.***

I know that the wiki provide some hints about build times and RAM needed for them, but that info is not applicable to everyone and might be outdated. So, I starter searching around for anyone posting or blogging about any packages' build time and the specs used, but there is none. I was hesitant for awhile to build big packages, but today I decided to test my machine by building thunderbird and I expected it to take about 3 hrs. However, it took a lot less than that!

So, I'm hoping that you guys participate by posting your build times and specs for anyone seeking a general idea about their hardware and its capabilities.

Here are the build times of thunderbird & friends, and specs of my machine:

Code:
root@~ # genlop -t thunderbird
 * mail-client/thunderbird

     Fri Dec  8 23:06:02 2023 >>> mail-client/thunderbird-115.5.0
       merge time: 32 minutes and 31 seconds.

root@~ # genlop -t nodejs     
 * net-libs/nodejs

     Fri Dec  8 22:28:32 2023 >>> net-libs/nodejs-20.6.1
       merge time: 27 minutes and 33 seconds.

root@~ # genlop -t openh264
 * media-libs/openh264

     Fri Dec  8 22:00:39 2023 >>> media-libs/openh264-2.3.1-r3
       merge time: 15 seconds.

root@~ # genlop -t botan   
 * dev-libs/botan

     Fri Dec  8 22:29:45 2023 >>> dev-libs/botan-2.19.3-r2
       merge time: 1 minute and 6 seconds.


Code:
Host: ThinkPad P52
Kernel: 6.1.66-gentoo
CPU: Intel i7-8850H (12) @ 4.300GHz
GPU: NVIDIA Quadro P2000 Mobile
Memory: 2639MiB / 31793MiB
Back to top
View user's profile Send private message
rfx
Tux's lil' helper
Tux's lil' helper


Joined: 19 Apr 2023
Posts: 142
Location: de-by

PostPosted: Sat Dec 09, 2023 6:57 am    Post subject: Reply with quote

Code:
Kernel: 6.6.5-gentoo
CPU: Intel Core i5-6200u (4) @ 2.3 GHz
Ram: 8 GB


Big Stuff like Thunderbird Firefox & Co. i build over night without display-manager, so i have more free Ram for compiling

Code:
genlop -t firefox thunderbird nodejs openh264 botan
 * www-client/firefox

     Tue Nov 14 12:31:50 2023 >>> www-client/firefox-115.4.0
       merge time: 1 hour, 44 minutes.

     Fri Nov 24 04:44:04 2023 >>> www-client/firefox-115.5.0
       merge time: 1 hour, 36 minutes and 51 seconds.

 * mail-client/thunderbird

     Wed Nov 15 02:25:16 2023 >>> mail-client/thunderbird-115.4.1
       merge time: 1 hour, 44 minutes and 22 seconds.

     Fri Nov 24 03:07:13 2023 >>> mail-client/thunderbird-115.5.0
       merge time: 1 hour, 44 minutes and 37 seconds.

 * net-libs/nodejs

     Tue Nov 14 10:42:49 2023 >>> net-libs/nodejs-20.6.1
       merge time: 1 hour, 41 minutes and 29 seconds.

 * media-libs/openh264

     Mon Nov 13 13:30:50 2023 >>> media-libs/openh264-2.3.1-r3
       merge time: 34 seconds.

 * dev-libs/botan

     Wed Nov 15 00:40:01 2023 >>> dev-libs/botan-2.19.3-r2
       merge time: 3 minutes and 22 seconds.

     Mon Nov 20 13:39:33 2023 >>> dev-libs/botan-2.19.3-r2
       merge time: 3 minutes and 34 seconds.
Back to top
View user's profile Send private message
eeckwrk99
Apprentice
Apprentice


Joined: 14 Mar 2021
Posts: 232
Location: Gentoo forums

PostPosted: Sat Dec 09, 2023 9:53 am    Post subject: Reply with quote

- CPU: Intel i7-5820K (12) @ 3.80 GHz
- RAM: 32 GB
- COMMON_FLAGS="-march=haswell -O2 -pipe"
- CPU_FLAGS_X86="aes avx avx2 f16c fma3 mmx mmxext pclmul popcnt rdrand sse sse2 sse3 sse4_1 sse4_2 ssse3"
-j12 -l10.8

Code:
$ emlop l -e sys-devel/llvm

2023-01-07 01:49:31  1:00:50 sys-devel/llvm-15.0.6-r1
2023-01-13 17:23:31  1:01:45 sys-devel/llvm-15.0.7
2023-03-18 17:46:50  1:12:53 sys-devel/llvm-16.0.0
2023-04-06 14:38:40  1:12:26 sys-devel/llvm-16.0.1
2023-04-20 11:04:19  1:10:53 sys-devel/llvm-16.0.2
2023-05-04 10:58:23  1:08:54 sys-devel/llvm-16.0.3
2023-05-18 08:21:09  1:06:19 sys-devel/llvm-16.0.4
2023-06-03 09:49:04  1:14:12 sys-devel/llvm-16.0.5
2023-06-14 14:04:00  1:28:26 sys-devel/llvm-16.0.6
2023-09-20 10:59:44  1:04:41 sys-devel/llvm-17.0.1
2023-10-04 18:20:05  1:03:23 sys-devel/llvm-17.0.2
2023-10-05 10:29:23  1:08:44 sys-devel/llvm-17.0.2-r1
2023-10-18 09:27:44  1:06:03 sys-devel/llvm-17.0.3
2023-10-31 22:33:13  1:07:16 sys-devel/llvm-17.0.4
2023-11-15 18:06:21  1:08:41 sys-devel/llvm-17.0.5
2023-11-29 12:53:24  1:06:17 sys-devel/llvm-17.0.6


Code:
$ emlop l -e www-client/firefox

2022-10-26 14:29:13    32:38 www-client/firefox-106.0.2
2022-11-03 15:56:14    30:54 www-client/firefox-106.0.4
2022-11-05 15:11:00    30:58 www-client/firefox-106.0.5
2022-11-15 20:41:14    29:38 www-client/firefox-107.0
2022-12-06 05:05:57  1:13:53 www-client/firefox-107.0.1
2022-12-14 14:34:15    26:47 www-client/firefox-108.0
2022-12-17 12:23:05    59:39 www-client/firefox-108.0
2022-12-18 11:41:50    29:23 www-client/firefox-108.0.1
2023-01-05 12:51:14    27:14 www-client/firefox-108.0.2
2023-01-17 12:10:54    27:08 www-client/firefox-109.0
2023-01-31 12:14:18    30:45 www-client/firefox-109.0.1
2023-02-14 19:27:00    31:44 www-client/firefox-109.0.1-r1
2023-02-20 15:35:01    26:43 www-client/firefox-110.0
2023-02-28 21:56:43  3:15:23 www-client/firefox-110.0.1
2023-03-14 14:48:10    29:35 www-client/firefox-111.0


Code:
$ emlop l -e app-office/libreoffice

2022-08-16 00:40:53  1:03:46 app-office/libreoffice-7.3.5.2
2022-09-09 08:42:14    55:10 app-office/libreoffice-7.3.6.2
2022-09-09 14:58:59  1:04:20 app-office/libreoffice-7.3.6.2
2022-10-21 12:01:30  1:34:38 app-office/libreoffice-7.3.6.2
2022-11-04 11:23:26    58:12 app-office/libreoffice-7.3.7.2
2022-12-06 05:34:17  1:42:00 app-office/libreoffice-7.3.7.2
2022-12-17 12:44:49  1:26:26 app-office/libreoffice-7.3.7.2
2022-12-18 00:15:18    51:44 app-office/libreoffice-7.3.7.2
2022-12-27 11:25:04    54:29 app-office/libreoffice-7.4.3.2
2023-01-10 10:46:05    59:57 app-office/libreoffice-7.4.3.2
2023-01-12 18:45:05  1:07:00 app-office/libreoffice-7.4.4.2
2023-02-01 23:48:10  1:04:42 app-office/libreoffice-7.4.5.1
2023-02-04 10:00:14  1:02:28 app-office/libreoffice-7.4.5.1
2023-03-10 16:41:31  1:10:25 app-office/libreoffice-7.4.6.2
Back to top
View user's profile Send private message
NeddySeagoon
Administrator
Administrator


Joined: 05 Jul 2003
Posts: 54577
Location: 56N 3W

PostPosted: Sat Dec 09, 2023 10:13 am    Post subject: Reply with quote

Code:
Pi5 ~ # genlop -t thunderbird
 * mail-client/thunderbird

     Tue Nov 28 21:15:57 2023 >>> mail-client/thunderbird-115.5.1
       merge time: 1 hour, 49 minutes and 4 seconds.

     Tue Dec  5 01:37:04 2023 >>> mail-client/thunderbird-115.5.1
       merge time: 1 hour, 52 minutes and 34 seconds.


and for a biggie ...

Code:
Pi5 ~ # genlop -t chromium
 * www-client/chromium

     Thu Nov 30 10:22:16 2023 >>> www-client/chromium-119.0.6045.159-r1
       merge time: 1 day, 5 minutes and 3 seconds.


That's an 8G Raspberry Pi 5 with 4G swap. The interesting part of make.conf is
Code:
CPU_FLAGS_ARM="edsp neon thumb vfp vfpv3 vfpv4 vfp-d32 aes sha1 sha2 crc32 v4 v5 v6 v7 v8 thumb2"

COMMON_FLAGS="-mcpu=cortex-a76+crc+crypto -O2 -pipe -mtune=cortex-a76"
CFLAGS="${COMMON_FLAGS}"
CXXFLAGS="${COMMON_FLAGS}"
FCFLAGS="${COMMON_FLAGS}"
FFLAGS="${COMMON_FLAGS}"

# WARNING: Changing your CHOST is not something that should be done lightly.
# Please consult https://wiki.gentoo.org/wiki/Changing_the_CHOST_variable before changing.
CHOST="aarch64-unknown-linux-gnu"

# NOTE: This stage was built with the bindist Use flag enabled

ACCEPT_KEYWORDS="~arm64"
ACCEPT_LICENSE="linux-fw-redistributable"

_________________
Regards,

NeddySeagoon

Computer users fall into two groups:-
those that do backups
those that have never had a hard drive fail.
Back to top
View user's profile Send private message
apiaio
Guru
Guru


Joined: 04 Dec 2008
Posts: 426

PostPosted: Sat Dec 09, 2023 3:08 pm    Post subject: Reply with quote

Code:
     Sat Sep 30 15:23:05 2023 >>> net-libs/nodejs-20.6.1
       merge time: 9 minutes and 49 seconds.

     Tue Sep 26 16:55:39 2023 >>> sys-devel/gcc-13.2.1_p20230826
       merge time: 23 minutes and 1 second.

     Wed Nov 22 18:17:36 2023 >>> dev-qt/qtwebengine-5.15.11_p20231120
       merge time: 40 minutes and 20 seconds.


Code:
RAM Kingston 2x32GB DDR4 3600MHz
5.15.80-gentoo
CPU Intel Core i7-12700 (4,9 GHz, LGA 1700), Alder Lake
Back to top
View user's profile Send private message
myga
Tux's lil' helper
Tux's lil' helper


Joined: 12 Jun 2023
Posts: 121

PostPosted: Sun Dec 10, 2023 2:49 am    Post subject: Reply with quote

NeddySeagoon wrote:


and for a biggie ...

Code:
Pi5 ~ # genlop -t chromium
 * www-client/chromium

     Thu Nov 30 10:22:16 2023 >>> www-client/chromium-119.0.6045.159-r1
       merge time: 1 day, 5 minutes and 3 seconds.


All the posts so far seem to have consistent merge times, but that is excessive! I bet you if you merge chromium multiple times a week, that ARM CPU is going to cease functioning. Those little computers are not meant for compiling software, at least not large projects, but thank you for experimenting.
Back to top
View user's profile Send private message
gorg86
Guru
Guru


Joined: 20 May 2011
Posts: 315

PostPosted: Sun Dec 10, 2023 6:37 pm    Post subject: Reply with quote

It's always interesting to see compile times of big packages on different machines, but I'd suggest adding at least LTO and PGO useflags, too.
Back to top
View user's profile Send private message
NeddySeagoon
Administrator
Administrator


Joined: 05 Jul 2003
Posts: 54577
Location: 56N 3W

PostPosted: Sun Dec 10, 2023 7:16 pm    Post subject: Reply with quote

myga,

It never goes over a CPU temp of 60C.

gorg86,

PGO will at least double the build time as the package will be built twice.
LTO will drive a lot more swapping as its a memory hog.

I do use LTO on my Pi4 build system (with 128G RAM) but it won't run code built for the Pi5 which makes building Pi5 optimised code a bit tedious.

All the Pi5 code on my binhost is actually built on the Pi5 just now.
distcc would help a bit, maybe, but that's a double edged sword.

The rest, is Pi4 optimised with LTO but not PGO.
Code:
# genlop -t chromium
 * www-client/chromium

     Wed Nov 15 15:06:07 2023 >>> www-client/chromium-119.0.6045.123
       merge time: 17 hours, 43 minutes and 1 second.

That's with 32 3.3GHz cores, 128G RAM and LTO.


On an 8G Pi4 ...
Code:
#genlop -t chromium

 * www-client/chromium

     Thu Oct 26 23:08:54 2023 >>> www-client/chromium-119.0.6045.21
       merge time: 3 days, 10 hours, 26 minutes and 57 seconds.


I was looking for a build error but it built. No LTO or PGO there either.
_________________
Regards,

NeddySeagoon

Computer users fall into two groups:-
those that do backups
those that have never had a hard drive fail.
Back to top
View user's profile Send private message
mss
n00b
n00b


Joined: 11 Dec 2023
Posts: 1

PostPosted: Mon Dec 11, 2023 3:10 am    Post subject: Reply with quote

I used Gentoo for ~5 years, and it was the first OS I installed on my last computer: https://www.cpubenchmark.net/compare/4814vs1920/AMD-Ryzen-7-5700X-vs-AMD-A10-5750M-APU

That machine was my daily driver for ten years, up until last week. I had been using OpenBSD for awhile, but switched back to Linux for the hardware support, and so Gentoo is the first install on this machine as well. The specs:

Ryzen 7 5700X
32x2 GB @ 3600
Radeon RX 6600 (8 GB VRAM)

As for build times, my old machine took several hours to build Rust, Clang, GHC, etc. As the benchmark numbers suggest, builds are ~14 times faster on this machine.

I think the increases in build time are because I added the LTO and vectorization flags a few days ago.

Code:
COMMON_FLAGS="-O2 -pipe -march=native -flto=auto -ftree-vectorize -fvect-cost-model=very-cheap"
USE="archive opencv gme alsa elogind X jpeg bzip2 png webp ffmpeg mp4 aac dbus unicode cjk"
*/* CPU_FLAGS_X86: aes avx avx2 f16c fma3 mmx mmxext pclmul popcnt rdrand sha sse sse2 sse3 sse4_1 sse4_2 sse4a ssse3


Code:
 * sys-devel/gcc

     Sun Dec 10 10:11:29 2023 >>> sys-devel/gcc-13.2.1_p20231014
       merge time: 19 minutes and 16 seconds.

 * sys-devel/clang

     Sun Dec  3 22:08:00 2023 >>> sys-devel/clang-16.0.6
       merge time: 14 minutes and 42 seconds.

     Mon Dec  4 02:06:18 2023 >>> sys-devel/clang-15.0.7-r3
       merge time: 14 minutes.

     Thu Dec  7 20:48:05 2023 >>> sys-devel/clang-17.0.6
       merge time: 18 minutes and 5 seconds.

 * virtual/rust

     Thu Dec  7 16:52:58 2023 >>> dev-lang/rust-1.73.0
       merge time: 27 minutes and 40 seconds.

 * dev-lang/ghc

     Sun Dec  3 23:37:46 2023 >>> dev-lang/ghc-9.0.2-r4
       merge time: 17 minutes and 9 seconds.

     Thu Dec  7 18:38:31 2023 >>> dev-lang/ghc-9.2.8
       merge time: 20 minutes and 32 seconds.

 * dev-qt/qtwebengine

     Mon Dec  4 22:07:33 2023 >>> dev-qt/qtwebengine-6.5.3
       merge time: 1 hour, 8 minutes and 30 seconds.

 * sys-devel/llvm

     Mon Dec  4 01:51:20 2023 >>> sys-devel/llvm-15.0.7-r3
       merge time: 13 minutes and 48 seconds.

     Tue Dec  5 02:26:17 2023 >>> sys-devel/llvm-16.0.6
       merge time: 29 minutes and 51 seconds.

     Thu Dec  7 20:29:54 2023 >>> sys-devel/llvm-17.0.6
       merge time: 32 minutes and 47 seconds.
Back to top
View user's profile Send private message
greyspoke
Apprentice
Apprentice


Joined: 08 Jan 2010
Posts: 171

PostPosted: Tue Dec 12, 2023 11:48 am    Post subject: Reply with quote

Quote:

Mon Sep 4 20:27:56 2023 >>> sys-devel/gcc-12.3.1_p20230526
merge time: 1 day, 5 hours, 5 minutes and 42 seconds.

This is on my home server, 32 bit Intel Atom processor (1 core, 1.6GHz, 2GiB memory). gcc doesn't get upgraded very often!
Back to top
View user's profile Send private message
eccerr0r
Watchman
Watchman


Joined: 01 Jul 2004
Posts: 9824
Location: almost Mile High in the USA

PostPosted: Tue Dec 12, 2023 7:26 pm    Post subject: Reply with quote

Code:
$ sudo qlop -mtv gcc
Password:
2023-11-21T22:52:29 >>> sys-devel/gcc-11.4.1_p20230622: 2:04:14
$ uname -a
Linux milly 6.1.66-gentoo #2 SMP PREEMPT_DYNAMIC Sat Dec  9 23:45:40 MST 2023 x86_64 AMD A6-3420M APU with Radeon(tm) HD Graphics AuthenticAMD GNU/Linux


This is USE="-pgo -lto +fortran". My build times are all suspect as I use distcc and --jobs > 1 ... With careful planning, even my rust qlop times are not completely indicative of the local machine's build speed.

milly "new to me" was a "Free Stuff" Craigslist computer...
_________________
Intel Core i7 2700K/Radeon R7 250/24GB DDR3/256GB SSD
What am I supposed watching?
Back to top
View user's profile Send private message
myga
Tux's lil' helper
Tux's lil' helper


Joined: 12 Jun 2023
Posts: 121

PostPosted: Fri Dec 15, 2023 3:19 am    Post subject: Reply with quote

greyspoke wrote:
Quote:

Mon Sep 4 20:27:56 2023 >>> sys-devel/gcc-12.3.1_p20230526
merge time: 1 day, 5 hours, 5 minutes and 42 seconds.

This is on my home server, 32 bit Intel Atom processor (1 core, 1.6GHz, 2GiB memory). gcc doesn't get upgraded very often!


My God! That's a long time to wait. I remember when I used to compile Firefox on FreeBSD, I leave it overnight too.

How were you able to compile GCC anyway? This is a quote from the Wiki:

Quote:
More than 4 GBs (will fail with <= 4 GBs), and even more if Java and Objective C are also included.


eccerr0r wrote:
This is USE="-pgo -lto +fortran". My build times are all suspect as I use distcc and --jobs > 1 ... With careful planning, even my rust qlop times are not completely indicative of the local machine's build speed.

milly "new to me" was a "Free Stuff" Craigslist computer...


That's not bad at all. But if you attempt to emerge Chromium, you will be waiting a while and from my experience with AMD, it'll generate more heat than a motorcycle on a hot summer day.


BTW, I got two old computers, one is Dell Vostro 220s (32bit) with Pentium 2200 CPU and the other is Compaq (64bit) with an Athlon II CPU. Yall are welcome to take them for your labs.
Back to top
View user's profile Send private message
eccerr0r
Watchman
Watchman


Joined: 01 Jul 2004
Posts: 9824
Location: almost Mile High in the USA

PostPosted: Fri Dec 15, 2023 4:26 am    Post subject: Reply with quote

My Pentium-M 1.6GHz (1.5GiB RAM) and Atom N270 (2GiB RAM) haven't quite reached their Gentoo refresh cycle yet... For kicks I tend to update them (both 32 bit) to latest about once a year. The N270 with distcc help still takes 5 days 24h/day compiling, and the Pentium-M is not far behind - both building firefox and its dependencies...

Luckily I really don't need these machines up so they can just build in the background.

Incidentally I've had LTO going for rust and I had the rust RSS go to almost 7GiB.

My A6-3420 (quad core):

2023-11-04T02:48:08 >>> dev-lang/rust-1.71.1: 3:14:27

It only has 7.5GiB RAM because 512MB is swallowed up by the on-die graphics (wish I could reduce it, I don't do graphics that much on this machine. Can't wait until I could do open CL on it so that 512MB could actually be useful...) Again this is with distcc help... My dual core i5-3317 with 16GiB RAM actually was significantly faster (about 2 hours) probably because of the lack of need to swap, I figure.
_________________
Intel Core i7 2700K/Radeon R7 250/24GB DDR3/256GB SSD
What am I supposed watching?
Back to top
View user's profile Send private message
krumpf
Apprentice
Apprentice


Joined: 15 Jul 2018
Posts: 187

PostPosted: Fri Dec 15, 2023 8:16 am    Post subject: Reply with quote

Last summer I changed CPU from a Ryzen 3600 (6C/12T - 3.6 to 4.2 GHz) to a Ryzen 5700X (8C/16T - 3.4 to 4.6 GHz), here are a few qlop stats :

Firefox (with USE=lto)
Ryzen 3600 (-j12)
Code:
2023-02-15T23:54:25 >>> www-client/firefox-102.7.0-r1: 21 minutes, 8 seconds
2023-02-23T13:13:21 >>> www-client/firefox-102.8.0: 21 minutes, 12 seconds
2023-03-19T21:30:56 >>> www-client/firefox-102.9.0: 21 minutes, 30 seconds
2023-04-13T00:28:10 >>> www-client/firefox-102.10.0: 22 minutes, 21 seconds
2023-05-15T21:37:56 >>> www-client/firefox-102.11.0: 21 minutes, 34 seconds
2023-06-11T11:08:30 >>> www-client/firefox-102.12.0: 22 minutes, 22 seconds
2023-07-09T23:40:50 >>> www-client/firefox-102.13.0: 23 minutes, 4 seconds
2023-07-21T21:15:25 >>> www-client/firefox-102.13.0: 22 minutes, 2 seconds

Ryzen 5700X (-j16)
Code:
2023-08-04T08:00:52 >>> www-client/firefox-102.14.0: 17 minutes, 32 seconds
2023-09-03T20:25:53 >>> www-client/firefox-102.15.0: 18 minutes, 34 seconds
2023-09-17T19:54:22 >>> www-client/firefox-102.15.1: 18 minutes, 20 seconds
2023-09-27T20:57:26 >>> www-client/firefox-115.2.1: 19 minutes, 10 seconds
2023-09-29T11:26:30 >>> www-client/firefox-115.3.0: 18 minutes, 42 seconds
2023-10-01T20:06:06 >>> www-client/firefox-115.3.1: 19 minutes, 25 seconds
2023-10-29T23:30:36 >>> www-client/firefox-115.4.0: 18 minutes, 48 seconds
2023-11-26T19:36:23 >>> www-client/firefox-115.5.0: 18 minutes, 43 seconds

Thunderbird (with USE=lto)
Ryzen 3600 (-j12)
Code:
2023-01-19T00:23:07 >>> mail-client/thunderbird-102.6.0: 23 minutes, 38 seconds
2023-01-22T23:32:56 >>> mail-client/thunderbird-102.6.1: 23 minutes, 55 seconds
2023-02-15T23:30:41 >>> mail-client/thunderbird-102.6.1-r1: 23 minutes, 44 seconds
2023-02-23T12:47:57 >>> mail-client/thunderbird-102.8.0: 25 minutes, 24 seconds
2023-03-19T21:05:13 >>> mail-client/thunderbird-102.9.0: 25 minutes, 43 seconds
2023-04-19T14:08:15 >>> mail-client/thunderbird-102.10.0: 26 minutes, 15 seconds
2023-05-15T23:58:01 >>> mail-client/thunderbird-102.11.0: 24 minutes, 12 seconds
2023-06-11T13:30:22 >>> mail-client/thunderbird-102.12.0: 24 minutes, 13 seconds
2023-07-09T23:15:51 >>> mail-client/thunderbird-102.13.0: 24 minutes, 59 seconds

Ryzen 5700X (-j16)
Code:
2023-08-04T08:20:22 >>> mail-client/thunderbird-102.14.0: 18 minutes, 38 seconds
2023-09-03T20:05:11 >>> mail-client/thunderbird-102.15.0: 20 minutes, 42 seconds
2023-09-17T19:34:33 >>> mail-client/thunderbird-102.15.1: 19 minutes, 49 seconds
2023-09-29T11:06:19 >>> mail-client/thunderbird-115.3.0: 20 minutes, 11 seconds
2023-10-01T19:45:38 >>> mail-client/thunderbird-115.3.1: 20 minutes, 28 seconds
2023-10-29T23:49:24 >>> mail-client/thunderbird-115.4.1: 19 minutes, 9 seconds
2023-11-28T08:52:22 >>> mail-client/thunderbird-115.5.0: 20 minutes, 12 seconds

GCC (with USE=lto)
Ryzen 3600 (-j12)
Code:
2023-05-16T10:58:35 >>> sys-devel/gcc-12.2.1_p20230428-r1: 53 minutes, 17 seconds
2023-06-29T00:06:28 >>> sys-devel/gcc-12.3.1_p20230526: 54 minutes, 22 seconds

Ryzen 5700X (-j16)
Code:
2023-08-03T20:22:50 >>> sys-devel/gcc-12.3.1_p20230526: 41 minutes, 33 seconds
2023-09-27T19:46:53 >>> sys-devel/gcc-13.2.1_p20230826: 51 minutes, 26 seconds
Back to top
View user's profile Send private message
rfx
Tux's lil' helper
Tux's lil' helper


Joined: 19 Apr 2023
Posts: 142
Location: de-by

PostPosted: Tue Dec 19, 2023 12:02 pm    Post subject: Reply with quote

@krumpf thank you, the comparison of the two CPU's with differenct Cores was very interesting, even if a different gcc and kernelversion also impact on build times.

Here my little workstation:

Quote:
Kernel: 6.6.7
CPU: Intel Celeron N5105 (4x 2.9 GHz)
RAM: 16GB (50% as tmpfs)


Code:
rene@gentoo ~ $ genlop -t firefox thunderbird nodejs
 * www-client/firefox

     Sat Dec 16 15:34:14 2023 >>> www-client/firefox-115.5.0
       merge time: 1 hour, 37 minutes and 17 seconds.

 * mail-client/thunderbird

     Sat Dec 16 10:52:55 2023 >>> mail-client/thunderbird-115.5.0
       merge time: 1 hour, 44 minutes and 4 seconds.

 * net-libs/nodejs

     Thu Dec 14 06:51:30 2023 >>> net-libs/nodejs-20.6.1
       merge time: 1 hour, 29 minutes and 20 seconds.






I was interested in testing the impact of different kernel versions on a larger package. The result surprised me; I expected a larger difference over time.


##updating #5 and #6

#1 = gentoo-sources-6.6.6
#2 = gentoo-kernel-bin-6.1.67
#3 = gentoo-kernel-bin-6.6.7
#4 = gentoo-sources-6.6.7
#5 = gentoo-kernel-6.1.67
#6 = gentoo-kernel-6.6.8


Code:
genlop -t firefox thunderbird
 * www-client/firefox

     Thu Dec 14 21:53:50 2023 >>> www-client/firefox-115.5.0
#1       merge time: 1 hour, 38 minutes and 51 seconds.

     Fri Dec 15 21:32:34 2023 >>> www-client/firefox-115.5.0
#2       merge time: 1 hour, 37 minutes and 44 seconds.

     Sat Dec 16 06:06:17 2023 >>> www-client/firefox-115.5.0
#3       merge time: 1 hour, 37 minutes and 41 seconds.

     Sat Dec 16 15:34:14 2023 >>> www-client/firefox-115.5.0
#4       merge time: 1 hour, 37 minutes and 17 seconds.

     Tue Dec 19 18:28:42 2023 >>> www-client/firefox-115.5.0
#5       merge time: 1 hour, 37 minutes and 52 seconds.

     Thu Dec 21 16:25:28 2023 >>> www-client/firefox-115.5.0
#6       merge time: 1 hour, 38 minutes and 54 seconds.


 * mail-client/thunderbird

     Thu Dec 14 08:45:34 2023 >>> mail-client/thunderbird-115.5.0
#1       merge time: 1 hour, 45 minutes and 21 seconds.

     Fri Dec 15 16:48:16 2023 >>> mail-client/thunderbird-115.5.0
#2       merge time: 1 hour, 45 minutes and 3 seconds.

     Sat Dec 16 01:22:00 2023 >>> mail-client/thunderbird-115.5.0
#3       merge time: 1 hour, 45 minutes and 10 seconds.

     Sat Dec 16 10:52:55 2023 >>> mail-client/thunderbird-115.5.0
#4       merge time: 1 hour, 44 minutes and 4 seconds.

     Tue Dec 19 20:13:18 2023 >>> mail-client/thunderbird-115.5.0
#5       merge time: 1 hour, 44 minutes and 36 seconds.

     Thu Dec 21 14:46:34 2023 >>> mail-client/thunderbird-115.5.0
#6       merge time: 1 hour, 46 minutes.


Last edited by rfx on Fri Dec 22, 2023 8:32 am; edited 1 time in total
Back to top
View user's profile Send private message
Spanik
Veteran
Veteran


Joined: 12 Dec 2003
Posts: 1001
Location: Belgium

PostPosted: Tue Dec 19, 2023 3:20 pm    Post subject: Reply with quote

The only ones I find that have already passed here:

Code:
~ $ emlop l -e sys-devel/gcc
2021-08-22 16:38:45    37:52 sys-devel/gcc-10.3.0-r2
2021-11-08 13:10:59    35:57 sys-devel/gcc-11.2.0
2022-03-12 10:43:40    34:19 sys-devel/gcc-11.2.1_p20220115
2022-06-11 10:34:29    32:42 sys-devel/gcc-11.3.0
2023-01-07 13:05:31    33:29 sys-devel/gcc-11.3.1_p20221209
2023-01-09 19:11:28  3:58:55 sys-devel/gcc-11.3.1_p20221209
2023-01-09 21:01:11    56:58 sys-devel/gcc-11.3.1_p20221209
2023-01-29 13:49:03    49:37 sys-devel/gcc-12.2.1_p20230121-r1
2023-04-27 15:57:17    49:59 sys-devel/gcc-12.2.1_p20230304
2023-05-26 17:28:04    53:08 sys-devel/gcc-12.2.1_p20230428-r1
2023-07-14 22:21:36    53:37 sys-devel/gcc-12.3.1_p20230526
2023-11-17 16:17:46    35:52 sys-devel/gcc-13.2.1_p20230826

The one that took 4 hours is funny. No idea why it takes a bit more than 30 minutes one time and almost an hour the other time. I would think it would always be similar on the same pc when you don't change things like cpu or memory.
Code:
emlop l -e www-client/firefox
2021-12-09 13:01:03  15:25 www-client/firefox-91.3.0

Code:
emlop l -e dev-lang/rust
2021-08-22 18:05:29  27:29 dev-lang/rust-1.53.0
2021-12-16 17:16:13  22:20 dev-lang/rust-1.56.1
2022-01-26 15:43:35  21:43 dev-lang/rust-1.58.1
2022-05-01 11:57:11  21:17 dev-lang/rust-1.59.0
2022-06-11 10:55:24  20:55 dev-lang/rust-1.60.0
2022-08-21 11:39:31  21:51 dev-lang/rust-1.62.1
2022-10-21 08:51:29  22:48 dev-lang/rust-1.64.0-r1
2022-12-03 12:28:27  22:09 dev-lang/rust-1.65.0
2023-01-29 14:36:06  21:09 dev-lang/rust-1.66.1
2023-07-14 23:41:02  21:29 dev-lang/rust-1.69.0-r1
2023-09-25 10:18:17  39:59 dev-lang/rust-1.71.1

Code:
emlop l -e sys-devel/clang
2021-12-09 12:33:50   9:41 sys-devel/clang-12.0.1
2023-01-09 22:01:37  14:44 sys-devel/clang-15.0.6-r1
2023-01-29 15:00:04  11:09 sys-devel/clang-15.0.7-r1
2023-05-26 18:19:21  11:06 sys-devel/clang-15.0.7-r1
2023-07-15 03:12:18  12:03 sys-devel/clang-16.0.5
2023-09-25 11:15:35  11:56 sys-devel/clang-16.0.6

Code:
emlop l -e net-libs/nodejs
2021-12-09 12:43:52  5:19 net-libs/nodejs-14.17.6


Code:
uname -a
Linux daw 6.1.57-gentoo #1 SMP PREEMPT_DYNAMIC Sun Nov 19 11:45:26 CET 2023 x86_64 AMD EPYC 7401P 24-Core Processor AuthenticAMD GNU/Linux


Looks like a need an update for some of those things :)
_________________
Expert in non-working solutions
Back to top
View user's profile Send private message
myga
Tux's lil' helper
Tux's lil' helper


Joined: 12 Jun 2023
Posts: 121

PostPosted: Sat Dec 23, 2023 3:30 am    Post subject: Reply with quote

Today I realized that www-client/thunderbird was built with clang USE FLAG and caused a build error. I removed it and emerged again and it looks it took longer to build this time.

Code:
# genlop -t thunderbird
 * mail-client/thunderbird

     Fri Dec  8 23:06:02 2023 >>> mail-client/thunderbird-115.5.0
       merge time: 32 minutes and 31 seconds.

     Fri Dec 22 20:18:34 2023 >>> mail-client/thunderbird-115.6.0
       merge time: 40 minutes and 20 seconds.
Back to top
View user's profile Send private message
eccerr0r
Watchman
Watchman


Joined: 01 Jul 2004
Posts: 9824
Location: almost Mile High in the USA

PostPosted: Sat Dec 23, 2023 5:17 am    Post subject: Reply with quote

More Atom 1.6GHz (N270 i686 1C2T, 2GiB RAM, mPCIe SSD):

2023-07-25T06:42:38 >>> sys-devel/gcc-12.3.1_p20230526: 17:44:15
2023-07-26T11:12:24 >>> dev-lang/rust-1.69.0-r1: 15:57:01
2022-08-30T02:50:57 >>> dev-util/cbindgen-0.24.3: 38′15″
2023-07-27T20:38:35 >>> gnome-base/librsvg-2.56.0: 1:15:42

I would hope these are not as corrupted by distcc but they may well still be due to --jobs ...
_________________
Intel Core i7 2700K/Radeon R7 250/24GB DDR3/256GB SSD
What am I supposed watching?
Back to top
View user's profile Send private message
sdauth
l33t
l33t


Joined: 19 Sep 2018
Posts: 650
Location: Ásgarðr

PostPosted: Sat Dec 23, 2023 5:59 am    Post subject: Reply with quote

A funny one (A106800K @ 4.1Ghz Piledriver)

Code:
     Tue Jun 27 04:00:07 2023 >>> sys-devel/gcc-12.3.1_p20230526
       merge time: 10 hours, 7 minutes and 25 seconds.

     Thu Oct 19 01:02:37 2023 >>> sys-devel/gcc-12.3.1_p20230825
       merge time: 4 hours, 33 minutes and 27 seconds.


I was very surprised (and pleased) to see the speed improvement. What happened ? Same use flags (ada, lto, pgo, objc..) and both compiled while nothing else was running.
Back to top
View user's profile Send private message
myga
Tux's lil' helper
Tux's lil' helper


Joined: 12 Jun 2023
Posts: 121

PostPosted: Sun Dec 24, 2023 3:38 am    Post subject: Reply with quote

sdauth wrote:
A funny one (A106800K @ 4.1Ghz Piledriver)

Code:
     Tue Jun 27 04:00:07 2023 >>> sys-devel/gcc-12.3.1_p20230526
       merge time: 10 hours, 7 minutes and 25 seconds.

     Thu Oct 19 01:02:37 2023 >>> sys-devel/gcc-12.3.1_p20230825
       merge time: 4 hours, 33 minutes and 27 seconds.


I was very surprised (and pleased) to see the speed improvement. What happened ? Same use flags (ada, lto, pgo, objc..) and both compiled while nothing else was running.


the flags lto and pgo quadruple build time and I don't see a reason for me to use them. Your build time was reduced significantly due to gcc not needing to rebuild most or all of its code and only the code that was committed is what was built.
Back to top
View user's profile Send private message
superjaded
l33t
l33t


Joined: 05 Jul 2002
Posts: 802

PostPosted: Mon Dec 25, 2023 2:01 am    Post subject: Reply with quote

Code:
2023-09-25T05:07:47 >>> sys-devel/gcc-13.2.1_p20230826: 18 minutes, 13 seconds
2023-11-02T16:49:06 >>> sys-devel/clang-16.0.6: 7 minutes, 31 seconds
2023-02-04T18:11:01 >>> www-client/firefox-109.0.1: 17 minutes, 47 seconds


AMD Ryzen 9 7950X 16-Core Processor (-j16 since this system only has 32GB of memory)

Code:
2023-09-25T21:48:48 >>> sys-devel/gcc-13.2.1_p20230826: 51 minutes, 21 seconds
2023-12-16T16:28:42 >>> sys-devel/clang-16.0.6: 18 minutes, 17 seconds
2023-02-10T05:27:50 >>> www-client/firefox-102.7.0: 52 minutes, 14 seconds


2x Intel(R) Xeon(R) CPU E5-2670 0 @ 2.60GHz (-j32, 192GB of memory)

Firefox examples probably aren't great since I normally use www-client/librewolf-bin for my browser which is why those are crazy old versions, but those were compiled with lto and pgo fwiw.
Back to top
View user's profile Send private message
mid-kid
n00b
n00b


Joined: 24 Aug 2014
Posts: 16

PostPosted: Sat Dec 30, 2023 5:01 pm    Post subject: Reply with quote

I suggest using a command like:
Code:
qlist -Iv | xargs sudo qlop -Mma | sort -k 2 -nr | head -n 10

In order to obtain the 10 longest-to-compile packages on any given system.

For me, that is:
Code:
dev-qt/qtwebengine: 16327 average for 1 merge
sys-devel/gcc: 12383 average for 1 merge
app-office/libreoffice: 7795 average for 1 merge
sys-devel/llvm: 6484 average for 6 merges
www-client/firefox: 5410 average for 1 merge
dev-lang/rust: 5098 average for 1 merge
sys-devel/clang: 4253 average for 3 merges
app-doc/doxygen: 4154 average for 1 merge
net-libs/nodejs: 4027 average for 1 merge
dev-util/mingw64-toolchain: 3676 average for 1 merge


Some averages here are skewed due to the occasional binary merge (downgrading llvm or gcc, primarily).

Code:
$ sudo genlop -t dev-qt/qtwebengine sys-devel/gcc app-office/libreoffice sys-devel/llvm www-client/firefox
 * dev-qt/qtwebengine

     Tue Dec 19 04:13:49 2023 >>> dev-qt/qtwebengine-5.15.11_p20231120
       merge time: 4 hours, 32 minutes and 7 seconds.

 * sys-devel/gcc

     Wed Dec 20 02:28:40 2023 >>> sys-devel/gcc-12.3.1_p20230825
       merge time: 3 hours, 45 minutes and 9 seconds.

 * app-office/libreoffice

     Fri Dec 22 00:07:56 2023 >>> app-office/libreoffice-7.5.6.2
       merge time: 2 hours, 9 minutes and 55 seconds.

 * sys-devel/llvm

     Tue Aug  1 08:08:28 2023 >>> sys-devel/llvm-16.0.6
       merge time: 2 hours, 22 minutes and 9 seconds.

 * www-client/firefox

     Sat Dec 16 16:32:04 2023 >>> www-client/firefox-115.5.0
       merge time: 1 hour, 30 minutes and 10 seconds.


Code:
Host: 20MUCTO1WW ThinkPad A485
Kernel: 6.1.60
CPU: AMD Ryzen 5 PRO 2500U w/ Radeon Vega Mobile Gfx (8) @ 2.000GHz
Memory: 22919MiB


USE="pgo lto"; CFLAGS="-pipe -march=znver1 -O3 -fuse-linker-plugin -flto=4 --param=lto-max-streaming-parallelism=4 -fgraphite-identity -floop-nest-optimize -fdevirtualize-at-ltrans -fipa-pta -fno-semantic-interposition"
Though I disable USE=pgo for firefox these days. Updates too often and takes too long.[/code]
Back to top
View user's profile Send private message
eeckwrk99
Apprentice
Apprentice


Joined: 14 Mar 2021
Posts: 232
Location: Gentoo forums

PostPosted: Sat Dec 30, 2023 5:25 pm    Post subject: Reply with quote

mid-kid wrote:
I suggest using a command like:
Code:
qlist -Iv | xargs sudo qlop -Mma | sort -k 2 -nr | head -n 10

In order to obtain the 10 longest-to-compile packages on any given system.


Nice one. You don't need sudo for qlop though.

Edit: Nevermind, you actually do. My current user was still in the Portage group when I wrote this :)


Last edited by eeckwrk99 on Sun Dec 31, 2023 10:09 pm; edited 2 times in total
Back to top
View user's profile Send private message
DavidF
n00b
n00b


Joined: 12 Jan 2004
Posts: 45
Location: Rocky Mountains

PostPosted: Sat Dec 30, 2023 7:30 pm    Post subject: Reply with quote

Code:

i9-13900k

Mon Sep 25 10:22:49 2023 >>> sys-devel/gcc-13.2.1_p20230826
       merge time: 17 minutes and 46 seconds
Thu Dec 28 08:02:29 2023 >>> mail-client/thunderbird-115.6.0
       merge time: 6 minutes and 54 seconds.
[/code]
Back to top
View user's profile Send private message
pietinger
Moderator
Moderator


Joined: 17 Oct 2006
Posts: 5104
Location: Bavaria

PostPosted: Sat Dec 30, 2023 9:51 pm    Post subject: Reply with quote

DavidF,

do you have running many other tasks when you do your emerge world ?

I have also an i9-13900K - using only -j24 (instead of possible -j32 ... because of CPU heat) =>
Code:
 * sys-devel/gcc

     Tue Nov 21 14:11:13 2023 >>> sys-devel/gcc-13.2.1_p20230826
       merge time: 12 minutes and 37 seconds.

with a manually configured kernel where almost every security feature is ENABLED ... so it should be slower than yours ... ?
_________________
https://wiki.gentoo.org/wiki/User:Pietinger
Back to top
View user's profile Send private message
Display posts from previous:   
Reply to topic    Gentoo Forums Forum Index Gentoo Chat All times are GMT
Goto page 1, 2  Next
Page 1 of 2

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum