Gentoo Forums
Gentoo Forums
Gentoo Forums
Quick Search: in
Portage crashes terminal, unable to compile @world set
View unanswered posts
View posts from last 24 hours

 
Reply to topic    Gentoo Forums Forum Index Portage & Programming
View previous topic :: View next topic  
Author Message
picarica
Guru
Guru


Joined: 11 Aug 2018
Posts: 338

PostPosted: Fri Jan 31, 2025 10:34 am    Post subject: Portage crashes terminal, unable to compile @world set Reply with quote

so i have this weird issue, where i do a basic world upgrade
Code:

$ sudo emerge --sync;sudo emerge -a --verbose --update --deep --newuse --keep-going --with-bdeps=y @world && sudo emerge @smart-live-rebuild

and i left my computer come back and my terminal crashed/closed and nothing was merged scusefully.
i chcekd emerge.log and the only thing there is this
Code:

1738223414: Started emerge on: Jan 30, 2025 08:50:14
1738223414:  *** emerge --newuse --update --ask --deep --keep-going --with-bdeps=y --regex-search-auto=y --verbose @world
1738237092:  >>> emerge (1 of 45) sci-libs/composable-kernel-6.1.1 to /
1738237092:  === (1 of 45) Cleaning (sci-libs/composable-kernel-6.1.1::/var/db/repos/gentoo/sci-libs/composable-kernel/composable-kernel-6.1.1.ebuild)
1738237092:  === (1 of 45) Compiling/Merging (sci-libs/composable-kernel-6.1.1::/var/db/repos/gentoo/sci-libs/composable-kernel/composable-kernel-6.1.1.ebuild)
1738258090:  >>> emerge (1 of 42) sci-libs/hipBLASLt-6.1.1-r1 to /
1738258090:  === (1 of 42) Cleaning (sci-libs/hipBLASLt-6.1.1-r1::/var/db/repos/gentoo/sci-libs/hipBLASLt/hipBLASLt-6.1.1-r1.ebuild)
1738258090:  === (1 of 42) Compiling/Merging (sci-libs/hipBLASLt-6.1.1-r1::/var/db/repos/gentoo/sci-libs/hipBLASLt/hipBLASLt-6.1.1-r1.ebuild)
~                                                                                                                                                                   

arethere more debugging tools i could use to get more info? i have no diea what is going on

this is my make.conf
Code:

# These settings were set by the catalyst build script that automatically
# built this stage.
# Please consult /usr/share/portage/config/make.conf.example for a more
# detailed example.
COMMON_FLAGS="-march=x86-64 -mtune=generic -O2 -pipe"
CFLAGS="${COMMON_FLAGS}"
CXXFLAGS="${COMMON_FLAGS}"
FCFLAGS="${COMMON_FLAGS}"
FFLAGS="${COMMON_FLAGS}"
#USE="nettle  -openssl zip heif vaapi libdrm sv-av1 -qt5 qt6 quick ensurepip sambaclient libass srt x265 X pdf ffmpeg extra mad wavpack -flac sound-server egl gles2 -accessiblity wxwidgets winbind samba apparmor -nanovdb -ruby mtp cycles-bin-kernels -openvdb svg tiff -gstreamer oidn icons -webengine webp pdfimport rar xinerama cups lm-sensors compress initramfs jemalloc brotli theora mount gnutls symlink opus vpx non-root -minimal modemmanager -sdk -thunderbolt sddm networkmanager gtk3 pulseaudio grub gtk glex2 display-manager lock xorg qml wayland minizip systemd llvm -lvm -zstd -elogind -handbooks kwallet -firewall -flatpak -crash-handler -crypt bluetooth -crash-handler -firewall -sdk -semantic-desktop -vlc -wifi -wext -handbook -designer -libnotify -sendmail  -thin -eds -gtk-doc -nls -gnome-online-accounts -colord -nautilus -gnome  -osl -cdr -fem -vtk -slideshow -cdr -exif -colord -nss"

USE="hip rocm opencl dri symlink harfbuzz keyring vdpau libdrm vaapi winbind mount NetworkManager pipewire-alsa quick bundled-libs accessibility dav1d libaom avif av1 sound-server libass srt -jack ffmpeg extra twolame mpg123 opus usbredir mtp fdk gd rar theora zip -rdp samba ssh dolphin lvm grub dbus dist-kernel networkmanager kwallet plymouth display-manager -crypt -cryptsetup cups systemd device-mapper modules dist-kernel -discover -firewall -flatpak -handbook -dvd -vlc -wifi -bluetooth -wext -nanovdb -openvdb dracut kms -kernel_linux"

MAKEOPTS="-j12"
#EMERGE_DEFAULT_OPTS="--jobs 12"
ACCEPT_LICENSE="*"

VIDEO_CARDS="amdgpu radeonsi radeon"
# NOTE: This stage was built with the bindist Use flag enabled

ACCEPT_LICENSE="*"
# This sets the language of build output to English.
# Please keep this setting intact when reporting bugs.
LC_MESSAGES=C
LINGUAS="ie sk en"
L10N="sk en en-GB"


GENTOO_MIRRORS="http://tux.rainside.sk/gentoo/ ftp://tux.rainside.sk/gentoo/ https://mirror.wheel.sk/gentoo http://mirror.wheel.sk/gentoo"
GRUB_PLATFORMS="efi-64"
Back to top
View user's profile Send private message
Zucca
Moderator
Moderator


Joined: 14 Jun 2007
Posts: 3930
Location: Rasi, Finland

PostPosted: Fri Jan 31, 2025 12:28 pm    Post subject: Reply with quote

What if you run the emerge -command inside of a terminal multiplexer (like tmux) or in virtual console?
What terminal emulator you use?
_________________
..: Zucca :..

My gentoo installs:
init=/sbin/openrc-init
-systemd -logind -elogind seatd

Quote:
I am NaN! I am a man!
Back to top
View user's profile Send private message
Banana
Moderator
Moderator


Joined: 21 May 2004
Posts: 1886
Location: Germany

PostPosted: Fri Jan 31, 2025 1:22 pm    Post subject: Reply with quote

And sometimes sudo can be the troublemaker.

Is it clear where the whole command chain breaks?
Could it be
Code:
sudo emerge -a --verbose --update --deep --newuse --keep-going --with-bdeps=y @world
or
Code:
sudo emerge @smart-live-rebuild
?
_________________
Forum Guidelines

PFL - Portage file list - find which package a file or command belongs to.
My delta-labs.org snippets do expire
Back to top
View user's profile Send private message
leonik375
n00b
n00b


Joined: 19 Jul 2016
Posts: 12

PostPosted: Fri Jan 31, 2025 3:29 pm    Post subject: Reply with quote

Can it be 'out of memory' problem?
Just in case
Back to top
View user's profile Send private message
logrusx
Advocate
Advocate


Joined: 22 Feb 2018
Posts: 2688

PostPosted: Fri Jan 31, 2025 4:28 pm    Post subject: Re: Portage crashes terminal, unable to compile @world set Reply with quote

picarica wrote:
Code:

1738258090:  === (1 of 42) Compiling/Merging (sci-libs/hipBLASLt-6.1.1-r1::/var/db/repos/gentoo/sci-libs/hipBLASLt/hipBLASLt-6.1.1-r1.ebuild)
~                                                                                                                                                                   

arethere more debugging tools i could use to get more info? i have no diea what is going on


Look into yout PORTAGE_TEMPDIR/<category>/<package>/temp/build.log

If the system has not crashed, grep for OOM's in your logs.

Also post your emerge --info. You should actually almost always do that. Answer the questions of posters before me, they are all relevant.

Best Regards,
Georgi
Back to top
View user's profile Send private message
picarica
Guru
Guru


Joined: 11 Aug 2018
Posts: 338

PostPosted: Fri Jan 31, 2025 5:15 pm    Post subject: Reply with quote

Quote:
What if you run the emerge -command inside of a terminal multiplexer (like tmux) or in virtual console?
What terminal emulator you use?

will try that tomorrow, and i am using terminator, i eve tried having two tabs open in terminator and only where the emerge was happening closed, the other tab (btop opened) was still open, so terminator itself didnt crash

Quote:
And sometimes sudo can be the troublemaker.

Is it clear where the whole command chain breaks?
Could it be

will try as root and in screen -R tomorrow or tmux, but i think it doesnt reach @smar-live-rebuild


Quote:
Can it be 'out of memory' problem?
Just in case

i am running on 32GB of RAM with another 16GB of SWAP so would hope note, i can merge qtwebengine fine.

Quote:
Look into yout PORTAGE_TEMPDIR/<category>/<package>/temp/build.log

If the system has not crashed, grep for OOM's in your logs.

Also post your emerge --info. You should actually almost always do that. Answer the questions of posters before me, they are all relevant.


this iwas most intresting i think i looked into
Code:
/var/tmp/portage/sci-libs/hipBLASLt-6.1.1-r1/temp/build.log

# and found
....
-- <<< Gentoo configuration >>>
Build type      RelWithDebInfo
Install path    /usr
Compiler flags:
C               
C++              -D__HIP_HCC_COMPAT_MODE__=1
Linker flags:
Executable      -Wl,-O1 -Wl,--as-needed -Wl,-z,pack-relative-relocs
Module          -Wl,-O1 -Wl,--as-needed -Wl,-z,pack-relative-relocs
Shared          -Wl,-O1 -Wl,--as-needed -Wl,-z,pack-relative-relocs

-- Configuring done (26.7s)
-- Generating done (0.0s)
-- Build files have been written to: /var/tmp/portage/sci-libs/hipBLASLt-6.1.1-r1/work/hipBLASLt-rocm-6.1.1_build
>>> Source configured.
>>> Compiling source in /var/tmp/portage/sci-libs/hipBLASLt-6.1.1-r1/work/hipBLASLt-rocm-6.1.1 ...
 * Source directory (CMAKE_USE_DIR): "/var/tmp/portage/sci-libs/hipBLASLt-6.1.1-r1/work/hipBLASLt-rocm-6.1.1"
 * Build directory  (BUILD_DIR):     "/var/tmp/portage/sci-libs/hipBLASLt-6.1.1-r1/work/hipBLASLt-rocm-6.1.1_build"
ninja -v -j12 -l0
[1/34] cd /var/tmp/portage/sci-libs/hipBLASLt-6.1.1-r1/work/hipBLASLt-rocm-6.1.1_build/virtualenv/lib/python3.12/site-packages/Tensile/Ops && /usr/bin/cmake -E rm -rf /var/tmp/portage/sci-libs/hipBLASLt-6.1.1-r1/work/hipBLASLt-rocm-6.1.1_build/library/build_tmp/ops && /usr/bin/cmake -E make_directory /var/tmp/portage/sci-libs/hipBLASLt-6.1.1-r1/work/hipBLASLt-rocm-6.1.1_build/library/build_tmp/ops && /usr/bin/cmake -E make_directory /var/tmp/portage/sci-libs/hipBLASLt-6.1.1-r1/work/hipBLASLt-rocm-6.1.1_build/Tensile/library && bash /var/tmp/portage/sci-libs/hipBLASLt-6.1.1-r1/work/hipBLASLt-rocm-6.1.1_build/virtualenv/lib/python3.12/site-packages/Tensile/Source/..//Ops/gen_assembly.sh "gfx90a;gfx940;gfx941;gfx942" /var/tmp/portage/sci-libs/hipBLASLt-6.1.1-r1/work/hipBLASLt-rocm-6.1.1_build/library/build_tmp/ops /var/tmp/portage/sci-libs/hipBLASLt-6.1.1-r1/work/hipBLASLt-rocm-6.1.1_build/virtualenv && /usr/bin/cmake -E copy /var/tmp/portage/sci-libs/hipBLASLt-6.1.1-r1/work/hipBLASLt-rocm-6.1.1_build/library/build_tmp/ops/hipblasltExtOpLibrary.dat /var/tmp/portage/sci-libs/hipBLASLt-6.1.1-r1/work/hipBLASLt-rocm-6.1.1_build/library/build_tmp/ops/extop_*.co /var/tmp/portage/sci-libs/hipBLASLt-6.1.1-r1/work/hipBLASLt-rocm-6.1.1_build/Tensile/library
Creating code object for arch gfx90a
Creating code object for arch gfx940
Creating code object for arch gfx941
Creating code object for arch gfx942
# thats it nothing after that


more intresting was build.log of compsoable kernel

i put it here it seems like it fails after hours of compilation for a reason i dont understand maybe this is the cause?

also sorry i forgot here is --info

Code:
emerge --info
Portage 3.0.66.1 (python 3.12.8-final-0, default/linux/amd64/23.0/desktop/plasma/systemd, gcc-14, glibc-2.40-r8, 6.6.69-cachyos-6.6.69-x86_64 x86_64)
=================================================================
System uname: Linux-6.6.69-cachyos-6.6.69-x86_64-x86_64-AMD_Ryzen_5_5600X_6-Core_Processor-with-glibc2.40
KiB Mem:    32784796 total,  24484464 free
KiB Swap:   15624188 total,  15607548 free
Head commit of repository gentoo: cc597403231578f46143811e76287cb785275707

Timestamp of repository CachyOS-kernels: Tue, 28 Jan 2025 07:37:11 +0000
Head commit of repository CachyOS-kernels: dba5abab311c7c632b001f31993753c7cda77132

Timestamp of repository FireBurn: Wed, 29 Jan 2025 23:33:19 +0000
Head commit of repository FireBurn: d74bf88a04165bef9f59209293220b57299e534e

Timestamp of repository binaryden: Wed, 29 Jan 2025 23:33:23 +0000
Head commit of repository binaryden: 1f403cb3d528f1e17b8c00f2cbd481fb7cc737b2

Timestamp of repository gentoo-bootstrap: Tue, 28 Jan 2025 07:37:00 +0000
Head commit of repository gentoo-bootstrap: b805f9295d8679ab308b26d7df563489f42548b6

Timestamp of repository guru: Wed, 29 Jan 2025 23:33:23 +0000
Head commit of repository guru: da47029dd4aaa8c1c6d13112554130319ca08e74

Timestamp of repository lanodanOverlay: Tue, 28 Jan 2025 07:36:46 +0000
Head commit of repository lanodanOverlay: 8a09c1b732496be394852ae6277a820281b7d42c

Head commit of repository picarica-overlay: e421ee640d206768366fc6b1d89f20ba9ceef19a

Timestamp of repository src_prepare-overlay: Wed, 15 Jan 2025 14:48:28 +0000
Head commit of repository src_prepare-overlay: 444efe63229d50268016d062952f9ffcd7c9a545

Timestamp of repository steam-overlay: Wed, 29 Jan 2025 23:33:21 +0000
Head commit of repository steam-overlay: 215a03000825d2d3b300d99915d5b4288ee879fb

Timestamp of repository thegreatmcpain: Wed, 29 Jan 2025 23:33:25 +0000
Head commit of repository thegreatmcpain: 7050408e55d120fef24cd33e65aa9c5c1883b24c

sh bash 5.2_p37
ld GNU ld (Gentoo 2.43 p3) 2.43.1
app-misc/pax-utils:        1.3.8::gentoo
app-shells/bash:           5.2_p37::gentoo
dev-build/autoconf:        2.13-r8::gentoo, 2.72-r1::gentoo
dev-build/automake:        1.16.5-r2::gentoo
dev-build/cmake:           3.30.6::gentoo
dev-build/libtool:         2.5.4::gentoo
dev-build/make:            4.4.1-r100::gentoo
dev-build/meson:           1.6.1::gentoo
dev-java/java-config:      2.3.4::gentoo
dev-lang/perl:             5.40.0-r1::gentoo
dev-lang/python:           3.10.16_p1::gentoo, 3.12.8_p1::gentoo, 3.13.1_p1::gentoo
dev-lang/rust-bin:         1.82.0-r101::gentoo, 1.83.0::gentoo
llvm-core/clang:           17.0.6::gentoo, 18.1.8-r6::gentoo, 19.1.6::gentoo
llvm-core/lld:             17.0.6::gentoo, 18.1.8::gentoo, 19.1.6::gentoo
llvm-core/llvm:            17.0.6-r3::gentoo, 18.1.8-r6::gentoo, 19.1.6::gentoo
sys-apps/baselayout:       2.17::gentoo
sys-apps/sandbox:          2.39::gentoo
sys-apps/systemd:          256.10::gentoo
sys-devel/binutils:        2.43-r2::gentoo
sys-devel/binutils-config: 5.5.2::gentoo
sys-devel/gcc:             12.4.1_p20241219::gentoo, 13.3.1_p20241220::gentoo, 14.2.1_p20241221::gentoo
sys-devel/gcc-config:      2.12.1::gentoo
sys-kernel/linux-headers:  6.6-r1::gentoo (virtual/os-headers)
sys-libs/glibc:            2.40-r8::gentoo
Repositories:

gentoo
    location: /var/db/repos/gentoo
    sync-type: git
    sync-uri: https://gitweb.gentoo.org/repo/gentoo.git
    priority: -1000
    volatile: False

CachyOS-kernels
    location: /var/db/repos/CachyOS-kernels
    sync-type: git
    sync-uri: https://github.com/gentoo-mirror/CachyOS-kernels.git
    masters: gentoo
    volatile: False

FireBurn
    location: /var/db/repos/FireBurn
    sync-type: git
    sync-uri: https://github.com/gentoo-mirror/FireBurn.git
    masters: gentoo
    volatile: False

binaryden
    location: /var/db/repos/binaryden
    sync-type: git
    sync-uri: https://github.com/gentoo-mirror/binaryden.git
    masters: gentoo
    volatile: False

gentoo-bootstrap
    location: /var/db/repos/gentoo-bootstrap
    sync-type: git
    sync-uri: https://github.com/gentoo-mirror/gentoo-bootstrap.git
    masters: gentoo
    volatile: False

guru
    location: /var/db/repos/guru
    sync-type: git
    sync-uri: https://github.com/gentoo-mirror/guru.git
    masters: gentoo
    volatile: False

lanodanOverlay
    location: /var/db/repos/lanodanOverlay
    sync-type: git
    sync-uri: https://github.com/gentoo-mirror/lanodanOverlay.git
    masters: gentoo guru gentoo-bootstrap
    volatile: False

picarica-overlay
    location: /var/db/repos/picarica-overlay
    sync-type: git
    sync-uri: https://gitlab.com/picarica/picarica-overlay
    masters: gentoo
    volatile: False

src_prepare-overlay
    location: /var/db/repos/src_prepare-overlay
    sync-type: git
    sync-uri: https://github.com/gentoo-mirror/src_prepare-overlay.git
    masters: gentoo
    volatile: False

steam-overlay
    location: /var/db/repos/steam-overlay
    sync-type: git
    sync-uri: https://github.com/gentoo-mirror/steam-overlay.git
    masters: gentoo
    volatile: False

thegreatmcpain
    location: /var/db/repos/thegreatmcpain
    sync-type: git
    sync-uri: https://github.com/gentoo-mirror/thegreatmcpain.git
    masters: gentoo
    volatile: False

ACCEPT_KEYWORDS="amd64"
ACCEPT_LICENSE="*"
CBUILD="x86_64-pc-linux-gnu"
CFLAGS="-march=x86-64 -mtune=generic -O2 -pipe"
CHOST="x86_64-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/lib64/libreoffice/program/sofficerc /usr/share/config /usr/share/gnupg/qualified.txt /var/bind"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/texmf/language.dat.d /etc/texmf/language.def.d /etc/texmf/updmap.d /etc/texmf/web2c"
CXXFLAGS="-march=x86-64 -mtune=generic -O2 -pipe"
DISTDIR="/var/cache/distfiles"
ENV_UNSET="CARGO_HOME DBUS_SESSION_BUS_ADDRESS DISPLAY GDK_PIXBUF_MODULE_FILE GOBIN GOPATH PERL5LIB PERL5OPT PERLPREFIX PERL_CORE PERL_MB_OPT PERL_MM_OPT XAUTHORITY XDG_CACHE_HOME XDG_CONFIG_HOME XDG_DATA_HOME XDG_RUNTIME_DIR XDG_STATE_HOME"
FCFLAGS="-march=x86-64 -mtune=generic -O2 -pipe"
FEATURES="assume-digests binpkg-docompress binpkg-dostrip binpkg-logs binpkg-multi-instance buildpkg-live config-protect-if-modified distlocks ebuild-locks fixlafiles ipc-sandbox merge-sync merge-wait multilib-strict network-sandbox news parallel-fetch pid-sandbox pkgdir-index-trusted preserve-libs protect-owned qa-unresolved-soname-deps sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr"
FFLAGS="-march=x86-64 -mtune=generic -O2 -pipe"
GENTOO_MIRRORS="http://tux.rainside.sk/gentoo/ ftp://tux.rainside.sk/gentoo/ https://mirror.wheel.sk/gentoo http://mirror.wheel.sk/gentoo"
LANG="en_IE.utf8"
LDFLAGS="-Wl,-O1 -Wl,--as-needed -Wl,-z,pack-relative-relocs"
LEX="flex"
LINGUAS="ie sk en"
MAKEOPTS="-j12"
PKGDIR="/var/cache/binpkgs"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git"
PORTAGE_TMPDIR="/var/tmp"
SHELL="/bin/bash"
USE="NetworkManager X a52 aac accessibility acl acpi activities alsa amd64 av1 avif branding bundled-libs bzip2 cairo cdda cdr cet cups dav1d dbus declarative device-mapper display-manager dist-kernel dolphin dracut dri dts dvdr encode exif extra fdk ffmpeg flac gd gdbm gif gpm grub gtk gui harfbuzz hip iconv icu ipv6 jpeg kde keyring kf6compat kms kwallet lcms libaom libass libdrm libnotify libtirpc lvm mad mng modules mount mp3 mp4 mpeg mpg123 mtp multilib ncurses networkmanager nls ogg opencl opengl openmp opus pam pango pcre pdf pipewire pipewire-alsa plasma plymouth png policykit ppds pulseaudio qml qt5 qt6 quick rar readline rocm samba screencast sdl seccomp semantic-desktop sound sound-server spell srt ssh ssl startup-notification svg symlink systemd test-rust theora tiff truetype twolame udev udisks unicode upower usb usbredir vaapi vdpau vorbis vulkan wayland widgets winbind wxwidgets x264 xattr xcb xft xml xv xvid zip zlib" ABI_X86="64" ADA_TARGET="gcc_13" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_anon authn_dbm authn_file authz_dbm authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir env expires ext_filter file_cache filter headers include info log_config logio mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="karbon sheets words" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_X86="mmx mmxext sse sse2 aes avx avx2 f16c fma3 pclmul popcnt rdrand sha sse3 sse4_1 sse4_2 sse4a ssse3" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock greis isync itrax navcom oceanserver oncore rtcm104v2 rtcm104v3 sirf skytraq superstar2 tsip tripmate tnt ublox" GRUB_PLATFORMS="efi-64" GUILE_SINGLE_TARGET="3-0" GUILE_TARGETS="3-0" INPUT_DEVICES="libinput" KERNEL="linux" L10N="sk en en-GB" LCD_DEVICES="bayrad cfontz glk hd44780 lb216 lcdm001 mtxorb text" LUA_SINGLE_TARGET="lua5-1" LUA_TARGETS="lua5-1" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php8-2" POSTGRES_TARGETS="postgres16" PYTHON_SINGLE_TARGET="python3_12" PYTHON_TARGETS="python3_12" RUBY_TARGETS="ruby32" VIDEO_CARDS="amdgpu radeonsi radeon" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipp2p iface geoip fuzzy condition tarpit sysrq proto logmark ipmark dhcpmac delude chaos account"
Unset:  ADDR2LINE, AR, ARFLAGS, AS, ASFLAGS, CC, CCLD, CONFIG_SHELL, CPP, CPPFLAGS, CTARGET, CXX, CXXFILT, ELFEDIT, EMERGE_DEFAULT_OPTS, EXTRA_ECONF, F77FLAGS, FC, GCOV, GPROF, INSTALL_MASK, LC_ALL, LD, LFLAGS, LIBTOOL, MAKE, MAKEFLAGS, NM, OBJCOPY, OBJDUMP, PORTAGE_BINHOST, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS, PYTHONPATH, RANLIB, READELF, RUSTFLAGS, SIZE, STRINGS, STRIP, YACC, YFLAGS

Back to top
View user's profile Send private message
logrusx
Advocate
Advocate


Joined: 22 Feb 2018
Posts: 2688

PostPosted: Fri Jan 31, 2025 5:45 pm    Post subject: Reply with quote

picarica wrote:


more intresting was build.log of compsoable kernel

i put it here it seems like it fails after hours of compilation for a reason i dont understand maybe this is the cause?



It fails on a huge command and although you have more than 2GB per thread, this is a scientific package and it may have been an OOM kill. Just for perspective you can find the command here.

Your terminal might have crashed on its own or was the victim of the OOM killer. Is there something in the sys log?

Best Regards,
Georgi
Back to top
View user's profile Send private message
Banana
Moderator
Moderator


Joined: 21 May 2004
Posts: 1886
Location: Germany

PostPosted: Fri Jan 31, 2025 6:42 pm    Post subject: Reply with quote

Code:
MAKEOPTS="-j12"

Either lower it globally or per pacakge if you notice it crashes at a specific one.

Quote:
Jobs should also be limited by RAM. Recent gcc versions can take 1.5 GB to 2 GB of RAM per job. For systems with 8 logical CPUs and only 4 GB RAM, MAKEOPTS should be lowered to -j2 so that the system can run the basics and also compile without hitting swap very often slowing things down.

https://wiki.gentoo.org/wiki/MAKEOPTS

You said you can build qtwebengine just fine, but over time packages (sadly) grow and old settings can not work anymore.
_________________
Forum Guidelines

PFL - Portage file list - find which package a file or command belongs to.
My delta-labs.org snippets do expire
Back to top
View user's profile Send private message
tckosvic
Apprentice
Apprentice


Joined: 18 Apr 2023
Posts: 157

PostPosted: Fri Jan 31, 2025 8:11 pm    Post subject: Reply with quote

Try the commands one at a time instead of chaining them.
Back to top
View user's profile Send private message
logrusx
Advocate
Advocate


Joined: 22 Feb 2018
Posts: 2688

PostPosted: Fri Jan 31, 2025 8:18 pm    Post subject: Reply with quote

tckosvic wrote:
Try the commands one at a time instead of chaining them.


Nice observation. It made me go back and review the command run. I'd add to avoid --keep-going too. I think OP should check the previous emerge session as AFAIR --keep-going starts a new one on failure.

Best Regards,
Georgi
Back to top
View user's profile Send private message
ingenarel
n00b
n00b


Joined: 16 Jan 2025
Posts: 13

PostPosted: Sat Feb 01, 2025 1:18 am    Post subject: Reply with quote

i usually chain the two commands a lot, but for me, i just do
Code:
sudo emerge --ask --deep --verbose --update --newuse @world && sudo smart-live-rebuild

and this never personally broke for me
Back to top
View user's profile Send private message
logrusx
Advocate
Advocate


Joined: 22 Feb 2018
Posts: 2688

PostPosted: Sat Feb 01, 2025 4:49 pm    Post subject: Reply with quote

ingenarel wrote:


This is a support forum and a user is requesting help. Please refrain from making unnecessary posts not directly related to users requests for help. This is considered off topic in this forum. If you want to discuss something or express your opinion, Gentoo Chat is the appropriate forum.

Best Regards,
Georgi
Back to top
View user's profile Send private message
Hu
Administrator
Administrator


Joined: 06 Mar 2007
Posts: 23082

PostPosted: Sun Feb 02, 2025 2:15 pm    Post subject: Reply with quote

Administrator note: a tangential thread about the meaning of smart-live-rebuild was split off to Set/command smart-live-rebuild to keep this thread focused on OP's problem.
Back to top
View user's profile Send private message
picarica
Guru
Guru


Joined: 11 Aug 2018
Posts: 338

PostPosted: Mon Feb 03, 2025 6:04 pm    Post subject: Reply with quote

Banana wrote:
Code:
MAKEOPTS="-j12"

Either lower it globally or per pacakge if you notice it crashes at a specific one.

Quote:
Jobs should also be limited by RAM. Recent gcc versions can take 1.5 GB to 2 GB of RAM per job. For systems with 8 logical CPUs and only 4 GB RAM, MAKEOPTS should be lowered to -j2 so that the system can run the basics and also compile without hitting swap very often slowing things down.

https://wiki.gentoo.org/wiki/MAKEOPTS

You said you can build qtwebengine just fine, but over time packages (sadly) grow and old settings can not work anymore.

lowered it to -j6 , ran in tmux, and tmux session is nowhere to be found it crashed again, i found this in dmesg

Code:

[35915.647012] lowmem_reserve[]: 0 3163 31983 31983 31983
[35915.647016] Node 0 DMA32 free:121896kB boost:0kB min:6680kB low:9916kB high:13152kB reserved_highatomic:0KB active_anon:1077500kB inactive_anon:1903744kB active_file:0kB inactive_file:1844kB unevictable:0kB writepending:4kB present:3317072kB managed:3251072kB mlocked:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
[35915.647021] lowmem_reserve[]: 0 0 28820 28820 28820
[35915.647025] Node 0 Normal free:62792kB boost:0kB min:60868kB low:90380kB high:119892kB reserved_highatomic:2048KB active_anon:10661124kB inactive_anon:17732084kB active_file:18720kB inactive_file:20716kB unevictable:848kB writepending:308kB present:30133760kB managed:29518376kB mlocked:848kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
[35915.647029] lowmem_reserve[]: 0 0 0 0 0
[35915.647033] Node 0 DMA: 1*4kB (U) 1*8kB (U) 1*16kB (U) 1*32kB (U) 1*64kB (U) 1*128kB (U) 1*256kB (U) 1*512kB (U) 0*1024kB 1*2048kB (M) 2*4096kB (M) = 11260kB
[35915.647048] Node 0 DMA32: 422*4kB (UME) 277*8kB (UME) 288*16kB (UME) 264*32kB (UME) 200*64kB (UME) 143*128kB (UE) 108*256kB (UME) 50*512kB (UME) 12*1024kB (UME) 4*2048kB (U) 0*4096kB = 121792kB
[35915.647063] Node 0 Normal: 1503*4kB (UMEH) 699*8kB (UMEH) 887*16kB (UMEH) 531*32kB (UMEH) 169*64kB (UMEH) 37*128kB (UMEH) 4*256kB (UME) 3*512kB (UME) 2*1024kB (UM) 1*2048kB (U) 0*4096kB = 64996kB
[35915.647079] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
[35915.647081] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
[35915.647082] 23763 total pagecache pages
[35915.647083] 5561 pages in swap cache
[35915.647084] Free swap  = 0kB
[35915.647085] Total swap = 15624188kB
[35915.647086] 8366707 pages RAM
[35915.647087] 0 pages HighMem/MovableOnly
[35915.647088] 170505 pages reserved
[35915.647089] 0 pages cma reserved
[35915.647090] 0 pages hwpoisoned
[35915.647091] Tasks state (memory values in pages):
[35915.647092] [  pid  ]   uid  tgid total_vm      rss pgtables_bytes swapents oom_score_adj name
[35915.647096] [    942]     0   942    42857      263   364544      384          -250 systemd-journal
[35915.647100] [    970]     0   970     8229      341    86016      576         -1000 systemd-udevd
[35915.647103] [   1190]    61  1190     1586      191    61440       64             0 avahi-daemon
[35915.647106] [   1191]   101  1191     2186      433    57344      256          -900 dbus-daemon
[35915.647108] [   1194]     0  1194     3675      301    77824      224             0 systemd-logind
[35915.647111] [   1195]     0  1195     3485      268    73728      128             0 systemd-machine
[35915.647113] [   1196]     0  1196   645292      515   532480     7707             0 tailscaled
[35915.647115] [   1200]     0  1200      902      268    53248       64             0 dhcpcd
[35915.647118] [   1202]    61  1202     1586      195    57344       32             0 avahi-daemon
[35915.647120] [   1297]     0  1297     5552      282    86016      480             0 cupsd
[35915.647123] [   1299]     0  1299      878      160    49152       32             0 ntpd
[35915.647125] [   1300]   321  1300      914      192    57344       32             0 ntpd
[35915.647128] [   1301]     0  1301    20679      304   147456      544             0 smbd
[35915.647131] [   1302]   321  1302     1135      171    53248       32             0 ntpd
[35915.647134] [   1306]     0  1306   596866     2015   360448     1632          -999 containerd
[35915.647137] [   1314]     0  1314    37881      251   159744      480             0 sddm
[35915.647140] [   1353]     0  1353   626363     2574   458752     2656          -500 dockerd
[35915.647143] [   1356]     0  1356   267441      397   540672     7040             0 X
[35915.647145] [   1387]     0  1387    19981      253   118784      544             0 smbd-notifyd
[35915.647148] [   1389]     0  1389    19979      285   114688      512             0 smbd-cleanupd
[35915.647151] [   1612] 65534  1612     1530      227    57344       64             0 dnsmasq
[35915.647154] [   1613]     0  1613     1530       99    57344       64             0 dnsmasq
[35915.647157] [   1699]     0  1699    45055      283   143360      512             0 lact
[35915.647160] [   1706]     0  1706    20020      251   143360      480             0 sddm-helper
[35915.647163] [   1710]  1000  1710     4372      307    77824      544           100 systemd
[35915.647166] [   1712]  1000  1712     4264      224    69632      320           100 (sd-pam)
[35915.647169] [   1719]  1000  1719    31868     1686   151552     1470           200 pipewire
[35915.647172] [   1720]  1000  1720    82265      956   126976      672           200 wireplumber
[35915.647175] [   1721]  1000  1721    54158      312   233472     1024             0 startplasma-way
[35915.647177] [   1724]  1000  1724     2029      355    61440      416           200 dbus-daemon
[35915.647180] [   1734]  1000  1734     1994      146    49152      160             0 ssh-agent
[35915.647183] [   1744]  1000  1744    37511      151   151552      384           200 kwin_wayland_wr
[35915.647186] [   1747]  1000  1747 67184134      970  1298432    19133           200 baloo_file
[35915.647189] [   1748]  1000  1748   680566     5999  1302528    21882           200 kwin_wayland
[35915.647192] [   1756]     0  1756   116311      216   131072      480             0 udisksd
[35915.647195] [   1757]  1000  1757   134397      360   139264      352           200 xdg-desktop-por
[35915.647198] [   1767]  1000  1767   133452      191   139264      128           200 xdg-document-po
[35915.647201] [   1768]   102  1768    95327      145    98304      448             0 polkitd
[35915.647204] [   1772]  1000  1772    77510      255   110592       64           200 xdg-permission-
[35915.647207] [   1779]  1000  1779      636      181    45056        0           200 fusermount3
[35915.647210] [   1797]     0  1797    77789      430   106496      320             0 upowerd
[35915.647213] [   1855]  1000  1855   250973      420   548864    10272           200 Xwayland
[35915.647216] [   1917]  1000  1917    94598      234   106496       32           200 at-spi-bus-laun
[35915.647218] [   1933]  1000  1933   301896      477   606208     3584           200 ksmserver
[35915.647221] [   1935]  1000  1935   489722     1011   749568     5792           200 kded6
[35915.647224] [   1941]  1000  1941     1821      275    57344      128           200 dbus-daemon
[35915.647226] [   1947]  1000  1947    58177      172    86016       96           200 at-spi2-registr
[35915.647228] [   1989]  1000  1989    57368      223    81920      128           200 dconf-service
[35915.647231] [   2003]  1000  2003  1803982    10461  2347008    64800           200 plasmashell
[35915.647233] [   2005]  1000  2005    38984     2784   217088     5663           200 pipewire-pulse
[35915.647235] [   2038]  1000  2038   366023      567   589824     3104           200 kactivitymanage
[35915.647237] [   2041]  1000  2041   282998      252   503808     2592           200 gmenudbusmenupr
[35915.647240] [   2042]  1000  2042   301967      389   622592     3680           200 kaccess
[35915.647242] [   2043]  1000  2043   370989      275   634880     3360           200 polkit-kde-auth
[35915.647244] [   2044]  1000  2044   425540      703   651264     3136           200 org_kde_powerde
[35915.647246] [   2045]  1000  2045   398747     3341   737280     2688           200 xdg-desktop-por
[35915.647249] [   2046]  1000  2046   282825      377   495616     2464           200 xembedsniproxy
[35915.647251] [   2093]  1000  2093     1967      235    61440       32           200 xsettingsd
[35915.647253] [   2159]  1000  2159   103527      292   176128     1056           200 xdg-desktop-por
[35915.647255] [   2202]     0  2202    77655      253   102400      160             0 power-profiles-
[35915.647257] [   2297]  1000  2297   607199     1750   921600    14816           200 nextcloud
[35915.647260] [   2304]  1000  2304   433914      462   741376     6208           200 xwaylandvideobr
[35915.647266] [   2309]  1000  2309   349338     3024  1957888    55221           200 telegram-deskto
[35915.647269] [   2329]  1000  2329   572357      320   974848    52991           200 sunshine
[35915.647271] [   2638]  1000  2638   372617      522   655360     3872           200 kwalletd6
[35915.647273] [   3367]  1000  3367     2769      192    61440      288           200 bash
[35915.647275] [   3560]  1000  3560     6395      128   106496       64           200 srt-logger
[35915.647278] [   3598]  1000  3598   215851     1151  1073152    15903           200 steam
[35915.647280] [   3735]  1000  3735     6120      192   102400       64           200 steam-runtime-s
[35915.647282] [   3747]  1000  3747     6122      160   102400       64           200 srt-logger
[35915.647285] [   3763]  1000  3763     1162      151    53248       32           200 srt-bwrap
[35915.647287] [   3966]  1000  3966    79896       96   139264      160           200 steam-runtime-l
[35915.647289] [   4024]  1000  4024     7332      128   118784       64           200 pressure-vessel
[35915.647291] [   4049]  1000  4049  1784607      517  2064384    27712           200 steamwebhelper
[35915.647293] [   4052]  1000  4052   103870      224   344064     3008           200 steamwebhelper
[35915.647296] [   4057]  1000  4057  8545846      320   446464     3072           200 steamwebhelper
[35915.647298] [   4058]  1000  4058  8545843      384   450560     2912           200 steamwebhelper
[35915.647300] [   4060]  1000  4060  8545850      328   233472     3040           200 steamwebhelper
[35915.647302] [   4086]  1000  4086  9111935      270  1212416    19424           200 steamwebhelper
[35915.647305] [   4130]  1000  4130   332371      320   626688     4288           200 steamwebhelper
[35915.647307] [   4141]  1000  4141  8638880      207   507904     4672           200 steamwebhelper
[35915.647309] [   4155]  1000  4155 12520320     2490  1748992    88128           300 steamwebhelper
[35915.647312] [   4909]  1000  4909   153727     3531   368640     7168           200 terminator
[35915.647314] [   4916]  1000  4916     3090      246    65536      480           200 bash
[35915.647316] [   8599]  1000  8599     7178      521    94208     3872           200 tmux: server
[35915.647319] [   8600]  1000  8600     3082      256    65536      544           200 bash
[35915.647321] [  23236]  1000 23236     4409      151    77824      224           200 sudo
[35915.647323] [  23238]  1000 23238     4409      202    57344      192           200 sudo
[35915.647325] [  23239]     0 23239   106565      597   897024    98144           200 emerge
[35915.647328] [  87877]  1000 87877   376150      508   679936     4640           200 kiod6
[35915.647330] [ 197481]     0 197481     2043      312    57344      128         -1000 sshd
[35915.647332] [ 226707]  1000 226707     3056      224    61440      544           200 bash
[35915.647335] [ 226714]  1000 226714    78401     1356   126976      128           200 btop
[35915.647337] [ 392121]  1000 392121  1117064      827  1331200    17344           200 krunner
[35915.647339] [ 392203]  1000 392203 67480564      343   675840     3904           200 baloorunner
[35915.647343] [ 498411]     0 498411     5198      234    81920     1472           200 python3.12
[35915.647345] [ 498412]     0 498412     5199      287    81920     1472           200 python3.12
[35915.647347] [ 498415]   250 498415      643      192    45056       32           200 sandbox
[35915.647350] [ 498416]   250 498416     3725      236    69632     1120           200 bash
[35915.647352] [ 498432]   250 498432     3724      318    65536     1056           200 bash
[35915.647354] [ 498461]   250 498461     2044      255    61440      320           200 ninja
[35915.647356] [ 498462]   250 498462  7649697  6198646 61038592  1327663           200 TensileCreateLi
[35915.647359] [ 523177]   250 523177   366642    14281  2957312   332779           200 TensileCreateLi
[35915.647361] [ 523178]   250 523178   251750   222816  2179072    14560           200 TensileCreateLi
[35915.647363] [ 523179]   250 523179   589610   111022  4763648   459968           200 TensileCreateLi
[35915.647366] [ 523180]   250 523180   233507   195429  1978368    23681           200 TensileCreateLi
[35915.647368] [ 523181]   250 523181   236380   219742  1957888     1804           200 TensileCreateLi
[35915.647370] [ 523182]   250 523182   207588   188174  2076672     5357           200 TensileCreateLi
[35915.647372] [ 523183]   250 523183   152271   133793  1589248     5282           200 TensileCreateLi
[35915.647374] [ 523184]   250 523184   157792   137263  1511424     7231           200 TensileCreateLi
[35915.647377] [ 523185]   250 523185   284425   153288  2449408   116017           200 TensileCreateLi
[35915.647379] [ 523186]   250 523186   529593    14217  4214784   492228           200 TensileCreateLi
[35915.647381] [ 523187]   250 523187   207713   180363  1724416    13265           200 TensileCreateLi
[35915.647383] [ 523188]   250 523188   411659    14377  3383296   377682           200 TensileCreateLi
[35915.647386] [ 523980]  1000 523980 12513335      348   946176    10835           300 steamwebhelper
[35915.647388] [ 524039]  1000 524039  3004883    54349  2486272    15104           200 firefox-bin
[35915.647390] [ 524128]  1000 524128    54386      313   225280     2016           200 Socket Process
[35915.647393] [ 524148]  1000 524148   621952     3533   798720     5152           167 Privileged Cont
[35915.647395] [ 524153]  1000 524153    83524      346   356352     2464           200 RDD Process
[35915.647397] [ 524216]  1000 524216  4917002    15434  1351680     5440           100 WebExtensions
[35915.647399] [ 524287]  1000 524287    84036      984   385024     2016           200 Utility Process
[35915.647402] [ 524514]  1000 524514  2877175    92487  3194880    21344           100 Isolated Web Co
[35915.647404] [ 525919]  1000 525919   633274    11788   933888     4608           100 Isolated Web Co
[35915.647406] [ 526491]  1000 526491 67131861      296   196608      480           200 kioworker
[35915.647408] [ 526499]  1000 526499   487097      559   724992     4864           200 kioworker
[35915.647411] [ 526560]  1000 526560 67131861      276   196608      544           200 kioworker
[35915.647413] [ 526562]  1000 526562 67131861      262   200704      544           200 kioworker
[35915.647415] [ 528049]  1000 528049   612806     4466   577536        0           100 Isolated Servic
[35915.647417] oom-kill:constraint=CONSTRAINT_NONE,nodemask=(null),cpuset=/,mems_allowed=0,global_oom,task_memcg=/user.slice/user-1000.slice/user@1000.service/app.slice/tmux-spawn-1f822da4-8caf-49b2-ac37-b8461f63d8bf.scope,task=TensileCreateLi,pid=498462,uid=250
[35915.647436] Out of memory: Killed process 498462 (TensileCreateLi) total-vm:30598788kB, anon-rss:24793900kB, file-rss:684kB, shmem-rss:0kB, UID:250 pgtables:59608kB oom_score_adj:200
[35918.306653] oom_reaper: reaped process 498462 (TensileCreateLi), now anon-rss:372kB, file-rss:556kB, shmem-rss:0kB


so it was oom kill, but why, i should have plenty of memory, how would i go about solving it

Code:

emerge --info
Portage 3.0.66.1 (python 3.12.8-final-0, default/linux/amd64/23.0/desktop/plasma/systemd, gcc-14, glibc-2.40-r8, 6.6.69-cachyos-6.6.69-x86_64 x86_64)
=================================================================
System uname: Linux-6.6.69-cachyos-6.6.69-x86_64-x86_64-AMD_Ryzen_5_5600X_6-Core_Processor-with-glibc2.40
KiB Mem:    32784808 total,  28275852 free
KiB Swap:   15624188 total,  13254576 free
Head commit of repository gentoo: ba6f07c6a6a1971feb5bb64c42c3ace886c84fe9

Timestamp of repository CachyOS-kernels: Mon, 03 Feb 2025 08:03:38 +0000
Head commit of repository CachyOS-kernels: b4b2c573113d95687ac80a034bad61413baeaad6

Timestamp of repository FireBurn: Sat, 01 Feb 2025 13:18:14 +0000
Head commit of repository FireBurn: 1eeb4494d87c41f436b5d803a7ec7670b2ff56c3

Timestamp of repository binaryden: Wed, 29 Jan 2025 23:33:23 +0000
Head commit of repository binaryden: 1f403cb3d528f1e17b8c00f2cbd481fb7cc737b2

Timestamp of repository gentoo-bootstrap: Tue, 28 Jan 2025 07:37:00 +0000
Head commit of repository gentoo-bootstrap: b805f9295d8679ab308b26d7df563489f42548b6

Timestamp of repository guru: Sat, 01 Feb 2025 16:18:20 +0000
Head commit of repository guru: 267681c66cf870644c6484602dcba1d86e9d6357

Timestamp of repository lanodanOverlay: Tue, 28 Jan 2025 07:36:46 +0000
Head commit of repository lanodanOverlay: 8a09c1b732496be394852ae6277a820281b7d42c

Head commit of repository picarica-overlay: e421ee640d206768366fc6b1d89f20ba9ceef19a

Timestamp of repository src_prepare-overlay: Wed, 15 Jan 2025 14:48:28 +0000
Head commit of repository src_prepare-overlay: 444efe63229d50268016d062952f9ffcd7c9a545

Timestamp of repository steam-overlay: Wed, 29 Jan 2025 23:33:21 +0000
Head commit of repository steam-overlay: 215a03000825d2d3b300d99915d5b4288ee879fb

Timestamp of repository thegreatmcpain: Sat, 01 Feb 2025 10:19:29 +0000
Head commit of repository thegreatmcpain: 0f1cc2c0aa146cf9638c7676c0debb17e01d1cff

sh bash 5.2_p37
ld GNU ld (Gentoo 2.43 p3) 2.43.1
app-misc/pax-utils:        1.3.8::gentoo
app-shells/bash:           5.2_p37::gentoo
dev-build/autoconf:        2.13-r8::gentoo, 2.72-r1::gentoo
dev-build/automake:        1.16.5-r2::gentoo
dev-build/cmake:           3.30.6::gentoo
dev-build/libtool:         2.5.4::gentoo
dev-build/make:            4.4.1-r100::gentoo
dev-build/meson:           1.6.1::gentoo
dev-java/java-config:      2.3.4::gentoo
dev-lang/perl:             5.40.0-r1::gentoo
dev-lang/python:           3.10.16_p1::gentoo, 3.12.8_p1::gentoo, 3.13.1_p1::gentoo
dev-lang/rust-bin:         1.82.0-r101::gentoo, 1.83.0::gentoo
llvm-core/clang:           17.0.6::gentoo, 18.1.8-r6::gentoo, 19.1.4::gentoo
llvm-core/lld:             17.0.6::gentoo, 18.1.8::gentoo, 19.1.6::gentoo
llvm-core/llvm:            17.0.6-r3::gentoo, 18.1.8-r6::gentoo, 19.1.4::gentoo
sys-apps/baselayout:       2.17::gentoo
sys-apps/sandbox:          2.39::gentoo
sys-apps/systemd:          256.10::gentoo
sys-devel/binutils:        2.43-r2::gentoo
sys-devel/binutils-config: 5.5.2::gentoo
sys-devel/gcc:             12.4.1_p20241219::gentoo, 13.3.1_p20241220::gentoo, 14.2.1_p20241221::gentoo
sys-devel/gcc-config:      2.12.1::gentoo
sys-kernel/linux-headers:  6.6-r1::gentoo (virtual/os-headers)
sys-libs/glibc:            2.40-r8::gentoo
Repositories:

gentoo
    location: /var/db/repos/gentoo
    sync-type: git
    sync-uri: https://gitweb.gentoo.org/repo/gentoo.git
    priority: -1000
    volatile: False

CachyOS-kernels
    location: /var/db/repos/CachyOS-kernels
    sync-type: git
    sync-uri: https://github.com/gentoo-mirror/CachyOS-kernels.git
    masters: gentoo
    volatile: False

FireBurn
    location: /var/db/repos/FireBurn
    sync-type: git
    sync-uri: https://github.com/gentoo-mirror/FireBurn.git
    masters: gentoo
    volatile: False

binaryden
    location: /var/db/repos/binaryden
    sync-type: git
    sync-uri: https://github.com/gentoo-mirror/binaryden.git
    masters: gentoo
    volatile: False

gentoo-bootstrap
    location: /var/db/repos/gentoo-bootstrap
    sync-type: git
    sync-uri: https://github.com/gentoo-mirror/gentoo-bootstrap.git
    masters: gentoo
    volatile: False

guru
    location: /var/db/repos/guru
    sync-type: git
    sync-uri: https://github.com/gentoo-mirror/guru.git
    masters: gentoo
    volatile: False

lanodanOverlay
    location: /var/db/repos/lanodanOverlay
    sync-type: git
    sync-uri: https://github.com/gentoo-mirror/lanodanOverlay.git
    masters: gentoo guru gentoo-bootstrap
    volatile: False

picarica-overlay
    location: /var/db/repos/picarica-overlay
    sync-type: git
    sync-uri: https://gitlab.com/picarica/picarica-overlay
    masters: gentoo
    volatile: False

src_prepare-overlay
    location: /var/db/repos/src_prepare-overlay
    sync-type: git
    sync-uri: https://github.com/gentoo-mirror/src_prepare-overlay.git
    masters: gentoo
    volatile: False

steam-overlay
    location: /var/db/repos/steam-overlay
    sync-type: git
    sync-uri: https://github.com/gentoo-mirror/steam-overlay.git
    masters: gentoo
    volatile: False

thegreatmcpain
    location: /var/db/repos/thegreatmcpain
    sync-type: git
    sync-uri: https://github.com/gentoo-mirror/thegreatmcpain.git
    masters: gentoo
    volatile: False

ACCEPT_KEYWORDS="amd64"
ACCEPT_LICENSE="*"
CBUILD="x86_64-pc-linux-gnu"
CFLAGS="-march=x86-64 -mtune=generic -O2 -pipe"
CHOST="x86_64-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/lib64/libreoffice/program/sofficerc /usr/share/config /usr/share/gnupg/qualified.txt /var/bind"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/texmf/language.dat.d /etc/texmf/language.def.d /etc/texmf/updmap.d /etc/texmf/web2c"
CXXFLAGS="-march=x86-64 -mtune=generic -O2 -pipe"
DISTDIR="/var/cache/distfiles"
ENV_UNSET="CARGO_HOME DBUS_SESSION_BUS_ADDRESS DISPLAY GDK_PIXBUF_MODULE_FILE GOBIN GOPATH PERL5LIB PERL5OPT PERLPREFIX PERL_CORE PERL_MB_OPT PERL_MM_OPT XAUTHORITY XDG_CACHE_HOME XDG_CONFIG_HOME XDG_DATA_HOME XDG_RUNTIME_DIR XDG_STATE_HOME"
FCFLAGS="-march=x86-64 -mtune=generic -O2 -pipe"
FEATURES="assume-digests binpkg-docompress binpkg-dostrip binpkg-logs binpkg-multi-instance buildpkg-live config-protect-if-modified distlocks ebuild-locks fixlafiles ipc-sandbox merge-sync merge-wait multilib-strict network-sandbox news parallel-fetch pid-sandbox pkgdir-index-trusted preserve-libs protect-owned qa-unresolved-soname-deps sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr"
FFLAGS="-march=x86-64 -mtune=generic -O2 -pipe"
GENTOO_MIRRORS="http://tux.rainside.sk/gentoo/ ftp://tux.rainside.sk/gentoo/ https://mirror.wheel.sk/gentoo http://mirror.wheel.sk/gentoo"
LANG="en_IE.utf8"
LDFLAGS="-Wl,-O1 -Wl,--as-needed -Wl,-z,pack-relative-relocs"
LEX="flex"
LINGUAS="ie sk en"
MAKEOPTS="-j6"
PKGDIR="/var/cache/binpkgs"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git"
PORTAGE_TMPDIR="/var/tmp"
SHELL="/bin/bash"
USE="NetworkManager X a52 aac accessibility acl acpi activities alsa amd64 av1 avif branding bundled-libs bzip2 cairo cdda cdr cet cups dav1d dbus declarative device-mapper display-manager dist-kernel dolphin dracut dri dts dvdr encode exif extra fdk ffmpeg flac gd gdbm gif gpm grub gtk gui harfbuzz hip iconv icu ipv6 jpeg kde keyring kf6compat kms kwallet lcms libaom libass libdrm libnotify libtirpc lvm mad mng modules mount mp3 mp4 mpeg mpg123 mtp multilib ncurses networkmanager nls ogg opencl opengl openmp opus pam pango pcre pdf pipewire pipewire-alsa plasma plymouth png policykit ppds pulseaudio qml qt5 qt6 quick rar readline rocm samba screencast sdl seccomp semantic-desktop sound sound-server spell srt ssh ssl startup-notification svg symlink systemd test-rust theora tiff truetype twolame udev udisks unicode upower usb usbredir vaapi vdpau vorbis vulkan wayland widgets winbind wxwidgets x264 xattr xcb xft xml xv xvid zip zlib" ABI_X86="64" ADA_TARGET="gcc_13" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_anon authn_dbm authn_file authz_dbm authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir env expires ext_filter file_cache filter headers include info log_config logio mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="karbon sheets words" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_X86="mmx mmxext sse sse2 aes avx avx2 f16c fma3 pclmul popcnt rdrand sha sse3 sse4_1 sse4_2 sse4a ssse3" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock greis isync itrax navcom oceanserver oncore rtcm104v2 rtcm104v3 sirf skytraq superstar2 tsip tripmate tnt ublox" GRUB_PLATFORMS="efi-64" GUILE_SINGLE_TARGET="3-0" GUILE_TARGETS="3-0" INPUT_DEVICES="libinput" KERNEL="linux" L10N="sk en en-GB" LCD_DEVICES="bayrad cfontz glk hd44780 lb216 lcdm001 mtxorb text" LUA_SINGLE_TARGET="lua5-1" LUA_TARGETS="lua5-1" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php8-2" POSTGRES_TARGETS="postgres16" PYTHON_SINGLE_TARGET="python3_12" PYTHON_TARGETS="python3_12" RUBY_TARGETS="ruby32" VIDEO_CARDS="amdgpu radeonsi radeon" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipp2p iface geoip fuzzy condition tarpit sysrq proto logmark ipmark dhcpmac delude chaos account"
Unset:  ADDR2LINE, AR, ARFLAGS, AS, ASFLAGS, CC, CCLD, CONFIG_SHELL, CPP, CPPFLAGS, CTARGET, CXX, CXXFILT, ELFEDIT, EMERGE_DEFAULT_OPTS, EXTRA_ECONF, F77FLAGS, FC, GCOV, GPROF, INSTALL_MASK, LC_ALL, LD, LFLAGS, LIBTOOL, MAKE, MAKEFLAGS, NM, OBJCOPY, OBJDUMP, PORTAGE_BINHOST, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS, PYTHONPATH, RANLIB, READELF, RUSTFLAGS, SIZE, STRINGS, STRIP, YACC, YFLAGS

Back to top
View user's profile Send private message
logrusx
Advocate
Advocate


Joined: 22 Feb 2018
Posts: 2688

PostPosted: Mon Feb 03, 2025 6:38 pm    Post subject: Reply with quote

picarica wrote:

lowered it to -j6 , ran in tmux, and tmux session is nowhere to be found it crashed again


Well, stop running it in a tmux! You were already asked if you run it in a tmux and that should have given you a hint. I personally have never had gnome-terminal or an FB console killed even on my quad code 6GB box.

Best Regards,
Georgi
Back to top
View user's profile Send private message
Hu
Administrator
Administrator


Joined: 06 Mar 2007
Posts: 23082

PostPosted: Mon Feb 03, 2025 7:05 pm    Post subject: Reply with quote

Running in tmux is normally fine, and is sometimes recommended over running it straight in an xterm (or equivalent) because tmux is less likely to be accidentally killed by a bad upgrade. However, in this case, the out-of-memory is the real problem, and running inside or outside tmux is likely irrelevant.

I think Zucca wanted the command run inside a tmux in the hope that OP could reattach later to capture the output of the command, even if the X server crashed.
Back to top
View user's profile Send private message
picarica
Guru
Guru


Joined: 11 Aug 2018
Posts: 338

PostPosted: Mon Feb 03, 2025 7:16 pm    Post subject: Reply with quote

Hu wrote:
Running in tmux is normally fine, and is sometimes recommended over running it straight in an xterm (or equivalent) because tmux is less likely to be accidentally killed by a bad upgrade. However, in this case, the out-of-memory is the real problem, and running inside or outside tmux is likely irrelevant.

I think Zucca wanted the command run inside a tmux in the hope that OP could reattach later to capture the output of the command, even if the X server crashed.


ye well, it was first time running in tmux, i was also hoping i could reattach it and see error but it was oom, so i am not sure how can icompile that hipblas on my system
Back to top
View user's profile Send private message
logrusx
Advocate
Advocate


Joined: 22 Feb 2018
Posts: 2688

PostPosted: Mon Feb 03, 2025 7:23 pm    Post subject: Reply with quote

picarica wrote:
so i am not sure how can icompile that hipblas on my system


Well, -j1. If that doesn't help, then the problem might not be in your system.

BTW you don't happen to have LTO, PGO, et.c.? I didn't see it in you emerge info but there's also /etc/portage/package.*

Best Regards,
Georgi
Back to top
View user's profile Send private message
picarica
Guru
Guru


Joined: 11 Aug 2018
Posts: 338

PostPosted: Mon Feb 03, 2025 7:36 pm    Post subject: Reply with quote

logrusx wrote:
picarica wrote:
so i am not sure how can icompile that hipblas on my system


Well, -j1. If that doesn't help, then the problem might not be in your system.

BTW you don't happen to have LTO, PGO, et.c.? I didn't see it in you emerge info but there's also /etc/portage/package.*

Best Regards,
Georgi

got it will try tomorrow

also idk what LTO PGO is, been using gento for years idk what, i have this in portage folder

Code:

ls -la
total 48
drwxr-xr-x   9 root root 4096 Feb  3 09:39 .
drwxr-xr-x 104 root root 4096 Feb  3 20:26 ..
-rw-r--r--   1 root root 2305 Feb  3 09:38 make.conf
lrwxrwxrwx   1 root root   82 Jun 12  2024 make.profile -> ../../var/db/repos/gentoo/profiles/default/linux/amd64/23.0/desktop/plasma/systemd
drwxr-xr-x   2 root root 4096 Feb  3 19:11 package.accept_keywords
drwxr-xr-x   2 root root 4096 Dec 26 12:14 package.mask
-rw-r--r--   1 root root    0 Jan 22  2024 package.unmask
drwxr-xr-x   2 root root 4096 Feb  3 09:39 package.use
drwxr-xr-x   2 root root 4096 Dec 29 10:05 postsync.d
drwxr-xr-x   3 root root 4096 Nov 26  2022 profile
drwxr-xr-x   2 root root 4096 Jan 18 14:03 repos.conf
drwxr-xr-x   4 root root 4096 Dec 30 09:19 savedconfig
-rw-r--r--   1 root root   46 Dec 12 14:54 smart-live-rebuild.conf
Back to top
View user's profile Send private message
picarica
Guru
Guru


Joined: 11 Aug 2018
Posts: 338

PostPosted: Thu Feb 06, 2025 7:27 am    Post subject: Reply with quote

so after 2 days of compiling with MAKEOPTS="-j1" it crashed again

Code:

[136002.114130] oom-kill:constraint=CONSTRAINT_NONE,nodemask=(null),cpuset=/,mems_allowed=0,global_oom,task_memcg=/user.slice/user-1000.slice/user@1000.service/app.slice/vte-spawn-0de2f7e9-4f74-4ae4-8bb0-89f35db884f4.scope,task=TensileCreateLi,pid=532667,uid=250
[136002.114159] Out of memory: Killed process 532667 (TensileCreateLi) total-vm:31906504kB, anon-rss:22215360kB, file-rss:5148kB, shmem-rss:0kB, UID:250 pgtables:62304kB oom_score_adj:200
[136004.735554] oom_reaper: reaped process 532667 (TensileCreateLi), now anon-rss:648kB, file-rss:596kB, shmem-rss:0kB


i tried monitoring my memory usage, and near the end the 32GB of my ram was used 31.5GB, how is this possbiel with makeopts-jf1? there has to be some sort of memory leak

Code:

# i had make this log using while true; do free -m;sleep 5m ; done
Mem:           32016       16779         542         365       15513       15237
Swap:          15257          27       15230
               total        used        free      shared  buff/cache   available
Mem:           32016       16794         517         360       15518       15221
Swap:          15257          27       15230
               total        used        free      shared  buff/cache   available
Mem:           32016       16692         614         356       15519       15324
Swap:          15257          27       15230
               total        used        free      shared  buff/cache   available
Mem:           32016       16384         919         312       15479       15632
Swap:          15257          27       15230
               total        used        free      shared  buff/cache   available
Mem:           32016       16781         518         325       15495       15234
Swap:          15257          27       15230
               total        used        free      shared  buff/cache   available
Mem:           32016       15742        1603         339       15463       16273
Swap:          15257          27       15230
               total        used        free      shared  buff/cache   available
Mem:           32016        7943        9277         300       15548       24072
Swap:          15257          26       15231


this is not possible, during whole two days i was regualery checking it it was barerly 3GB used, how was 31GB used at the end? something is not right.
also this is happening on Composable-kernel packge, could it be related that i am using Cachy-OS kernel? not the gentoo's one?
Back to top
View user's profile Send private message
logrusx
Advocate
Advocate


Joined: 22 Feb 2018
Posts: 2688

PostPosted: Thu Feb 06, 2025 7:47 am    Post subject: Reply with quote

Have you tested your memory? If this is memory failure, I bet it'll show up at the first pass of memtest.

Best Regards,
Georgi
Back to top
View user's profile Send private message
Zucca
Moderator
Moderator


Joined: 14 Jun 2007
Posts: 3930
Location: Rasi, Finland

PostPosted: Thu Feb 06, 2025 8:14 am    Post subject: Reply with quote

picarica wrote:
and near the end the 32GB of my ram was used 31.5GB, how is this possbiel with makeopts-jf1? there has to be some sort of memory leak
It sure sounds like it.
Code:
[136002.114159] Out of memory: Killed process 532667 (TensileCreateLi) total-vm:31906504kB, anon-rss:22215360kB, file-rss:5148kB, shmem-rss:0kB, UID:250 pgtables:62304kB oom_score_adj:20
total-vm almost 320GB and anon-rss at 22GB.
I suspect (a wild guess really) your emerge process was either compiling or using dev-util/Tensile.
Do you have an update to that package in line? You could try to mask or --exclude it.
_________________
..: Zucca :..

My gentoo installs:
init=/sbin/openrc-init
-systemd -logind -elogind seatd

Quote:
I am NaN! I am a man!
Back to top
View user's profile Send private message
logrusx
Advocate
Advocate


Joined: 22 Feb 2018
Posts: 2688

PostPosted: Thu Feb 06, 2025 9:11 am    Post subject: Reply with quote

Prompted by Zucca's observation, I want to see your full update command output with verbose and pretend. I suspect you're enabling features you're not aware of. And please make sure you have that emerge default ops line in make.conf commented. Make sure there are no parallel jobs running because your errors have been strange so far, in compiling one package we see contents of another blow up.

Best Regards,
Georgi

p.s. hipblas or hipblast? I happen to have experience with BLAST and it can take a lot of memory if invoked in certain way. In fact it can eat all of the world's memory available. What I'm looking for is some test use flags. BTW you should have started with that first place. Always include --pretend output of your emerge command.

p.s.2 hipBLASLt and hipcc have debug flags. hipcc has also test. Disable them both.

p.s.3 I tried to install that stuff and it turns out it's very complicated, a lot of outdated stuff is pulled in. What else have you done and why didn't you mention it?
Back to top
View user's profile Send private message
Display posts from previous:   
Reply to topic    Gentoo Forums Forum Index Portage & Programming All times are GMT
Page 1 of 1

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum