Gentoo Forums
Gentoo Forums
Gentoo Forums
Quick Search: in
Caffe2 Emerge issue - USE flag constraints unsatisfied
View unanswered posts
View posts from last 24 hours

 
Reply to topic    Gentoo Forums Forum Index Portage & Programming
View previous topic :: View next topic  
Author Message
rsnfunky
Tux's lil' helper
Tux's lil' helper


Joined: 30 Dec 2007
Posts: 77

PostPosted: Sun Sep 29, 2024 4:02 pm    Post subject: Caffe2 Emerge issue - USE flag constraints unsatisfied Reply with quote

Hi All,

How do I resolve the below issue:

System: AMDGPU with ROCm and Target gfx1100

Aim: To get flash-attention working with ROCm.

Code:
# ACCEPT_KEYWORDS="~amd64" emerge --pretend caffe2

These are the packages that would be merged, in order:

Calculating dependencies /

!!! Problem resolving dependencies for sci-libs/caffe2
... done!
Dependency resolution took 0.78 s (backtrack: 0/20).


!!! The ebuild selected to satisfy "caffe2" has unmet requirements.
- sci-libs/caffe2-2.4.1-r1::gentoo USE="flash numpy opencl openmp rocm -cuda -distributed -fbgemm -gloo -mkl -mpi -nnpack -onednn -openblas -qnnpack -xnnpack" ABI_X86="(64)" AMDGPU_TARGETS="gfx1100 gfx1102 -gfx1010 -gfx1011 -gfx1012 -gfx1030 -gfx1031 -gfx1101 -gfx803 -gfx900 -gfx906 -gfx908 -gfx90a -gfx940 -gfx941 -gfx942" PYTHON_SINGLE_TARGET="python3_12 -python3_10 -python3_11"

  The following REQUIRED_USE flag constraints are unsatisfied:
    rocm? ( !flash )

  The above constraints are a subset of the following complete expression:
    exactly-one-of ( python_single_target_python3_10 python_single_target_python3_11 python_single_target_python3_12 ) mpi? ( distributed ) gloo? ( distributed ) at-most-one-of ( cuda rocm ) rocm? ( any-of ( any-of ( amdgpu_targets_gfx906 amdgpu_targets_gfx908 amdgpu_targets_gfx90a amdgpu_targets_gfx942 amdgpu_targets_gfx1030 amdgpu_targets_gfx1100 amdgpu_targets_gfx803 amdgpu_targets_gfx900 amdgpu_targets_gfx940 amdgpu_targets_gfx941 amdgpu_targets_gfx1010 amdgpu_targets_gfx1011 amdgpu_targets_gfx1012 amdgpu_targets_gfx1031 amdgpu_targets_gfx1101 amdgpu_targets_gfx1102 ) ) !flash )


 * IMPORTANT: 27 news items need reading for repository 'gentoo'.
 * Use eselect news read to view new items.


The Emerge --info:

Code:
emerge --info
Portage 3.0.65 (python 3.12.6-final-0, default/linux/amd64/23.0/desktop/gnome, gcc-13, glibc-2.39-r6, 6.6.47-gentoo-gentoo-dist x86_64)
=================================================================
System uname: Linux-6.6.47-gentoo-gentoo-dist-x86_64-AMD_Ryzen_7_8700G_w-_Radeon_780M_Graphics-with-glibc2.39
KiB Mem:    63305756 total,  51557232 free
KiB Swap:   66694136 total,  66693624 free
Timestamp of repository gentoo: Sun, 29 Sep 2024 09:00:00 +0000
Head commit of repository gentoo: 8289834aa7047b2585d7e5571b9076e4c0341aeb
sh bash 5.2_p26-r6
ld GNU ld (Gentoo 2.42 p3) 2.42.0
app-misc/pax-utils:        1.3.7::gentoo
app-shells/bash:           5.2_p26-r6::gentoo
dev-build/autoconf:        2.13-r8::gentoo, 2.71-r7::gentoo
dev-build/automake:        1.16.5-r2::gentoo
dev-build/cmake:           3.30.2::gentoo
dev-build/libtool:         2.4.7-r4::gentoo
dev-build/make:            4.4.1-r1::gentoo
dev-build/meson:           1.5.1::gentoo
dev-lang/perl:             5.40.0::gentoo
dev-lang/python:           3.11.10_p1::gentoo, 3.12.6_p2::gentoo
dev-lang/rust-bin:         1.80.1::gentoo
sys-apps/baselayout:       2.15::gentoo
sys-apps/openrc:           0.54.2::gentoo
sys-apps/sandbox:          2.39::gentoo
sys-devel/binutils:        2.42-r1::gentoo
sys-devel/binutils-config: 5.5.2::gentoo
sys-devel/clang:           18.1.8::gentoo
sys-devel/gcc:             13.3.1_p20240614::gentoo
sys-devel/gcc-config:      2.11::gentoo
sys-devel/lld:             18.1.8::gentoo
sys-devel/llvm:            18.1.8-r1::gentoo
sys-kernel/linux-headers:  6.6-r1::gentoo (virtual/os-headers)
sys-libs/glibc:            2.39-r6::gentoo
Repositories:

gentoo
    location: /var/db/repos/gentoo
    sync-type: rsync
    sync-uri: rsync://rsync.gentoo.org/gentoo-portage
    priority: -1000
    volatile: False
    sync-rsync-verify-metamanifest: yes
    sync-rsync-verify-jobs: 1
    sync-rsync-verify-max-age: 3
    sync-rsync-extra-opts:

Binary Repositories:

gentoobinhost
    priority: 1
    sync-uri: https://distfiles.gentoo.org/releases/amd64/binpackages/23.0/x86-64

ACCEPT_KEYWORDS="amd64"
ACCEPT_LICENSE="*"
CBUILD="x86_64-pc-linux-gnu"
CFLAGS="-march=znver4 -O2 -pipe"
CHOST="x86_64-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/share/config /usr/share/gnupg/qualified.txt"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/sandbox.d"
CXXFLAGS="-march=znver4 -O2 -pipe"
DISTDIR="/mnt/docker/distfiles"
ENV_UNSET="CARGO_HOME DBUS_SESSION_BUS_ADDRESS DISPLAY GDK_PIXBUF_MODULE_FILE GOBIN GOPATH PERL5LIB PERL5OPT PERLPREFIX PERL_CORE PERL_MB_OPT PERL_MM_OPT XAUTHORITY XDG_CACHE_HOME XDG_CONFIG_HOME XDG_DATA_HOME XDG_RUNTIME_DIR XDG_STATE_HOME"
FCFLAGS="-march=znver4 -O2 -pipe"
FEATURES="assume-digests binpkg-docompress binpkg-dostrip binpkg-logs binpkg-multi-instance buildpkg-live config-protect-if-modified distlocks ebuild-locks fixlafiles ipc-sandbox merge-sync merge-wait multilib-strict network-sandbox news parallel-fetch pid-sandbox pkgdir-index-trusted preserve-libs protect-owned qa-unresolved-soname-deps sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr"
FFLAGS="-march=znver4 -O2 -pipe"
GENTOO_MIRRORS="https://mirrors.nxtgen.com/gentoo-mirror/gentoo-source/     http://mirrors.nxtgen.com/gentoo-mirror/gentoo-source/     rsync://ftp.iij.ad.jp/pub/linux/gentoo/     http://ftp.iij.ad.jp/pub/linux/gentoo/"
LANG="C.UTF8"
LDFLAGS="-Wl,-O1 -Wl,--as-needed -Wl,-z,pack-relative-relocs"
LEX="flex"
MAKEOPTS="-j28 -l279"
PKGDIR="/var/cache/binpkgs"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git"
PORTAGE_TMPDIR="/var/tmp"
SHELL="/bin/bash"
USE="X a52 aac acl acpi adns alsa amd64 bash-completion blas bluetooth branding brts bzip2 cairo calendar cdda cdr cet clamav colord crypt cups curl dbus dga dracut dri dts dvd dvdr eds efistub egl elogind encode evo exif extra extras ffmpeg flac flash fortran ftp gdbm gif gnome gnome-keyring gnome-online-accounts gnome-shell grub gstreamer gtk gtk3 gui gzip handbook hip http2 iconv icu inspector introspection ipv6 jpeg jpeg2k jpegxl keyring kf6compat lcms libnotify libtirpc libwww lm-sensors lz4 lzip lzma lzo mad man minizip mng modules-sign mount mp3 mp4 mpeg mplayer multilib nautilus ncurses networkmanager nls ntfs offload ogg opencl opengl openmp pam pango pcre pdf plasma png policykit ppds profile profiler pulseaudio python qml qt5 qt6 readline rocm sdl seccomp secureboot sound speech speex spell ssl startup-notification svg sysprof test-rust tiff tracker truetype udev udisks uefi unicode upower usb vorbis vulkan wayland wxwidgets x264 xattr xcb xft xml xv xvid zip zlib" ABI_X86="64" ADA_TARGET="gcc_12" AMDGPU_TARGETS="gfx1100 gfx1102" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_anon authn_dbm authn_file authz_dbm authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir env expires ext_filter file_cache filter headers include info log_config logio mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="karbon sheets words" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_X86="mmx mmxext sse sse2 aes avx avx2 avx512_bf16 avx512_bitalg avx512_vbmi2 avx512_vnni avx512_vpopcntdq avx512bw avx512cd avx512dq avx512f avx512ifma avx512vbmi avx512vl f16c fma3 pclmul popcnt rdrand sha sse3 sse4_1 sse4_2 sse4a ssse3 vpclmulqdq" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock greis isync itrax mtk3301 ntrip navcom oceanserver oncore rtcm104v2 rtcm104v3 sirf skytraq superstar2 tsip tripmate tnt ublox" GRUB_PLATFORMS="efi-64" GUILE_SINGLE_TARGET="3-0" GUILE_TARGETS="3-0" INPUT_DEVICES="libinput" KERNEL="linux" LCD_DEVICES="bayrad cfontz glk hd44780 lb216 lcdm001 mtxorb text" LLVM_TARGETS="AMDGPU BPF X86" LUA_SINGLE_TARGET="lua5-1" LUA_TARGETS="lua5-1" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php8-2" POSTGRES_TARGETS="postgres16" PYTHON_SINGLE_TARGET="python3_12" PYTHON_TARGETS="python3_12" RUBY_TARGETS="ruby31 ruby32" VIDEO_CARDS="amdgpu radeonsi" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipp2p iface geoip fuzzy condition tarpit sysrq proto logmark ipmark dhcpmac delude chaos account"
Unset:  ADDR2LINE, AR, ARFLAGS, AS, ASFLAGS, CC, CCLD, CONFIG_SHELL, CPP, CPPFLAGS, CTARGET, CXX, CXXFILT, ELFEDIT, EMERGE_DEFAULT_OPTS, EXTRA_ECONF, F77FLAGS, FC, GCOV, GPROF, INSTALL_MASK, LC_ALL, LD, LFLAGS, LIBTOOL, LINGUAS, MAKE, MAKEFLAGS, NM, OBJCOPY, OBJDUMP, PORTAGE_BINHOST, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS, PYTHONPATH, RANLIB, READELF, RUSTFLAGS, SIZE, STRINGS, STRIP, YACC, YFLAGS
Back to top
View user's profile Send private message
alamahant
Advocate
Advocate


Joined: 23 Mar 2019
Posts: 3918

PostPosted: Mon Sep 30, 2024 1:43 am    Post subject: Reply with quote

Quote:


The following REQUIRED_USE flag constraints are unsatisfied:
rocm? ( !flash )
You can not have both USE flags enabled at the same time.
Try
Code:

USE="rcom -flash" emerge -av caffe2
or
USE="-rcom flash" emerge -av caffe2


When you make your mind plz use package.use to make your choice permanent.
_________________
:)
Back to top
View user's profile Send private message
stefantalpalaru
Tux's lil' helper
Tux's lil' helper


Joined: 11 Jan 2009
Posts: 76
Location: Italy

PostPosted: Mon Sep 30, 2024 4:11 pm    Post subject: Re: Caffe2 Emerge issue - USE flag constraints unsatisfied Reply with quote

rsnfunky wrote:

Aim: To get flash-attention working with ROCm.


I don't think that's available upstream: https://github.com/pytorch/pytorch/issues/112997
Back to top
View user's profile Send private message
rsnfunky
Tux's lil' helper
Tux's lil' helper


Joined: 30 Dec 2007
Posts: 77

PostPosted: Mon Oct 07, 2024 6:32 pm    Post subject: Reply with quote

Flash Attention is available upstream with pytorch:

https://github.com/pytorch/pytorch/pull/114309

https://rocm.docs.amd.com/en/latest/how-to/llm-fine-tuning-optimization/model-acceleration-libraries.html

Please do let me know if I am missing something.
Back to top
View user's profile Send private message
Display posts from previous:   
Reply to topic    Gentoo Forums Forum Index Portage & Programming All times are GMT
Page 1 of 1

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum