Gentoo Forums :: View topic - libxcb problem in doing updates

libxcb problem in doing updates

View unanswered posts
View posts from last 24 hours

Gentoo Forums Forum Index

Installing Gentoo

View previous topic :: View next topic

Author

Message

tckosvic
Tux's lil' helper

Joined: 18 Apr 2023
Posts: 138

Posted: Thu Aug 24, 2023 3:20 pm Post subject: libxcb problem in doing updates

Running emerge -avuDN @world. Stops at libxcb. Need advice. Looks like problem might be python version related.

Extract code below. Sorry for length.

Code:

>>> Emerging (8 of 101) x11-libs/libxcb-1.16::gentoo
* libxcb-1.16.tar.xz BLAKE2B SHA512 size ;-) ... [ ok ]
* Checking whether python3_12 is suitable ...
* dev-lang/python:3.12[xml(+)] ... [ ok ]
* python_check_deps ...
* >=x11-base/xcb-proto-1.16.0[python_targets_python3_12(-)] ... [ !! ]
* Checking whether python3_11 is suitable ...
* dev-lang/python:3.11[xml(+)] ... [ ok ]
* python_check_deps ...
* >=x11-base/xcb-proto-1.16.0[python_targets_python3_11(-)] ... [ ok ]
* Using python3.11 to build (via PYTHON_COMPAT iteration)
>>> Unpacking source...
>>> Unpacking libxcb-1.16.tar.xz to /var/tmp/portage/x11-libs/libxcb-1.16/work
>>> Source unpacked in /var/tmp/portage/x11-libs/libxcb-1.16/work
>>> Preparing source in /var/tmp/portage/x11-libs/libxcb-1.16/work/libxcb-1.16 ...
* Running elibtoolize in: libxcb-1.16/
* Running elibtoolize in: libxcb-1.16/build-aux/
* Applying portage/1.2.0 patch ...
* Applying sed/1.5.6 patch ...
* Applying as-needed/2.4.3 patch ...
>>> Source prepared.
>>> Configuring source in /var/tmp/portage/x11-libs/libxcb-1.16/work/libxcb-1.16 ...
* abi_x86_64.amd64: running multilib-minimal_abi_src_configure
* econf: updating libxcb-1.16/build-aux/config.sub with /usr/share/gnuconfig/config.sub
* econf: updating libxcb-1.16/build-aux/config.guess with /usr/share/gnuconfig/config.guess
/var/tmp/portage/x11-libs/libxcb-1.16/work/libxcb-1.16/configure --prefix=/usr --build=x86_64-pc-linux-gnu --host=x86_64-pc-linux-gnu --mandir=/usr/share/man --infodir=/usr/share/info --datadir=/usr/share --sysconfdir=/etc --localstatedir=/var/lib --datarootdir=/usr/share --disable-dependency-tracking --disable-silent-rules --disable-static --docdir=/usr/share/doc/libxcb-1.16 --htmldir=/usr/share/doc/libxcb-1.16/html --with-sysroot=/ --libdir=/usr/lib64 --disable-dependency-tracking --disable-selective-werror --disable-static --disable-devel-docs --disable-selinux
checking for a BSD-compatible install... /var/tmp/portage/._portage_reinstall_.vwdn2gyb/bin/ebuild-helpers/xattr/install -c
checking whether build environment is sane... yes
checking for a race-free mkdir -p... /bin/mkdir -p
checking for gawk... gawk
checking whether make sets $(MAKE)... yes
checking whether make supports nested variables... yes
checking whether /usr/bin/python3.11 version is >= 3.0... yes
checking for /usr/bin/python3.11 version... 3.11
checking for /usr/bin/python3.11 platform... linux
checking for GNU default /usr/bin/python3.11 prefix... ${prefix}
checking for GNU default /usr/bin/python3.11 exec_prefix... ${exec_prefix}
checking for /usr/bin/python3.11 script directory (pythondir)... ${PYTHON_PREFIX}/lib/python3.11/site-packages
checking for /usr/bin/python3.11 extension module directory (pyexecdir)... ${PYTHON_EXEC_PREFIX}/lib/python3.11/site-packages
checking whether make supports the include directive... yes (GNU style)
checking for x86_64-pc-linux-gnu-gcc... x86_64-pc-linux-gnu-gcc
checking whether the C compiler works... yes
checking for C compiler default output file name... a.out
checking for suffix of executables...
checking whether we are cross compiling... no
checking for suffix of object files... o
checking whether the compiler supports GNU C... yes
checking whether x86_64-pc-linux-gnu-gcc accepts -g... yes
checking for x86_64-pc-linux-gnu-gcc option to enable C11 features... none needed
checking whether x86_64-pc-linux-gnu-gcc understands -c and -o together... yes
checking dependency style of x86_64-pc-linux-gnu-gcc... none
checking for stdio.h... yes
checking for stdlib.h... yes
checking for string.h... yes
checking for inttypes.h... yes
checking for stdint.h... yes
checking for strings.h... yes
checking for sys/stat.h... yes
checking for sys/types.h... yes
checking for unistd.h... yes
checking for wchar.h... yes
checking for minix/config.h... no
checking whether it is safe to define __EXTENSIONS__... yes
checking whether _XOPEN_SOURCE should be defined... no
checking build system type... x86_64-pc-linux-gnu
checking host system type... x86_64-pc-linux-gnu
checking how to print strings... printf
checking for a sed that does not truncate output... /bin/sed
checking for grep that handles long lines and -e... /bin/grep
checking for egrep... /bin/grep -E
checking for fgrep... /bin/grep -F
checking for ld used by x86_64-pc-linux-gnu-gcc... /usr/x86_64-pc-linux-gnu/bin/ld
checking if the linker (/usr/x86_64-pc-linux-gnu/bin/ld) is GNU ld... yes
checking for BSD- or MS-compatible name lister (nm)... /usr/bin/x86_64-pc-linux-gnu-nm -B
checking the name lister (/usr/bin/x86_64-pc-linux-gnu-nm -B) interface... BSD nm
checking whether ln -s works... yes
checking the maximum length of command line arguments... 1572864
checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop
checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop
checking for /usr/x86_64-pc-linux-gnu/bin/ld option to reload object files... -r
checking for x86_64-pc-linux-gnu-file... no
checking for file... file
checking for x86_64-pc-linux-gnu-objdump... x86_64-pc-linux-gnu-objdump
checking how to recognize dependent libraries... pass_all
checking for x86_64-pc-linux-gnu-dlltool... x86_64-pc-linux-gnu-dlltool
checking how to associate runtime and link libraries... printf %s\n
checking for x86_64-pc-linux-gnu-ar... x86_64-pc-linux-gnu-ar
checking for archiver @FILE support... @
checking for x86_64-pc-linux-gnu-strip... x86_64-pc-linux-gnu-strip
checking for x86_64-pc-linux-gnu-ranlib... x86_64-pc-linux-gnu-ranlib
checking command to parse /usr/bin/x86_64-pc-linux-gnu-nm -B output from x86_64-pc-linux-gnu-gcc object... ok
checking for sysroot... /
checking for a working dd... /bin/dd
checking how to truncate binary pipes... /bin/dd bs=4096 count=1
checking for x86_64-pc-linux-gnu-mt... no
checking for mt... no
checking if : is a manifest tool... no
checking for dlfcn.h... yes
checking for objdir... .libs
checking if x86_64-pc-linux-gnu-gcc supports -fno-rtti -fno-exceptions... no
checking for x86_64-pc-linux-gnu-gcc option to produce PIC... -fPIC -DPIC
checking if x86_64-pc-linux-gnu-gcc PIC flag -fPIC -DPIC works... yes
checking if x86_64-pc-linux-gnu-gcc static flag -static works... yes
checking if x86_64-pc-linux-gnu-gcc supports -c -o file.o... yes
checking if x86_64-pc-linux-gnu-gcc supports -c -o file.o... (cached) yes
checking whether the x86_64-pc-linux-gnu-gcc linker (/usr/x86_64-pc-linux-gnu/bin/ld -m elf_x86_64) supports shared libraries... yes
checking whether -lc should be explicitly linked in... no
checking dynamic linker characteristics... GNU/Linux ld.so
checking how to hardcode library paths into programs... immediate
checking whether stripping libraries is possible... yes
checking if libtool supports shared libraries... yes
checking whether to build shared libraries... yes
checking whether to build static libraries... no
checking for x86_64-pc-linux-gnu-gcc options needed to detect all undeclared functions... (cached) none needed
checking whether __clang__ is declared... no
checking whether __INTEL_COMPILER is declared... no
checking whether __SUNPRO_C is declared... no
checking for x86_64-pc-linux-gnu-pkg-config... /usr/bin/x86_64-pc-linux-gnu-pkg-config
checking pkg-config is at least version 0.9.0... yes
checking if x86_64-pc-linux-gnu-gcc supports -Werror=unknown-warning-option... no
checking if x86_64-pc-linux-gnu-gcc supports -Werror=unused-command-line-argument... no
checking if x86_64-pc-linux-gnu-gcc supports -Wall... yes
checking if x86_64-pc-linux-gnu-gcc supports -Wpointer-arith... yes
checking if x86_64-pc-linux-gnu-gcc supports -Wmissing-declarations... yes
checking if x86_64-pc-linux-gnu-gcc supports -Wformat=2... yes
checking if x86_64-pc-linux-gnu-gcc supports -Wstrict-prototypes... yes
checking if x86_64-pc-linux-gnu-gcc supports -Wmissing-prototypes... yes
checking if x86_64-pc-linux-gnu-gcc supports -Wnested-externs... yes
checking if x86_64-pc-linux-gnu-gcc supports -Wbad-function-cast... yes
checking if x86_64-pc-linux-gnu-gcc supports -Wold-style-definition... yes
checking if x86_64-pc-linux-gnu-gcc supports -Wdeclaration-after-statement... yes
checking if x86_64-pc-linux-gnu-gcc supports -Wunused... yes
checking if x86_64-pc-linux-gnu-gcc supports -Wuninitialized... yes
checking if x86_64-pc-linux-gnu-gcc supports -Wshadow... yes
checking if x86_64-pc-linux-gnu-gcc supports -Wmissing-noreturn... yes
checking if x86_64-pc-linux-gnu-gcc supports -Wmissing-format-attribute... yes
checking if x86_64-pc-linux-gnu-gcc supports -Wredundant-decls... yes
checking if x86_64-pc-linux-gnu-gcc supports -Wlogical-op... yes
configure: WARNING: You have chosen not to turn some select compiler warnings into errors. This should not be necessary. Please report why you needed to do so in a bug report at https://gitlab.freedesktop.org/xorg/lib/libxcb/issues
checking if x86_64-pc-linux-gnu-gcc supports -Wimplicit... yes
checking if x86_64-pc-linux-gnu-gcc supports -Wnonnull... yes
checking if x86_64-pc-linux-gnu-gcc supports -Winit-self... yes
checking if x86_64-pc-linux-gnu-gcc supports -Wmain... yes
checking if x86_64-pc-linux-gnu-gcc supports -Wmissing-braces... yes
checking if x86_64-pc-linux-gnu-gcc supports -Wsequence-point... yes
checking if x86_64-pc-linux-gnu-gcc supports -Wreturn-type... yes
checking if x86_64-pc-linux-gnu-gcc supports -Wtrigraphs... yes
checking if x86_64-pc-linux-gnu-gcc supports -Warray-bounds... yes
checking if x86_64-pc-linux-gnu-gcc supports -Wwrite-strings... yes
checking if x86_64-pc-linux-gnu-gcc supports -Waddress... yes
checking if x86_64-pc-linux-gnu-gcc supports -Wint-to-pointer-cast... yes
checking if x86_64-pc-linux-gnu-gcc supports -Wpointer-to-int-cast... yes
checking if x86_64-pc-linux-gnu-gcc supports -pedantic... yes
checking if x86_64-pc-linux-gnu-gcc supports -Werror... yes
checking if x86_64-pc-linux-gnu-gcc supports -Werror=attributes... yes
checking whether make supports nested variables... (cached) yes
checking whether to build developer documentation... no
checking for doxygen... no
configure: WARNING: doxygen not found - documentation targets will be skipped
configure: WARNING: dot not found - doxygen targets will be skipped
checking for CHECK... no
checking for XCBPROTO... yes
checking for NEEDED... yes
checking for XDMCP... yes
checking for XdmcpWrap in -lXdmcp... yes
checking XCBPROTO_XCBINCLUDEDIR... //usr/share/xcb
checking XCBPROTO_XCBPYTHONDIR... /
checking for library containing getaddrinfo... none required
checking for library containing connect... none required
checking for library containing sendmsg... none required
checking for struct msghdr.msg_control... yes
checking for struct sockaddr_un.sun_len... no
checking for tsol/label.h... no
checking for is_system_labeled... no
checking whether IOV_MAX is declared... yes
checking whether x86_64-pc-linux-gnu-gcc supports symbol visibility... yes
checking for getaddrinfo... yes
checking for poll... yes
checking that generated files are newer than configure... done
configure: creating ./config.status
config.status: creating Makefile
config.status: creating doc/Makefile
config.status: creating man/Makefile
config.status: creating src/Makefile
config.status: creating tests/Makefile
config.status: creating xcb.pc
config.status: creating xcb-composite.pc
config.status: creating xcb-damage.pc
config.status: creating xcb-dbe.pc
config.status: creating xcb-dpms.pc
config.status: creating xcb-dri2.pc
config.status: creating xcb-dri3.pc
config.status: creating xcb-ge.pc
config.status: creating xcb-glx.pc
config.status: creating xcb-present.pc
config.status: creating xcb-randr.pc
config.status: creating xcb-record.pc
config.status: creating xcb-render.pc
config.status: creating xcb-res.pc
config.status: creating xcb-screensaver.pc
config.status: creating xcb-shape.pc
config.status: creating xcb-shm.pc
config.status: creating xcb-sync.pc
config.status: creating xcb-xevie.pc
config.status: creating xcb-xf86dri.pc
config.status: creating xcb-xfixes.pc
config.status: creating xcb-xinerama.pc
config.status: creating xcb-xinput.pc
config.status: creating xcb-xkb.pc
config.status: creating xcb-xprint.pc
config.status: creating xcb-xselinux.pc
config.status: creating xcb-xtest.pc
config.status: creating xcb-xv.pc
config.status: creating xcb-xvmc.pc
config.status: creating doc/xcb.doxygen
config.status: creating src/config.h
config.status: executing depfiles commands
config.status: executing libtool commands

Package: libxcb 1.16

Configuration
XDM support.........: yes
sendmsg fd passing..: yes
Build unit tests....: no
with html results.: no
XCB buffer size.....: 16384

X11 extensions
Composite...........: yes
Damage..............: yes
Dbe.................: yes
Dpms................: yes
Dri2................: yes
Dri3................: yes
GenericEvent........: no
Glx.................: yes
Randr...............: yes
Record..............: yes
Render..............: yes
Resource............: yes
Screensaver.........: yes
selinux.............: no
Shape...............: yes
Shm.................: yes
Sync................: yes
Xevie...............: no
Xfixes..............: yes
Xfree86-dri.........: yes
xinerama............: yes
xinput..............: yes
xkb.................: yes
xprint..............: no
xtest...............: yes
xv..................: yes
xvmc................: yes

Used CFLAGS:
CPPFLAGS............:
CFLAGS..............: -march=native -O2 -pipe

Installation:
Prefix..............: /usr

>>> Source configured.
>>> Compiling source in /var/tmp/portage/x11-libs/libxcb-1.16/work/libxcb-1.16 ...
* abi_x86_64.amd64: running multilib-minimal_abi_src_compile
make -j3
Making all in src
make[1]: Entering directory '/var/tmp/portage/x11-libs/libxcb-1.16/work/libxcb-1.16-abi_x86_64.amd64/src'
/usr/bin/python3.11 /var/tmp/portage/x11-libs/libxcb-1.16/work/libxcb-1.16/src/c_client.py -c "libxcb 1.16" -l "X Version 11" \
-s "3" -p / \
\
//usr/share/xcb/xproto.xml
/usr/bin/python3.11 /var/tmp/portage/x11-libs/libxcb-1.16/work/libxcb-1.16/src/c_client.py -c "libxcb 1.16" -l "X Version 11" \
-s "3" -p / \
\
//usr/share/xcb/bigreq.xml
/usr/bin/python3.11 /var/tmp/portage/x11-libs/libxcb-1.16/work/libxcb-1.16/src/c_client.py -c "libxcb 1.16" -l "X Version 11" \
-s "3" -p / \
\
//usr/share/xcb/xc_misc.xml
/usr/bin/python3.11 /var/tmp/portage/x11-libs/libxcb-1.16/work/libxcb-1.16/src/c_client.py -c "libxcb 1.16" -l "X Version 11" \
-s "3" -p / \
\
//usr/share/xcb/composite.xml
/usr/bin/python3.11 /var/tmp/portage/x11-libs/libxcb-1.16/work/libxcb-1.16/src/c_client.py -c "libxcb 1.16" -l "X Version 11" \
-s "3" -p / \
\
//usr/share/xcb/damage.xml
Traceback (most recent call last):
File "/var/tmp/portage/x11-libs/libxcb-1.16/work/libxcb-1.16/src/c_client.py", line 3395, in <module>
module.generate()
File "/usr/lib/python3.11/site-packages/xcbgen/state.py", line 131, in generate
item.out(name)
File "/var/tmp/portage/x11-libs/libxcb-1.16/work/libxcb-1.16/src/c_client.py", line 3212, in c_request
_man_request(self, name, void=not self.reply, aux=False)
File "/var/tmp/portage/x11-libs/libxcb-1.16/work/libxcb-1.16/src/c_client.py", line 2676, in _man_request
f.write('%s \\- %s\n' % (func_name, brief))
UnicodeEncodeError: 'latin-1' codec can't encode character '\u201c' in position 68: ordinal not in range(256)
make[1]: *** [Makefile:1425: composite.c] Error 1
make[1]: *** Waiting for unfinished jobs....
make[1]: Leaving directory '/var/tmp/portage/x11-libs/libxcb-1.16/work/libxcb-1.16-abi_x86_64.amd64/src'
make: *** [Makefile:799: all-recursive] Error 1
* ERROR: x11-libs/libxcb-1.16::gentoo failed (compile phase):
* emake failed
*

Any advice or help is appreciated. Must be local issue on my system else-wise it would be widely reported, I would think.

quilosaq
Veteran
Veteran

Joined: 22 Dec 2009
Posts: 1539

Posted: Thu Aug 24, 2023 4:23 pm Post subject:

Try using a locale with utf-8 encoding.

tckosvic
Tux's lil' helper

Joined: 18 Apr 2023
Posts: 138

Posted: Thu Aug 24, 2023 5:22 pm Post subject:

list of /etc/locale.gen below. Shows us-utf-8 enabled. Any other place where this setting could be garbled up. thanks, tom kosvic

Code:

# /etc/locale.gen: list all of the locales you want to have led.on your system.
# See the locale.gen(5) man page for more details.
#
# The format of each line:
# <locale name> <charset>
#
# Where <locale name> starts with a name as found in /usr/share/i18n/locales/.
# It must be unique in the file as it is used as the key to locale variables.
# For non-default encodings, the <charset> is typically appended.
#
# Where <charset> is a charset located in /usr/share/i18n/charmaps/ (sans any
# suffix like ".gz").
#
# All blank lines and lines starting with # are ignored.
#
# For the default list of supported combinations, see the file:
# /usr/share/i18n/SUPPORTED
#
# Whenever glibc is emerged, the locales listed here will be automatically
# rebuilt for you. After updating this file, you can simply run `locale-gen`
# yourself instead of re-emerging glibc.

en_US ISO-8859-1
en_US.UTF-8 UTF-8
#ja_JP.EUC-JP EUC-JP
#ja_JP.UTF-8 UTF-8
#ja_JP EUC-JP
#en_HK ISO-8859-1
#en_PH ISO-8859-1

tckosvic
Tux's lil' helper

Joined: 18 Apr 2023
Posts: 138

Posted: Thu Aug 24, 2023 5:33 pm Post subject:

Additionally, I reran locale-gen and this re-loaded the locale files successfully. I ran the emerge@world again and process stopped at the same place as above with same messages. tom kosvic

grknight
Retired Dev

Joined: 20 Feb 2015
Posts: 1919

Posted: Thu Aug 24, 2023 6:09 pm Post subject:

tckosvic wrote:

Additionally, I reran locale-gen and this re-loaded the locale files successfully.

I ran the emerge@world again and process stopped at the same place as above with same messages.

What does eselect locale list say?

tckosvic
Tux's lil' helper

Joined: 18 Apr 2023
Posts: 138

Posted: Thu Aug 24, 2023 6:34 pm Post subject:

eselect locale list:

Code:

gentooVM /home/tom # eselect locale list
Available targets for the LANG variable:
[1] C
[2] C.utf8
[3] en_US *
[4] en_US.iso88591
[5] en_US.utf8
[6] POSIX
[ ] (free form)
gentooVM /home/tom #

I will change selection to number 5 and rerun. will report how that goes

tom kosvic

tckosvic
Tux's lil' helper

Joined: 18 Apr 2023
Posts: 138

Posted: Thu Aug 24, 2023 6:40 pm Post subject:

emerge now ran past libxcb so "solved", I think. thanks, tom kosvic

shimbob
Tux's lil' helper

Joined: 13 Sep 2003
Posts: 140

Posted: Tue Oct 17, 2023 3:19 am Post subject:

Just got hit with this stopper as well, same fix solved it. Thanks

Robert S
Guru
Guru

Joined: 15 Aug 2004
Posts: 462
Location: Canberra Australia

Posted: Sat Oct 21, 2023 7:07 am Post subject:

I'm having the same problem here, but setting the locale doesn't fix it.

Code:

myserver ~ # eselect locale list
Available targets for the LANG variable:
[1] C
[2] C.utf8 *
[3] en_AU
[4] en_AU.iso88591
[5] en_AU.utf8
[6] en_US
[7] en_US.iso88591
[8] en_US.utf8
[9] POSIX
[ ] (free form)
myserver ~ # eselect locale set 8
Setting LANG to en_US.utf8 ...
Run ". /etc/profile" to update the variable in your shell.
myserver ~ # . /etc/profile
myserver ~ # eselect locale list
Available targets for the LANG variable:
[1] C
[2] C.utf8
[3] en_AU
[4] en_AU.iso88591
[5] en_AU.utf8
[6] en_US
[7] en_US.iso88591
[8] en_US.utf8 *
[9] POSIX
[ ] (free form)

myserver ~ # emerge -vDuN --with-bdeps=y @world

These are the packages that would be merged, in order:

Calculating dependencies... done!
Dependency resolution took 9.40 s.

[ebuild U ] x11-libs/libxcb-1.16:0/1.12::gentoo [1.15-r1:0/1.12::gentoo] USE="xkb -doc (-selinux) -test" ABI_X86="(64) -32 (-x32)" 0 KiB

Total: 1 package (1 upgrade), Size of downloads: 0 KiB

[blah]
Traceback (most recent call last):
File "/var/tmp/portage/x11-libs/libxcb-1.16/work/libxcb-1.16/src/c_client.py", line 3395, in <module>
module.generate()
File "/usr/lib/python3.11/site-packages/xcbgen/state.py", line 131, in generate
item.out(name)
File "/var/tmp/portage/x11-libs/libxcb-1.16/work/libxcb-1.16/src/c_client.py", line 3212, in c_request
_man_request(self, name, void=not self.reply, aux=False)
File "/var/tmp/portage/x11-libs/libxcb-1.16/work/libxcb-1.16/src/c_client.py", line 2676, in _man_request
f.write('%s \\- %s\n' % (func_name, brief))
UnicodeEncodeError: 'latin-1' codec can't encode character '\u201c' in position 68: ordinal not in range(256)
make[1]: *** [Makefile:1425: composite.c] Error 1

Any thoughts? I've tried all the LANG variables that end with utf8.

grknight
Retired Dev

Joined: 20 Feb 2015
Posts: 1919

Posted: Sat Oct 21, 2023 12:22 pm Post subject:

Robert S wrote:

I'm having the same problem here, but setting the locale doesn't fix it.

Code:

Traceback (most recent call last):
File "/var/tmp/portage/x11-libs/libxcb-1.16/work/libxcb-1.16/src/c_client.py", line 3395, in <module>
module.generate()
File "/usr/lib/python3.11/site-packages/xcbgen/state.py", line 131, in generate
item.out(name)
File "/var/tmp/portage/x11-libs/libxcb-1.16/work/libxcb-1.16/src/c_client.py", line 3212, in c_request
_man_request(self, name, void=not self.reply, aux=False)
File "/var/tmp/portage/x11-libs/libxcb-1.16/work/libxcb-1.16/src/c_client.py", line 2676, in _man_request
f.write('%s \\- %s\n' % (func_name, brief))
UnicodeEncodeError: 'latin-1' codec can't encode character '\u201c' in position 68: ordinal not in range(256)
make[1]: *** [Makefile:1425: composite.c] Error 1

Any thoughts? I've tried all the LANG variables that end with utf8.

Please show the output of the locale command under the root user. Also show make.conf and emerge --info.

Robert S
Guru
Guru

Joined: 15 Aug 2004
Posts: 462
Location: Canberra Australia

Posted: Sun Oct 22, 2023 1:34 am Post subject:

Code:

~ # locale
LANG=en_AU
LC_CTYPE="en_AU"
LC_NUMERIC="en_AU"
LC_TIME="en_AU"
LC_COLLATE="en_AU"
LC_MONETARY="en_AU"
LC_MESSAGES="en_AU"
LC_PAPER="en_AU"
LC_NAME="en_AU"
LC_ADDRESS="en_AU"
LC_TELEPHONE="en_AU"
LC_MEASUREMENT="en_AU"
LC_IDENTIFICATION="en_AU"
LC_ALL=

Code:

~ # cat /etc/portage/make.conf
CFLAGS="-O2 -pipe"
CXXFLAGS="-O2 -pipe"
CHOST="x86_64-pc-linux-gnu"
USE="mmx sse sse2"
MAKEOPTS="-j5"
GENTOO_MIRRORS="https://mirror.aarnet.edu.au/pub/gentoo"
USE="$USE -ipv6 -gnome -java -ldap bash-completion -gtk -X -gtk2 gpm -openldap"
PORTDIR_OVERLAY="/usr/local/portage"
PORTAGE_ELOG_CLASSES="warn error log"
PORTAGE_ELOG_SYSTEM="save"
FEATURES="ccache"
CCACHE_SIZE="1G"
source /var/lib/layman/make.conf
QEMU_SOFTMMU_TARGETS="i386 x86_64 arm"
QEMU_USER_TARGETS="i386 x86_64 arm"
PHP_TARGETS="php8-0"
GRUB_PLATFORMS="efi-64"
PORTDIR="/usr/portage"
ACCEPT_LICENSE="NPSL-0.94"

Code:

~ # emerge --info
Portage 3.0.51 (python 3.11.5-final-0, default/linux/amd64/17.1, gcc-13, glibc-2.37-r7, 6.1.31-gentoo-x86_64 x86_64)
=================================================================
System uname: Linux-6.1.31-gentoo-x86_64-x86_64-Intel-R-_Core-TM-_i7-10700_CPU_@_2.90GHz-with-glibc2.37
KiB Mem: 8027884 total, 1796944 free
KiB Swap: 8388604 total, 8345596 free
Timestamp of repository gentoo: Sat, 21 Oct 2023 16:30:01 +0000
Head commit of repository gentoo: 8839270f2104d2c3b5929ecec79ade9f989342f5
Timestamp of repository guru: Sat, 21 Oct 2023 11:16:46 +0000
Head commit of repository guru: 5df517f193b3e66f7d512473d6303a7bdb253d70

sh bash 5.1_p16-r6
ld GNU ld (Gentoo 2.40 p5) 2.40.0
ccache version 4.8.2 [enabled]
app-misc/pax-utils: 1.3.5::gentoo
app-shells/bash: 5.1_p16-r6::gentoo
dev-lang/perl: 5.38.0-r1::gentoo
dev-lang/python: 3.11.5::gentoo
dev-lang/rust: 1.71.1::gentoo
dev-util/ccache: 4.8.2::gentoo
dev-util/cmake: 3.26.5-r2::gentoo
dev-util/meson: 1.2.1-r1::gentoo
sys-apps/baselayout: 2.14::gentoo
sys-apps/openrc: 0.48::gentoo
sys-apps/sandbox: 2.38::gentoo
sys-devel/autoconf: 2.71-r6::gentoo
sys-devel/automake: 1.16.5-r1::gentoo
sys-devel/binutils: 2.40-r5::gentoo
sys-devel/binutils-config: 5.5::gentoo
sys-devel/gcc: 13.2.1_p20230826::gentoo
sys-devel/gcc-config: 2.11::gentoo
sys-devel/libtool: 2.4.7-r1::gentoo
sys-devel/llvm: 16.0.6::gentoo
sys-devel/make: 4.4.1-r1::gentoo
sys-kernel/linux-headers: 6.1::gentoo (virtual/os-headers)
sys-libs/glibc: 2.37-r7::gentoo
Repositories:

gentoo
location: /usr/portage
sync-type: rsync
sync-uri: rsync://rsync.gentoo.org/gentoo-portage
priority: -1000
volatile: True
sync-rsync-verify-jobs: 1
sync-rsync-verify-metamanifest: yes
sync-rsync-extra-opts:
sync-rsync-verify-max-age: 24

guru
location: /var/db/repos/guru
sync-type: git
sync-uri: https://github.com/gentoo-mirror/guru.git
masters: gentoo
volatile: False

x-portage
location: /usr/local/portage
masters: gentoo
priority: 0
volatile: True

ACCEPT_KEYWORDS="amd64"
ACCEPT_LICENSE="@FREE NPSL-0.94"
CBUILD="x86_64-pc-linux-gnu"
CFLAGS="-O2 -pipe"
CHOST="x86_64-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/share/gnupg/qualified.txt"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/php/apache2-php8.1/ext-active/ /etc/php/cgi-php8.1/ext-active/ /etc/php/cli-php8.1/ext-active/ /etc/php/fpm-php8.1/ext-active/ /etc/php/phpdbg-php8.1/ext-active/ /etc/revdep-rebuild /etc/sandbox.d /etc/splash /etc/terminfo"
CXXFLAGS="-O2 -pipe"
DISTDIR="/usr/portage/distfiles"
ENV_UNSET="CARGO_HOME DBUS_SESSION_BUS_ADDRESS DISPLAY GDK_PIXBUF_MODULE_FILE GOBIN GOPATH PERL5LIB PERL5OPT PERLPREFIX PERL_CORE PERL_MB_OPT PERL_MM_OPT XAUTHORITY XDG_CACHE_HOME XDG_CONFIG_HOME XDG_DATA_HOME XDG_RUNTIME_DIR XDG_STATE_HOME"
FCFLAGS="-O2 -pipe"
FEATURES="assume-digests binpkg-docompress binpkg-dostrip binpkg-logs buildpkg-live ccache config-protect-if-modified distlocks ebuild-locks fixlafiles ipc-sandbox merge-sync multilib-strict network-sandbox news parallel-fetch pid-sandbox preserve-libs protect-owned qa-unresolved-soname-deps sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr"
FFLAGS="-O2 -pipe"
GENTOO_MIRRORS="https://mirror.aarnet.edu.au/pub/gentoo"
LANG="en_AU"
LDFLAGS="-Wl,-O1 -Wl,--as-needed"
LEX="flex"
MAKEOPTS="-j5"
PKGDIR="/usr/portage/packages"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git"
PORTAGE_TMPDIR="/var/tmp"
SHELL="/bin/bash"
USE="acl amd64 bash-completion bzip2 cli crypt dri fortran gdbm gpm iconv libtirpc mmx multilib ncurses nls nptl openmp pam pcre readline seccomp split-usr sse sse2 ssl test-rust unicode xattr zlib" ABI_X86="64" ADA_TARGET="gnat_2021" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="karbon sheets words" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_X86="mmx mmxext sse sse2" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock greis isync itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf skytraq superstar2 timing tsip tripmate tnt ublox ubx" GRUB_PLATFORMS="efi-64" INPUT_DEVICES="libinput" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" LUA_SINGLE_TARGET="lua5-1" LUA_TARGETS="lua5-1" OFFICE_IMPLEMENTATION="libreoffice" POSTGRES_TARGETS="postgres15" PYTHON_SINGLE_TARGET="python3_11" PYTHON_TARGETS="python3_11" QEMU_SOFTMMU_TARGETS="i386 x86_64 arm" QEMU_USER_TARGETS="i386 x86_64 arm" RUBY_TARGETS="ruby31" VIDEO_CARDS="amdgpu fbdev intel nouveau radeon radeonsi vesa dummy v4l" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq proto steal rawnat logmark ipmark dhcpmac delude chaos account"
Unset: ADDR2LINE, AR, ARFLAGS, AS, ASFLAGS, CC, CCLD, CONFIG_SHELL, CPP, CPPFLAGS, CTARGET, CXX, CXXFILT, ELFEDIT, EMERGE_DEFAULT_OPTS, EXTRA_ECONF, F77FLAGS, FC, GCOV, GPROF, INSTALL_MASK, LC_ALL, LD, LFLAGS, LIBTOOL, LINGUAS, MAKE, MAKEFLAGS, NM, OBJCOPY, OBJDUMP, PORTAGE_BINHOST, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS, RANLIB, READELF, RUSTFLAGS, SIZE, STRINGS, STRIP, YACC, YFLAGS

grknight
Retired Dev

Joined: 20 Feb 2015
Posts: 1919

Posted: Sun Oct 22, 2023 2:53 am Post subject:

Robert S wrote:

Code:

This is your problem. Somewhere in the environment, LANG is being set to something that is not a utf8 value.
Find where en_AU is being set for root and replace it with a valid utf8 locale.

This could be in /etc/ or in a hidden file for root. Also, how are you becoming root?
Be sure to use a login shell for consistency.

Robert S
Guru
Guru

Joined: 15 Aug 2004
Posts: 462
Location: Canberra Australia

Posted: Sun Oct 22, 2023 7:37 am Post subject:

Fixed.
/etc/profile:

Code:

#export LANG=en_AU changed to:
export LANG=en_AU.utf8

BonezTheGoon
Bodhisattva

Joined: 14 Jun 2002
Posts: 1408
Location: Albuquerque, NM -- birthplace of Microsoft and Gentoo

Posted: Wed Jan 17, 2024 4:03 pm Post subject:

tckosvic wrote:

eselect locale list:

Code:

gentooVM /home/tom # eselect locale list
Available targets for the LANG variable:
[1] C
[2] C.utf8
[3] en_US *
[4] en_US.iso88591
[5] en_US.utf8
[6] POSIX
[ ] (free form)
gentooVM /home/tom #

I will change selection to number 5 and rerun. will report how that goes

tom kosvic

Thanks, this worked to fix things for me today with libxcb! (Using "en_US.utf8" instead of en_US)

Regards,
BonezTheGoon
_________________

mcgruff wrote:

I can't promise to be civil.

pjp wrote:

The greater evil is voting for the "lesser evil."

PyedPyper
n00b
n00b

Joined: 21 Feb 2024
Posts: 2

Posted: Wed Feb 21, 2024 5:07 am Post subject:

Hey I had the same problem.
I didn't want to change my locale so I replaced the troublesome chars..

from the libxcb-1.16 root dir, in file "./src/c_client.py"
add these lines...

new line 2981:

Code:

desc = desc.encode("ascii", "replace").decode("ascii")

new line 2911:

Code:

desc = desc.encode("ascii", "replace").decode("ascii")

new line 2676:

Code:

brief = brief.encode("ascii", "replace").decode("ascii")

new line 337:

Code:

line = line.encode("ascii", "ignore").decode("ascii")

The problem chars are just UTF quotations so you could alternatively replace them with ascii chars...

Code:

line = line.replace('\u201c','"').replace('\u201d','"').replace('\u2018',"'").replace('\u2019',"'")

You could also add print(line) afterwards if you want to see what the data is.

reference for above functions https://docs.python.org/3/howto/unicode.html

Cheers

Display posts from previous:

	Gentoo Forums Forum Index Installing Gentoo	All times are GMT
Page 1 of 1

Jump to:

You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum

Copyright 2001-2024 Gentoo Foundation, Inc. Designed by Kyle Manna © 2003; Style derived from original subSilver theme. | Hosting by Gossamer Threads Inc. © | Powered by phpBB 2.0.23-gentoo-p11 © 2001, 2002 phpBB Group
Privacy Policy