Gentoo Forums
Gentoo Forums
Gentoo Forums
Quick Search: in
python 3.8.2 in qemu aarch64 chroot
View unanswered posts
View posts from last 24 hours

 
Reply to topic    Gentoo Forums Forum Index Gentoo on ARM
View previous topic :: View next topic  
Author Message
mortonP
Tux's lil' helper
Tux's lil' helper


Joined: 22 Dec 2015
Posts: 89

PostPosted: Sun May 03, 2020 8:38 pm    Post subject: python 3.8.2 in qemu aarch64 chroot Reply with quote

I'm trying to compile python-3.8.2-r2 in a qemu aarch64 chroot, on x86.
So far I've had no problems with any package from Gentoo (and older Pythons), however this one fails.
Compiling it native on aarch64 it compiles fine.
What is the difference in QEMU that just the Python 3.8 package fails?

....

Code:

Compiling '/var/tmp/portage/dev-lang/python-3.8.2-r2/image/usr/lib/python3.8/test/audit-tests.py'...
Compiling '/var/tmp/portage/dev-lang/python-3.8.2-r2/image/usr/lib/python3.8/test/bytecode_helper.py'...
Process ForkProcess-2:
Traceback (most recent call last):
  File "/var/tmp/portage/dev-lang/python-3.8.2-r2/image/usr/lib/python3.8/multiprocessing/process.py", line 315, in _bootstrap
    self.run()
  File "/var/tmp/portage/dev-lang/python-3.8.2-r2/image/usr/lib/python3.8/multiprocessing/process.py", line 108, in run
    self._target(*self._args, **self._kwargs)
  File "/var/tmp/portage/dev-lang/python-3.8.2-r2/image/usr/lib/python3.8/concurrent/futures/process.py", line 233, in _process_worker
    call_item = call_queue.get(block=True)
  File "/var/tmp/portage/dev-lang/python-3.8.2-r2/image/usr/lib/python3.8/multiprocessing/queues.py", line 116, in get
    return _ForkingPickler.loads(res)
_pickle.UnpicklingError: invalid load key, '\x01'.

and subsequent:

Code:

...
Compiling '/var/tmp/portage/dev-lang/python-3.8.2-r2/image/usr/lib/python3.8/test/bisect_cmd.py'...
Process ForkProcess-3:
Traceback (most recent call last):
  File "/var/tmp/portage/dev-lang/python-3.8.2-r2/image/usr/lib/python3.8/multiprocessing/process.py", line 315, in _bootstrap
    self.run()
  File "/var/tmp/portage/dev-lang/python-3.8.2-r2/image/usr/lib/python3.8/multiprocessing/process.py", line 108, in run
    self._target(*self._args, **self._kwargs)
  File "/var/tmp/portage/dev-lang/python-3.8.2-r2/image/usr/lib/python3.8/concurrent/futures/process.py", line 233, in _process_worker
    call_item = call_queue.get(block=True)
  File "/var/tmp/portage/dev-lang/python-3.8.2-r2/image/usr/lib/python3.8/multiprocessing/queues.py", line 97, in get
    res = self._recv_bytes()
  File "/var/tmp/portage/dev-lang/python-3.8.2-r2/image/usr/lib/python3.8/multiprocessing/synchronize.py", line 98, in __exit__
    return self._semlock.__exit__(*args)
ValueError: semaphore or lock released too many times
Exception in thread QueueManagerThread:
Traceback (most recent call last):
  File "/var/tmp/portage/dev-lang/python-3.8.2-r2/image/usr/lib/python3.8/threading.py", line 932, in _bootstrap_inner
    self.run()
  File "/var/tmp/portage/dev-lang/python-3.8.2-r2/image/usr/lib/python3.8/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "/var/tmp/portage/dev-lang/python-3.8.2-r2/image/usr/lib/python3.8/concurrent/futures/process.py", line 394, in _queue_management_worker
    work_item.future.set_exception(bpe)
  File "/var/tmp/portage/dev-lang/python-3.8.2-r2/image/usr/lib/python3.8/concurrent/futures/_base.py", line 539, in set_exception
    raise InvalidStateError('{}: {!r}'.format(self._state, self))
concurrent.futures._base.InvalidStateError: CANCELLED: <Future at 0x40143c9f40 state=cancelled>

...

Code:
Listing '/var/tmp/portage/dev-lang/python-3.8.2-r2/image/usr/lib/python3.8/xmlrpc'...
Traceback (most recent call last):
  File "/var/tmp/portage/dev-lang/python-3.8.2-r2/image/usr/lib/python3.8/compileall.py", line 327, in <module>
    exit_status = int(not main())
  File "/var/tmp/portage/dev-lang/python-3.8.2-r2/image/usr/lib/python3.8/compileall.py", line 309, in main
    if not compile_dir(dest, maxlevels, args.ddir,
  File "/var/tmp/portage/dev-lang/python-3.8.2-r2/image/usr/lib/python3.8/compileall.py", line 93, in compile_dir
    success = min(results, default=True)
  File "/var/tmp/portage/dev-lang/python-3.8.2-r2/image/usr/lib/python3.8/concurrent/futures/process.py", line 484, in _chain_from_iterable_of_lists
    for element in iterable:
  File "/var/tmp/portage/dev-lang/python-3.8.2-r2/image/usr/lib/python3.8/concurrent/futures/_base.py", line 611, in result_iterator
    yield fs.pop().result()
  File "/var/tmp/portage/dev-lang/python-3.8.2-r2/image/usr/lib/python3.8/concurrent/futures/_base.py", line 439, in result
    return self.__get_result()
  File "/var/tmp/portage/dev-lang/python-3.8.2-r2/image/usr/lib/python3.8/concurrent/futures/_base.py", line 388, in __get_result
    raise self._exception
concurrent.futures.process.BrokenProcessPool: A process in the process pool was terminated abruptly while the future was running or pending.

...
Code:
Compiling '/var/tmp/portage/dev-lang/python-3.8.2-r2/image/usr/lib/python3.8/test/_test_multiprocessing.py'...
Process ForkProcess-4:
Traceback (most recent call last):
  File "/var/tmp/portage/dev-lang/python-3.8.2-r2/image/usr/lib/python3.8/multiprocessing/process.py", line 315, in _bootstrap
    self.run()
  File "/var/tmp/portage/dev-lang/python-3.8.2-r2/image/usr/lib/python3.8/multiprocessing/process.py", line 108, in run
    self._target(*self._args, **self._kwargs)
  File "/var/tmp/portage/dev-lang/python-3.8.2-r2/image/usr/lib/python3.8/concurrent/futures/process.py", line 233, in _process_worker
    call_item = call_queue.get(block=True)
  File "/var/tmp/portage/dev-lang/python-3.8.2-r2/image/usr/lib/python3.8/multiprocessing/queues.py", line 116, in get
    return _ForkingPickler.loads(res)
EOFError: Ran out of input


[Moderator edit: changed [quote] tags to [code] tags to preserve output layout. -Hu]
Back to top
View user's profile Send private message
jannis
Guru
Guru


Joined: 05 Dec 2004
Posts: 340
Location: Germany / Bavaria / Aschaffenburg

PostPosted: Tue Nov 24, 2020 6:54 pm    Post subject: Reply with quote

I experienced exactly the same (cross-arch chroot from amd64 to arm64) and python:3.8 failed with the same errors. Building it with MAKEOPTS="-j1" fixed it for me
Back to top
View user's profile Send private message
Display posts from previous:   
Reply to topic    Gentoo Forums Forum Index Gentoo on ARM All times are GMT
Page 1 of 1

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum