Update 0.1.4.0_beta10 [git] --toolchain, --perl

steveL · Posted: Thu Sep 05, 2013 11:58 pm Post subject: couple of bugfixes

Ah I see what you mean now Geki. I've been working on update today, and just pushed some fixes to stuff that was stopping me upgrading. (I could have got round them with emerge, but that would have meant I lost the test-cases to fix the bugs with.)

I'm glad I took the time to go slowly with the harfbuzz thing: it turned out I needed to change the default cacheDir setting, since portage has been md5-cache only for quite a while. That's what was triggering it looking for the SLOT in the ebuild, instead of the cache, which is where it was picking up the comment from (that's sorted now as well, ofc.) So that should make things a bit quicker for all of us.

I think that just got missed, as I remember spending ages waiting for md5-cache to be the default. Also, there was a problem with blockers, which are slotted, which I hit with php. The ebuild was gone from tree, so I spent a while thinking it was another issue with getSlot. The fixes were pretty small in the end, as usual, but that area has always been hard to debug; so I made it a bit easier for next time.

Anyhow, I've just hit it not allowing me to proceed with toolchain upgrade because I need to upgrade my kernel before I can do kernel-headers. Picking up on --exclude is an option, although i feel loathe to add yet more code, when my inclination is to keep the rigour of the check, as it only kicks in if linux-headers is in the list, and upgrading to it would be unsafe. Other than that, if you want to do something past the envelope, you should be doing it directly with emerge. I'll have a think about it, as I get my machine updated.

geki · Posted: Fri Sep 06, 2013 6:03 am Post subject:

if I get you right, I just have to mask newer linux-headers. lets see ...
_________________
hear hear

steveL · Posted: Fri Sep 06, 2013 1:03 pm Post subject:

steveL · Posted: Sat Sep 14, 2013 4:28 pm Post subject: updating after a few months

Well, I've finally finished the first cut of --toolchain; it's currently in git (along with a few other fixes.) Oh I also enabled update --perl in line with --python and --haskell, since Griz was on-hand to QA it.

My last --deep world, according to /var/log/emerge.log was on January 06, 2013, (ie 8 months ago!) and I've finally set it off again, after upgrading my kernel, since linux-headers were blocked as above (by design), then the following from update --toolchain

steveL · Posted: Sat Sep 14, 2013 4:42 pm Post subject: update --toolchain: resume

So I got the resume working:

steveL

So what came next, once I was sure there was no weird linkage going on with toolchain things? (And I'd got some sleep;-) The usual tree-chasing basically, just a few things compressed into one upgrade, including an improvement in USE flag editing.

Standard update -s came up with a couple of blockers. First off, ncurses got a new tinfo flag, and openrc needed to be compiled with it off (I think; I lost the terminal output, so I'm going off emerge.log and eix output for what's there now.) update ncurses took care of that.

texlive-langgerman-2012 was blocking the upgrade to texlive-2013, despite the new version being in the list, so for the time being I simply used emerge -Cq texlive-langgerman (remember: update doesn't have an uninstall option: we don't shield you from emerge, since if you don't know how to use it properly you will not be able to troubleshoot anything at all.) Note that -cq is the normal uninstall switch, which is dependency aware. However since it's dependency-aware, it won't remove a package that's in-use (ie depended on by another package, or in world/system.)

Additionally sysvinit was holding back openrc and udev (iirc) and util-linux needed upgrading for something else, so I simply hit update sysvinit util-linux to get past those. (update does not install to world unless you tell it to with -i.)

Then I tried update -aU system but only 2 packages showed up (note i'd forgotten -u ;) and it was worse with --bdep, so I just used update system and let it skip useless rebuilds, using the old logic. That got the list down from 40 to 16 packages and meant I could proceed knowing my base system was up to date. (Stuff like bash; again a reboot was in order.)

The next bit was me playing with USE-flags, basically, and seeing what new stuff was coming in. I had a slight issue with qtsql, since the KDE desktop profile now sets the mysql flag on for that package. This was a suspect area, since we had logic to detect "default" in UI (dialog) as what the package is currently coming in with, ie the default if we don't change anything, but the logic for deciding what flags to set is separate, and uses IUSE from the ebuild. I'd wrestled with it before, but came to a hackish compromise that allowed me to at least switch off a profile-set flag. Even if I do force this one off globally at some point. Basically we now always accept an off setting from the user if the package is currently going to have the flag on, according to emerge. Previously (as here) the global being off, would be enough for it to assume the setting would be off.

That needs a bit of refinement, as ever, but it is an iterative improvement on what was there before. (or I would have had to set the flag manually, by editing package.use.) I also fixed up error handling under --jobs: if you skip an ebuild then that can cause emerge to error out. In my case, I have firefox in noCompile, so it only gets updated when I use update firefox, not on every upgrade that comes in (since it takes forever and uses over 15G of disk space.) But the installed firefox had a dependency on sqlite with fts3 USE-flag, which sqlite-3.8.0 does not have. So I was getting an error, only I couldn't see it, apart from "0 Jobs of compiled" and then a die message that no packages were compiled. That's fixed; (I actually only noticed it as I was trying to update udev without lvm2, which didn't work either. So that was my testcase; it was only when I got the error output that I saw the firefox/sqlite issue.)

And off we go:

steveL · Posted: Sat Sep 21, 2013 6:50 pm Post subject:

Minor bump, as I fixed a couple of bugs.

If it's working okay for everyone for the next couple of weeks, I'll wrap the changes into an ebuild. Though we really should set up an overlay, since waiting a year between releases is no good.

steveL · Posted: Sat Apr 05, 2014 1:18 am Post subject:

Just so you don't think I'm neglecting this (or an ebuild) I am very close to finishing off --toolchain. The recent perl difficulties, led me to wanting this dependency conflict handled automatically, which entailed handling all of them (3 types that I know about so far) generically, including when ABI warnings happen for packages that aren't in the resultant list. This shows the problem:

brownandsticky · n00b Joined: 19 Nov 2014 Posts: 4

'been using this script for a week or so now and it's awesome. I used my own little script for years but wanted something more polished and complete. This fits the bill nicely.

Many thanks +SteveL

As a stop gap for overlay. Could you possibly make the ebuilds available via git (in app-portage directory)?

steveL · Posted: Thu Nov 20, 2014 6:30 pm Post subject:

jamtat · Apprentice Joined: 09 Aug 2003 Posts: 162

I found the script discussed in this thread while trying to find a semi-automated way of keeping my Gentoo/MythTV system updated/upgraded. Could I ask that the author of this script take a look at the thread I created at https://forums.gentoo.org/viewtopic-t-1021528.html?sid=6b54a4ec784b5aa3fe0d4ae52a8571bd and offer input as to whether this script could serve my purposes? Thanks in advance for any input on this: I hope this might provide the answer I'm seeking.

steveL · Posted: Thu Jul 16, 2015 5:24 pm Post subject:

Sorry I didn't reply sooner; this didn't come up in "My Posts", for some reason.

steveL · Posted: Sat Jul 18, 2015 1:11 pm Post subject: trac snafu

Just in case anyone tries to register on the trac, sorry but we've closed that for a few days, due to a deluge of fake account spam, till infra sort out a captcha or something they're happy with.

Shame, as I've always hated captchas, but can't see any other real option. In any event, if you need an account (unlikely I know ;) then feel free to pm me, or ask (Monkeh, igli or Griz64) in #friendly-coders on IRC: chat.freenode.net

geki · Posted: Sat Sep 12, 2015 9:34 am Post subject:

finally got time to merge git version. set noCompile array in config wrt kernel, its headers, grub and perl to skip these for manual upgrades.

just a great experience updating, thank you again, steveL!

_________________
hear hear

steveL · Posted: Mon Sep 14, 2015 3:29 pm Post subject:

Hey you're welcome geki :-)

Thanks for the encouragement. :D