xx-sources

xiphux · Posted: Tue May 04, 2004 4:48 am Post subject: xx-sources

[edit]
As requested, here is a link for people who don't want to go hunting through this thread:
http://sourceforge.net/projects/xx-sources
The version in Sourceforge CVS is usually the most recent.
[/edit]

Not to steal anyone's fire, but since more and more people are posting kernel patchsets, I figured I'd jump on the bandwagon since my patchset has a couple things I don't really see in the others - namely, the extra reiser4 patches in http://thebsh.namesys.com/snapshots/2004.03.26/extra/ and the runtime selectable IO scheduler patches (which I haven't seen around here for some time).

It's yet another reiser4-based patchset, so it's still applied to 2.6.5. It's got Nicksched v30d, cfq, elv-select, autoregulating swappiness, bootsplash, configurable jiffies and cflags, and some other random crap.

The files are here:

http://www.thelightofthesoul.com/linux/patches/xx-sources-2.6.5-xx17/

The full patch list is in the patch-series file. I've been doing this for a while, but this is the first public release, which is why the version is so high.

I also tried to implement isochronous scheduling in Nicksched. However, my knowledge of the kernel scheduling code is limited, so it probably doesn't work. Just ignore it or reverse it.

I have a bootscript that I use to manage my IO schedulers:
http://www.thelightofthesoul.com/linux/init.d/scheduler
http://www.thelightofthesoul.com/linux/conf.d/scheduler

Since this was originally created with just my computer in mind, it's really only got the patches I wanted. But almost any other patch can be added upon request and a link, provided that it doesn't cause horrible breakage (like the way rmap/anonmm/anonvma break reiser4).

So give it a shot and tell me what you think.

Evil Dark Archon · Posted: Tue May 04, 2004 6:38 am Post subject:

i would advise taking out the runtime-selectable io scheduler patch as it has known bugs with usb-storage devices.
_________________
This post has been over explained for newb-informing purposes.

Registered Linux user 347334
Abit AV8-3rd eye, AMD Athlon64 3500+ 90nm, ATI Radeon x850 pro

Jake · Veteran Joined: 31 Jul 2003 Posts: 1132

neenee · Veteran Joined: 20 Jul 2003 Posts: 1786

xiphux · Posted: Tue May 04, 2004 4:06 pm Post subject:

I haven't had any issues with it, and not everyone uses usb storage devices. If you don't like it, you can just reverse it.

yngwin · Posted: Tue May 04, 2004 5:03 pm Post subject:

Whooah! That looks really good! I'm gonna try and build this thing. Keep up the good work!

BTW, does reiser4-20040326-fixed.patch mean it has these fixes?

yngwin · Posted: Tue May 04, 2004 5:29 pm Post subject:

For people who like ebuilds: I made an ebuild for xx-sources. Get it from
http://www.stijlstek.nl/os/linux/gentoo/ebuilds/sys-kernel/xx-sources/
_________________
"Those who deny freedom to others deserve it not for themselves." - Abraham Lincoln
Free Culture | Defective by Design | EFF

yngwin · Posted: Tue May 04, 2004 7:45 pm Post subject:

Hmm, I get this error:

xiphux · Posted: Tue May 04, 2004 7:47 pm Post subject:

The fixed reiser4 has all the bugfixes to date. (I know the tail, ..metas rename, and the meta permissions ones are in there. I'll check on as_ops)

I don't have the security patch, but i'll put it in.

At the moment, I'm attempting to add supermount, layer7 netfilter, some of the worthwhile patches in 2.6.5-tiny, and the reiserfs data=journal and xattr acl patches from Chris Mason for the next release. (And that security fix)

I am running it now... did you reverse any of the patches? I'll try rediffing it in a bit.

yngwin · Posted: Tue May 04, 2004 7:51 pm Post subject:

No, I just used my ebuild for xx-sources, which cleanly applies the patch, then make mrproper. Then I do make menuconfig and make, getting this error. Seems to be in the scheduler code. Backing out nicksched would probably help, but I'd like to keep that in

And BTW it seems v30e is out.
_________________
"Those who deny freedom to others deserve it not for themselves." - Abraham Lincoln
Free Culture | Defective by Design | EFF

xiphux · Posted: Tue May 04, 2004 8:14 pm Post subject:

Ok, I rediffed it from the working tree I have in /usr/src/linux. Hopefully it should work this time. If your computer still doesn't like it, then try reversing the extra reiser4 patch reiser4-iowait-reason.patch. Since it's early in the patch list, you might have to fix a block by hand.

I'm putting v30e into the next one.

yngwin · Posted: Tue May 04, 2004 9:20 pm Post subject:

No go. Same error with your rediffed patch. After backing out reiser4-iowait-reason.patch, i get an error a bit later in mm/page-writeback.c which I suspect is related to the backed-out patch. Hmm, these extra reiser4 fixes seem to be more trouble then they're worth...

BTW, do you have a link to d/l v30e? I can't find it. Then I can apply it myself to a vanilla kernel.
_________________
"Those who deny freedom to others deserve it not for themselves." - Abraham Lincoln
Free Culture | Defective by Design | EFF

Jake · Veteran Joined: 31 Jul 2003 Posts: 1132

For a workaround, enable SMP.

EDIT: it compiles and boots, but hangs when I try to start X. I'm running Xorg on a reiser4 filesystem with nvidia binary drivers and Athcool enabled.

xiphux · Posted: Wed May 05, 2004 4:11 am Post subject:

Huh. I suppose the extra reiser4 patches are extra for a reason. Oh well. Hopefully it works for someone other than me...

The nvidia driver issue is probably related to the 4k-stacks patch. Try reversing that one. I really wish I could test and find out, but I don't have an nvidia card.

Redeeman's versions of Nicksched are available at:
http://kaspersandberg.com/~redeeman/Redeeman-Sources/
inside the vanilla folder.
The link seems to be down at the time of this post, but I know that it usually works.

The as_ops fix is in the fixed reiser4 patch. (I always called it mapping->host->dirtied_when, since that's what it actually did)

Well, for the few of you for whom this patch actually works, I have a new version:
http://www.thelightofthesoul.com/linux/patches/xx-sources-2.6.5-xx18/

Nicksched is updated to v30e, and supermount and layer7 are added. The extra reiser4 patches seem to break some of the patches in -tiny, but I don't know which ones yet, so I haven't included any of -tiny.

And for those of you complaining about elv-select, there's a patch in that folder that will back out the selectable elevators and the original cfq, add the ioniceable cfq scheduler, and add the code to set ionice according to scheduling priority.

I'll try to trace down the source of these problems, but with limited time and testing platforms, I can't really guarantee anything. If the extra reiser4 patches continue to cause issues, I may start backing them out.

Well, I guess this gives you a reason to continue doing your lokean-sources, yngwin...

yngwin · Posted: Wed May 05, 2004 11:39 am Post subject:

yngwin · Posted: Wed May 05, 2004 12:24 pm Post subject:

OK, you can get the new ebuild for xx18 at http://www.stijlstek.nl/os/linux/gentoo/ebuilds/sys-kernel/xx-sources/
_________________
"Those who deny freedom to others deserve it not for themselves." - Abraham Lincoln
Free Culture | Defective by Design | EFF

Jake · Veteran Joined: 31 Jul 2003 Posts: 1132

xx18 is working great with 4k stacks backed out and SMP enabled

Redeeman · l33t Joined: 25 Sep 2003 Posts: 958 Location: Portugal

the reason the link to my site is sometimes down, is that i host it at my workstation, which usually is down at the night

(im GMT+1)

xiphux · Posted: Wed May 05, 2004 8:56 pm Post subject:

I dug up the old 4k stacks patch that still leaves the 4k/8k config option, so I'll use that in the future to make it easier.

Redeeman, if you want, I can give you some space on my site for posting releases or whatever. It's up all the time.

xiphux · Posted: Thu May 06, 2004 7:02 am Post subject:

Ok, following right on the heels of xx18 is xx19.

http://www.thelightofthesoul.com/linux/patches/xx-sources-2.6.5-xx19/

It's got all the patches xx18 has, plus some more.

I moved to the older 4k stacks patch that leaves the 4k stacks option in kernel hacking. That should make it a little easier for nvidia users.

I've added Win4Lin, another bugfix from the lkml, the vesafb refreshrate patch, and a patch from Nikita Danilov of Namesys to add per-super-block info in proc and sysfs.

I also added most of the useful stuff in gentoo-dev-sources: bugfixes, lufs, squashfs, lirc, etc. There is also a patch in gentoo-dev-sources that sets up the kernel to use low-latency, which should be used in place of preempt. Supposedly it fixes 90% of the latency issues - at least, according to the gentoo-dev-sources maintainer. However, I'm still a bit skeptical. So I added the patch, and hacked up a config option to enable/disable the low latency calls, so you don't have to keep patching/reversing to test between low-latency and preempt. The low latency and preempt options are mutually exclusive, since you're not supposed to use them together. It's a little ugly since I don't have a whole lot of experience with Kconfig.

And, of course, I've provided a cfqionice/schedioprio addon patch.

I got grsecurity2 to apply, but it's very fragile and has problems booting , so it's not in this one. Maybe the next release.

The extra reiserfs data=ordered patches conflict with the reiser4 patch, so I can't include those until there's a new snapshot.

Jake · Veteran Joined: 31 Jul 2003 Posts: 1132

Now I seem to be having problems with my USB keychain. It must be something in the newer kernels or your patchset.

If I use the cfqionice patch you provide, will it interfere with the other schedulers, most importantly AS? Last time I used that patch (CK's against vanilla), it broke every scheduler other than CFQ.

xiphux · Posted: Thu May 06, 2004 4:29 pm Post subject:

Yeah, it probably will break the other schedulers, unfortunately. I'm not sure why it does that. Actually, that's on my to-do list of things to look into.

But for now, you might just want to reverse elv-init-cleanup and elv-select.

yngwin · Posted: Thu May 06, 2004 9:49 pm Post subject:

xiphux · Posted: Fri May 07, 2004 5:04 am Post subject:

Well, it's finals week over here but my next final is on Monday and most of my friends have left already. So there's not much to do...

You don't have to keep making ebuilds if you don't want to, yngwin. And copying an old ebuild to a new filename will probably work, too. Besides, no one but me really uses this kernel...

And on that note, here's another one:

http://www.thelightofthesoul.com/linux/patches/xx-sources-2.6.5-xx20/

There's really only one major change in this patch. Now, in the kernel hacking section, there's an option to choose from a couple io framework options: runtime selectable io schedulers, cfqionice, or none. So you can just do a switch and recompile. Everyone can be satisfied without having to reverse patches; it's just a matter of switching a menu option. I thought that would be pretty useful. All three modes compile, and I've booted with the selectable IO schedulers, but let me know if there's a bug somewhere.

I also cleaned up the preempt/low-latency thing to be an actual choice, as opposed to two booleans.

Since this kernel originally used to be just for my computer, I got into the habit of making new releases anytime I made some changes, as opposed to waiting to make a release. So I guess you can see why the version is already at 20...

scaba · Posted: Fri May 07, 2004 5:54 am Post subject: