View previous topic :: View next topic |
Author |
Message |
kernelOfTruth Watchman
Joined: 20 Dec 2005 Posts: 6111 Location: Vienna, Austria; Germany; hello world :)
|
Posted: Sun Aug 17, 2008 1:37 am Post subject: Official thread: "zen-sources" - Part V |
|
|
checking the sources out
First Time
1) for zen-sources
Code:
Code: | cd /usr/src
git clone git://zen-sources.org/zen/zen.git zen-sources
cd zen-sources
make menuconfig |
2) for zenmm-sources
Code:
Code: | cd /usr/src
git clone git://zen-sources.org/zen/mmotm.git zenmm-sources
cd zenmm-sources
make menuconfig |
3) for zenrt-sources (doesn't exist yet / anymore)
Code:
Code: | cd /usr/src
git clone git://zen-sources.org/zen/kernel/zenrt.git zen-sources
cd zen-sources
make menuconfig |
creating a patch
example:
Code: |
git diff v2.6.24 v2.6.24-zen1 > 2.6.24-zen1.patch |
you can also do most of this stuff graphically (GUI !) with qgit:
or
Code: | apt-cache search qgit |
then
Code: | sudo apt-get install qgit | (if that's the exact package name on apt/deb-based systems)
update sources (inside the directory)
Code: | Update
Code:
cd /usr/src/zen-sources
git pull | (called "merging")
you are in the middle of a conflicted merge:
output could be:
Quote: | git pull
Auto-merged .gitignore
Auto-merged MAINTAINERS
Auto-merged Makefile
CONFLICT (content): Merge conflict in Makefile
Removed arch/mips/lasat/sysctl.h
Auto-merged drivers/ata/libata-scsi.c
Auto-merged drivers/char/Kconfig
Auto-merged drivers/char/drm/ati_pcigart.c
Auto-merged drivers/char/drm/drm.h
Auto-merged drivers/char/drm/drm_drv.c
CONFLICT (content): Merge conflict in drivers/char/drm/drm_drv.c
...
Automatic merge failed; fix conflicts and then commit the result. |
rmh3093 wrote: | This usually happens when the branch you are trying to update has been rebased. The easiest way to get around this is to checkout a new copy of the branch. For example, if you are currently on the master branch you would do something like the following: |
first try:
Code: | git checkout -f && git pull |
if that doesn't help, then:
Code: | git reset --hard; git branch -M master master-old; git checkout -b master origin/master; git branch -D master-old; git checkout -f |
you need to change to another branch ?
example:
Code: | # git checkout master-devel |
if the branch doesn't exist in your directory ()
e.g. master-light, then enter
Code: | git branch master-light origin/master-light && git checkout master-light |
you want to check out a specific version?
Code: | git checkout v2.6.25-rc5-zen0 |
speeding up merge (download) of zen-sources (during first time)
1) checkout the linux-2.6 branch of linus (git.eu.kernel.org or git.kernel.org)
Code: | git clone git://git.eu.kernel.org/pub/scm/linux/kernel/git/torvalds/linux-2.6.git |
or
Code: | git clone git://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux-2.6.git |
2) then merge both (e.g. it's in /usr/src/sources/linux-2.6)
Code: | git clone --reference /usr/src/sources/linux-2.6/ git://zen-sources.org/zen/zen.git |
what branches are there?
currently (december 2008), there are 2 different patchsets and branches used in those are (see):
( heads (zen-sources) ):
( heads (zenmm-sources) ):
( heads (zenrt-sources) ): (not available right now)
- master (git checkout master) (e.g. v2.6.24-zen3)
sometime there's also master-new or similar for testing / rebasing purposes
the other "head"s are branches which are added to the main tree
the project's site can be reached over at:
www.zen-sources.org
the repo is reachable via:
http://git.zen-sources.org/?p=zen.git;a=summary (zen-sources)
and/or
http://git.zen-sources.org/?p=mmotm.git;a=summary (zenmm-sources)
and/or
http://zen-sources.org/cgi-bin/gitweb.cgi?p=kernel-rt.git;a=summary (zenrt-sources) (not available right now)
as of August 2008 there's a zenhardened-sources planned with no ETA known yet
update:
removed reiser4-repository links
update2:
added instruction on how to git-clone linus' repository and using that for reference to update to the zen-sources repo
update3:
updated adresses to the new overlay/servers
update4:
updated the git-addresses for zen-sources and mmotm (mm-sources) of the new zen-sources server _________________ https://github.com/kernelOfTruth/ZFS-for-SystemRescueCD/tree/ZFS-for-SysRescCD-4.9.0
https://github.com/kernelOfTruth/pulseaudio-equalizer-ladspa
Hardcore Gentoo Linux user since 2004
Last edited by kernelOfTruth on Thu Dec 18, 2008 1:07 pm; edited 6 times in total |
|
Back to top |
|
|
tranquilcool Veteran
Joined: 25 Mar 2005 Posts: 1246
|
Posted: Sun Aug 17, 2008 6:26 am Post subject: |
|
|
CC drivers/block/floppy.o
CC drivers/block/brd.o
CC drivers/block/compcache.o
drivers/block/compcache.c: In function ‘compcache_size_setup’:
drivers/block/compcache.c:465: error: implicit declaration of function ‘strtoul’
make[2]: *** [drivers/block/compcache.o] Error 1
make[1]: *** [drivers/block] Error 2
make: *** [drivers] Error 2
errors with latest git pull zen-sources.
the kernel only compiles if compcache is selected as a module. _________________ this is a strange strange world. |
|
Back to top |
|
|
mieszkoslusarczyk Tux's lil' helper
Joined: 16 Jul 2008 Posts: 92 Location: Kraków/Poland
|
Posted: Sun Aug 17, 2008 6:36 am Post subject: |
|
|
I want to unmerge squashfs from zen-sources. Can you tell me how do I create a patch to do it? |
|
Back to top |
|
|
rmh3093 Advocate
Joined: 06 Aug 2003 Posts: 2138 Location: Albany, NY
|
Posted: Sun Aug 17, 2008 7:26 am Post subject: |
|
|
mieszkoslusarczyk wrote: | I want to unmerge squashfs from zen-sources. Can you tell me how do I create a patch to do it? |
look on gitweb for the commit id for squashfs and then use 'git revert' _________________ Do not meddle in the affairs of wizards, for they are subtle and quick to anger. |
|
Back to top |
|
|
mieszkoslusarczyk Tux's lil' helper
Joined: 16 Jul 2008 Posts: 92 Location: Kraków/Poland
|
Posted: Sun Aug 17, 2008 7:31 am Post subject: |
|
|
Which id is it?
Is it one of those?
Code: | commit 43b8bda46f64f1d2222ba9cb705cf6a92d9ed87d
tree 6176375e037b4d853460abc51cc56d89fffdb9d5
parent dcef349bb45244bb9b9d50f14a9a148ed21bea84 |
What command should I issue to do that? |
|
Back to top |
|
|
Diskmaster n00b
Joined: 13 Jul 2008 Posts: 23
|
Posted: Sun Aug 17, 2008 8:02 am Post subject: |
|
|
rmh or cheater: e2fsprogs/ss/com_err 1.41 is now in tree, and such it should be dropped from zen-overlay. :O
also, wtb [alsa-kernel.git in -zen?] pst _________________ Linux polished-diamond 3.0.9-00003-g3c676b1 x86_64 Intel(R) Core(TM) i7 CPU 950 @ 3.07GHz GenuineIntel GNU/Linux
Something witty goes here.
Last edited by Diskmaster on Sun Aug 17, 2008 11:25 am; edited 1 time in total |
|
Back to top |
|
|
kernelOfTruth Watchman
Joined: 20 Dec 2005 Posts: 6111 Location: Vienna, Austria; Germany; hello world :)
|
|
Back to top |
|
|
RobertDavid Apprentice
Joined: 08 Aug 2005 Posts: 271 Location: Czech Republic
|
Posted: Sun Aug 17, 2008 11:22 am Post subject: |
|
|
Hi guys, do you plan to support new eee901 in zen? this means ethernet atl1e, wifi rt2860. ?? If so I would make a zen package for ARCH linux and eee901. But it looks like there are only sources for building a modules for those hw, not a kernel patch.
And another question is, if there is 1G-lowmem patch in x86 branch of ZEN. Im serching for this patch to the 2.6.26 kernel we use in ARCH linux for eee901. _________________ Arch & Fluxbox & 2.6.24-rc-zen!!!!
robertek.brevnov.net |
|
Back to top |
|
|
rmh3093 Advocate
Joined: 06 Aug 2003 Posts: 2138 Location: Albany, NY
|
Posted: Sun Aug 17, 2008 3:31 pm Post subject: |
|
|
kernelOfTruth wrote: | rmh3093 wrote: | mieszkoslusarczyk wrote: | I want to unmerge squashfs from zen-sources. Can you tell me how do I create a patch to do it? |
look on gitweb for the commit id for squashfs and then use 'git revert' |
you can also do it with qgit (see first post of this thread)
@rmh3093, cheater1034:
is it safe now to use compcache with zen-sources and/or reiser4 ?
safe probably, does it work properly... probably not
thanks for bumping zen-sources |
_________________ Do not meddle in the affairs of wizards, for they are subtle and quick to anger. |
|
Back to top |
|
|
rmh3093 Advocate
Joined: 06 Aug 2003 Posts: 2138 Location: Albany, NY
|
Posted: Sun Aug 17, 2008 3:33 pm Post subject: |
|
|
RobertDavid wrote: | Hi guys, do you plan to support new eee901 in zen? this means ethernet atl1e, wifi rt2860. ?? If so I would make a zen package for ARCH linux and eee901. But it looks like there are only sources for building a modules for those hw, not a kernel patch.
And another question is, if there is 1G-lowmem patch in x86 branch of ZEN. Im serching for this patch to the 2.6.26 kernel we use in ARCH linux for eee901. |
never heard of eee901 till now, i will look into it, its ok if it does apply as a patch, I Know how to make kbuild/makefile's
1G-lowmem is in there.... should be at least _________________ Do not meddle in the affairs of wizards, for they are subtle and quick to anger. |
|
Back to top |
|
|
mieszkoslusarczyk Tux's lil' helper
Joined: 16 Jul 2008 Posts: 92 Location: Kraków/Poland
|
Posted: Sun Aug 17, 2008 5:33 pm Post subject: |
|
|
Is there a unionfs patch, that applies to latest zen-sources?
If not, could you make one, orinclude it in the tree?
#####EDIT
Sorry it doesn't apply to the 2.6.26 series of zen-sources, it DOES apply to the latest.
Btw.: Could you include unionfs in zen-sources?
Can anyone make a patch for 2.6.26-zen2? |
|
Back to top |
|
|
cheater1034 Veteran
Joined: 09 Sep 2004 Posts: 1558
|
|
Back to top |
|
|
cheater1034 Veteran
Joined: 09 Sep 2004 Posts: 1558
|
Posted: Mon Aug 18, 2008 3:36 am Post subject: |
|
|
Git updates:
- Add unionfs 2.4
- Fix a build on allyesconfig
- Add alsa/git, 1.0.18-rc1
- Revert comp cache
- Reiser4 code cleanups (~17,000 line patch :-p)
*edit*
Also added ext4 stuff, like online defrag v9 + more:
Code: | ext4_journal_credits_fix_for_writepages.patch
ext4-online-defrag-ext4-defrag.patch
ext4-online-defrag-alloc-contiguous-blks.patch
defrag-alloc-contiugous-blks-credit
ext4-online-defrag-relocate-file-data.patch
defrag-relocate-file-data-credits
ext4-online-defrag-exchange-blocks-between-two-inodes.patch
ext4-online-defrag-for-relevant-files.patch
ext4-online-defrag-check-for-freespace-fragmentation.patch
ext4-online-defrag-move-victim-files.patch
vfs-fiemap.patch
ocfs2-fiemap.patch
generic-fiemap.patch
ext4-fiemap.patch
ext4_fix_printk_checkpatch_issues |
*edit*
Quote: | for our reiser4-users/fans there's also vanilla+reiser4 only patchset and/or a reiser4-progs repository: |
I'm quite sure we do not want to use these, don't lead users to this git repo
*edit*
2.6.27-rc3-zen is about completed in git, and stabilized except for a minor zen-tune issue, it has btrfs v16 now and the latest mercurial~ _________________ IRC!: #zen-sources on irc.rizon.net
zen-kernel.org
--
Lost in android development land. |
|
Back to top |
|
|
mantoo Tux's lil' helper
Joined: 08 Dec 2007 Posts: 98 Location: Germany
|
Posted: Mon Aug 18, 2008 7:48 am Post subject: |
|
|
compcache excluded in 2.6.27-rc3? wasnt able to find it... should be /drivers/block-devices, shouldn't it?
and what is zen-tunable sysfs? wasn able to find anything on the net...
thx, mantoo |
|
Back to top |
|
|
mroconnor Guru
Joined: 24 Feb 2006 Posts: 402 Location: USA
|
Posted: Mon Aug 18, 2008 3:56 pm Post subject: |
|
|
pulled this am and got this when trying to compile:
Code: |
...
CC block/genhd.o
CC block/scsi_ioctl.o
CC block/cmd-filter.o
CC block/noop-iosched.o
CC block/deadline-iosched.o
CC block/cfq-iosched.o
CC block/compat_ioctl.o
LD block/built-in.o
CC zen/zen-system-layout-main.o
zen/zen-system-layout-main.c: In function 'zen_system_layout_init':
zen/zen-system-layout-main.c:75: warning: ISO C90 forbids mixed declarations and code
CC zen/sysfs.o
CC zen/zen-tune-main.o
LD zen/zen-tune.o
LD zen/zen-system-layout.o
LD zen/built-in.o
zen/zen-system-layout.o:(.data+0x0): multiple definition of `available_layouts'
zen/zen-tune.o:(.data+0x0): first defined here
make[1]: *** [zen/built-in.o] Error 1
make: *** [zen] Error 2
|
Any ideas? Or is it user error? Thanks. |
|
Back to top |
|
|
cheater1034 Veteran
Joined: 09 Sep 2004 Posts: 1558
|
Posted: Mon Aug 18, 2008 7:37 pm Post subject: |
|
|
mantoo wrote: | compcache excluded in 2.6.27-rc3? wasnt able to find it... should be /drivers/block-devices, shouldn't it? |
It has been reverted in zen, it's broken, it was never in main line kernel if that's what you mean.
Quote: | and what is zen-tunable sysfs? wasn able to find anything on the net...
thx, mantoo |
zen-tune is only in zen, started as a basic way to set different settings (ie scheduler niceness, swappiness, etc) throughout the kernel's kconfig, rather than editing the files manually.
zen-sysfs, zen system layout is all written by rmh, using kernel kobjects/sysfs interface, it allows the options/tunables set to be read in files in /sys/kernel/zen. Some of them being writable meaning you can change the setting during runtime, without recompiling the kernel _________________ IRC!: #zen-sources on irc.rizon.net
zen-kernel.org
--
Lost in android development land. |
|
Back to top |
|
|
mantoo Tux's lil' helper
Joined: 08 Dec 2007 Posts: 98 Location: Germany
|
Posted: Mon Aug 18, 2008 8:04 pm Post subject: |
|
|
cheater1034 wrote: | mantoo wrote: | compcache excluded in 2.6.27-rc3? wasnt able to find it... should be /drivers/block-devices, shouldn't it? |
It has been reverted in zen, it's broken, it was never in main line kernel if that's what you mean.
Quote: | and what is zen-tunable sysfs? wasn able to find anything on the net...
thx, mantoo |
zen-tune is only in zen, started as a basic way to set different settings (ie scheduler niceness, swappiness, etc) throughout the kernel's kconfig, rather than editing the files manually.
zen-sysfs, zen system layout is all written by rmh, using kernel kobjects/sysfs interface, it allows the options/tunables set to be read in files in /sys/kernel/zen. Some of them being writable meaning you can change the setting during runtime, without recompiling the kernel |
currently im using 2.6.27-rc3-zen1 kernel, running dtable for me. just wondered about compcache being mentioned some posts above but not finding anything related in my kernelconfig.
is it advantageous to load the module w/o planning to set those values manually. what i mean is this module used by the kernel itself?
thx |
|
Back to top |
|
|
cheater1034 Veteran
Joined: 09 Sep 2004 Posts: 1558
|
Posted: Mon Aug 18, 2008 10:35 pm Post subject: |
|
|
mantoo wrote: | cheater1034 wrote: | mantoo wrote: | compcache excluded in 2.6.27-rc3? wasnt able to find it... should be /drivers/block-devices, shouldn't it? |
It has been reverted in zen, it's broken, it was never in main line kernel if that's what you mean.
Quote: | and what is zen-tunable sysfs? wasn able to find anything on the net...
thx, mantoo |
zen-tune is only in zen, started as a basic way to set different settings (ie scheduler niceness, swappiness, etc) throughout the kernel's kconfig, rather than editing the files manually.
zen-sysfs, zen system layout is all written by rmh, using kernel kobjects/sysfs interface, it allows the options/tunables set to be read in files in /sys/kernel/zen. Some of them being writable meaning you can change the setting during runtime, without recompiling the kernel |
currently im using 2.6.27-rc3-zen1 kernel, running dtable for me. just wondered about compcache being mentioned some posts above but not finding anything related in my kernelconfig.
is it advantageous to load the module w/o planning to set those values manually. what i mean is this module used by the kernel itself?
thx |
In the latest git pull you will find it, i believe i have fixed it but it hasn't been tested yet. _________________ IRC!: #zen-sources on irc.rizon.net
zen-kernel.org
--
Lost in android development land. |
|
Back to top |
|
|
mantoo Tux's lil' helper
Joined: 08 Dec 2007 Posts: 98 Location: Germany
|
Posted: Tue Aug 19, 2008 8:37 am Post subject: |
|
|
cheater1034 wrote: | mantoo wrote: | cheater1034 wrote: | mantoo wrote: | compcache excluded in 2.6.27-rc3? wasnt able to find it... should be /drivers/block-devices, shouldn't it? |
It has been reverted in zen, it's broken, it was never in main line kernel if that's what you mean.
Quote: | and what is zen-tunable sysfs? wasn able to find anything on the net...
thx, mantoo |
zen-tune is only in zen, started as a basic way to set different settings (ie scheduler niceness, swappiness, etc) throughout the kernel's kconfig, rather than editing the files manually.
zen-sysfs, zen system layout is all written by rmh, using kernel kobjects/sysfs interface, it allows the options/tunables set to be read in files in /sys/kernel/zen. Some of them being writable meaning you can change the setting during runtime, without recompiling the kernel |
currently im using 2.6.27-rc3-zen1 kernel, running dtable for me. just wondered about compcache being mentioned some posts above but not finding anything related in my kernelconfig.
is it advantageous to load the module w/o planning to set those values manually. what i mean is this module used by the kernel itself?
thx |
In the latest git pull you will find it, i believe i have fixed it but it hasn't been tested yet. |
ok, thx, found it and im using it since about 3 hrs without noticing any probs... after the latest emerges im currently running im gonna try to test some memory-intensive progs to force using of swap while recompiling some stuff... what i noticed in dmesg: Quote: | compcache: compcache size not provided. Using default: (25% of Total RAM).
Use compcache_size_kbytes module param to specify custom size
compcache: Compressed swap size set to: 518860 KB
TLSF: pool: f8dbc000, init_size=16384, max_size=0, grow_size=16384 |
but top still giving that info: Quote: | Mem: 2075440k total, 966048k used, 1109392k free, 52740k buffers
Swap: 1004052k total, 0k used, 1004052k free, 418040k cached |
so although compcache set my swap to 512 mb top still says there's 1 gig of swap. doesn't top yet "see" compcache? as far as i understood compcache is replacing the physical swap and putting it to ram compressed. but by replacing the "swap" the swapsize should be reduced by the half.... ?!?
another thing i noticed through conky always running is that every time i started up my box there was a usage of about 600 - 700 kb of my swap by default... since compcache conky saying 0 kb...is it due to conky not being able to read the size of swap in compressed state used out of the ram or am i mixing up 2 completely different things?
did i maybe miss to disable my physical swap(partition)?
EDIT:
i pumped up the usage of my mem by running nearly every single program with gui i found on my system with at the end opening up some images im gimp and upscaling to 1000%; that way i foced a usage of Quote: | Mem: 2075440k total, 2019940k used, 55500k free,
Swap: 1004052k total, 27388k used, 976664k free, |
the system ran stable but im not able to tell anything about speed increases yes... further testing is waiting...
so far, greetz,
mantoo
Last edited by mantoo on Tue Aug 19, 2008 10:23 am; edited 1 time in total |
|
Back to top |
|
|
Civil Retired Dev
Joined: 24 Feb 2006 Posts: 16 Location: Berlin
|
Posted: Tue Aug 19, 2008 10:17 am Post subject: |
|
|
Thanks for your hard work. Your patchset is great. But I'm wonder, if this patch will be ever included? (support for cpufreqd to change cpu speed on Celeron M 5xx via p4-clockmod) _________________ ‘Who controls the past controls the future: who controls the present controls the past.’
George Orwell ‘1984’ |
|
Back to top |
|
|
kernelOfTruth Watchman
Joined: 20 Dec 2005 Posts: 6111 Location: Vienna, Austria; Germany; hello world :)
|
|
Back to top |
|
|
kernelOfTruth Watchman
Joined: 20 Dec 2005 Posts: 6111 Location: Vienna, Austria; Germany; hello world :)
|
|
Back to top |
|
|
mantoo Tux's lil' helper
Joined: 08 Dec 2007 Posts: 98 Location: Germany
|
Posted: Tue Aug 19, 2008 2:12 pm Post subject: |
|
|
kernelOfTruth wrote: | @mantoo:
have you meanwhile restarted your box several times and noticed any BUGs / locks during shutting down ?
if no are you using reiser4 (at all) ?
last time I used it there was some kind of triggered BUG / problem with compcache, pdflush, kswapd and reiser4 afaik (on .26-zen*)
thanks |
didnt notice any locks or even probs... rockstable as mentioned in your next post
still im not using reiserfs4, because im still a bit afraid of it.... first i have to get a bit time at weekend and backup all my stuff, then maybe im gonna give it a try as its now known as more performant than most other fs's..
greez, mantoo |
|
Back to top |
|
|
kernelOfTruth Watchman
Joined: 20 Dec 2005 Posts: 6111 Location: Vienna, Austria; Germany; hello world :)
|
Posted: Tue Aug 19, 2008 2:22 pm Post subject: |
|
|
well - after the compress swap has filled it's crawling now
Quote: | free -m
total used free shared buffers cached
Mem: 3950 3915 35 0 9 510
-/+ buffers/cache: 3394 555
Swap: 3489 1088 2401 |
Quote: | cat /proc/swaps
Filename Type Size Used Priority
/dev/mapper/system-swap partition 2562328 103080 -1
/dev/ramzswap0 partition 1011304 1011304 1 |
didn't know that googleearth eats THAT much ram
after closing most of the apps: (sorry didn't think of looking at it during peak load)
Quote: | cat /proc/compcache
DiskSize: 1011308 kB
NumReads: 244632
NumWrites: 249109
FailedReads: 0
FailedWrites: 0
InvalidIO: 0
GoodCompress: 93 %
NoCompress: 0 %
CurrentPages: 246354
CurrentMem: 255056 kB
PeakMem: 255056 kB |
conclusion:
if you're having much of ram & critical work loads, ensure that the compressed swap in ram isn't too small & you'll never have to run swap on harddisks in case you're running lots of apps / apps that need much ram -> that way you'll get pretty nice performance _________________ https://github.com/kernelOfTruth/ZFS-for-SystemRescueCD/tree/ZFS-for-SysRescCD-4.9.0
https://github.com/kernelOfTruth/pulseaudio-equalizer-ladspa
Hardcore Gentoo Linux user since 2004
Last edited by kernelOfTruth on Tue Aug 19, 2008 2:45 pm; edited 2 times in total |
|
Back to top |
|
|
cheater1034 Veteran
Joined: 09 Sep 2004 Posts: 1558
|
Posted: Tue Aug 19, 2008 2:23 pm Post subject: |
|
|
Civil wrote: | Thanks for your hard work. Your patchset is great. But I'm wonder, if this patch will be ever included? (support for cpufreqd to change cpu speed on Celeron M 5xx via p4-clockmod) |
Patch is in latest pull. _________________ IRC!: #zen-sources on irc.rizon.net
zen-kernel.org
--
Lost in android development land. |
|
Back to top |
|
|
|