| View previous topic :: View next topic |
| Author |
Message |
cal22cal
n00b
Joined: 19 Jan 2006
Posts: 36
|
 Posted: Sun Feb 21, 2010 2:31 am Post subject: |
 |
|
ExZombie
Thx. for your info. and details. 
stobbsm
md5deep will doing the md5 sum creation and checking as md5sum does
but it gives more options.
-r will do the md5 for sub-directories. So, we don't need the "find ... bla bla bla" in command line.
-X will cal the md5 for files without md5 entry according to the checksum file, somethings like that.
|
|
| Back to top |
|
 |
ExZombie
Apprentice
Joined: 29 May 2004
Posts: 170
|
| Posted: Sun Feb 21, 2010 9:06 am Post subject: |
|
|
| stobbsm: Thanks, I checked OpenBSD's man pages, and fixed this. If the recursive make call is the only problem, I consider OpenBSD supported. I'll check back when the 0.4 ebuild gets into sunrise. |
|
| Back to top |
|
|
stobbsm
Guru
Joined: 23 May 2004
Posts: 452
|
| Posted: Sun Feb 21, 2010 9:39 pm Post subject: |
|
|
can I have the patch to fix it in openbsd, just to ensure that it works correctly?
Better safe then sorry!
_________________
Sysadmin of Ubuntu systems and servers....
Although my own server is gentoo.... |
|
| Back to top |
|
|
ExZombie
Apprentice
Joined: 29 May 2004
Posts: 170
|
| Posted: Mon Feb 22, 2010 8:21 am Post subject: |
|
|
| Sure, just do 'git pull' in the prll directory. |
|
| Back to top |
|
|
stobbsm
Guru
Joined: 23 May 2004
Posts: 452
|
| Posted: Mon Feb 22, 2010 6:03 pm Post subject: |
|
|
make clean is not having the same problem in OpenBSD.
Here's a patch for you:
| Code: |
--- Makefile Mon Feb 22 03:57:08 2010
+++ Makefile.new Mon Feb 22 03:56:55 2010
@@ -7,7 +7,7 @@
clean:
rm -f sanitycheck check_key_size prll_jobserver
- $(MAKE) -C tests clean
+ cd tests && $(MAKE) clean
sanitycheck: check_key_size
./check_key_size && touch sanitycheck || (rm -f sanitycheck && false)
|
_________________
Sysadmin of Ubuntu systems and servers....
Although my own server is gentoo.... |
|
| Back to top |
|
|
ExZombie
Apprentice
Joined: 29 May 2004
Posts: 170
|
| Posted: Tue Feb 23, 2010 10:45 am Post subject: |
|
|
Version 0.4 is in sunrise. Thanks for help, everyone! All contributions are duly noted in the docs.
stobbsm: yeah, I forgot about the clean target, so this fix is not in 0.4, but it's not a showstopper. |
|
| Back to top |
|
|
ExZombie
Apprentice
Joined: 29 May 2004
Posts: 170
|
| Posted: Sun Apr 18, 2010 8:41 pm Post subject: |
|
|
Hello again!
I'm preparing to release version 0.5 of prll. The biggest news are full output buffering with synchronisation (solving a number of issues with output) and ability to interrupt prll from within a function (making possible e.g. ad-hoc parallel search which aborts on success).
As is usual, I'd like to hear of any problems running prll. You are welcome to clone the git repo, or you may use this ebuild. Anyone who can test prll on any kind of Unix, please do  . If you have ideas on how to improve prll further, I'll be glad to read your comments.
I also have a more specific question: is the README clear enough? Does it provide enough documentation?
Thanks! |
|
| Back to top |
|
|
cruzki123
Apprentice
Joined: 16 May 2008
Posts: 262
|
| Posted: Mon Apr 19, 2010 12:26 am Post subject: |
|
|
I'm ussing prll and think that the documentations is fine BUT is dificult to acces to them. I mind, you need to download and open de readme because some things aren't on the web documentation.
The rest is fine. Good job and thaks for the hard work. |
|
| Back to top |
|
|
ExZombie
Apprentice
Joined: 29 May 2004
Posts: 170
|
| Posted: Thu Apr 22, 2010 6:54 am Post subject: |
|
|
| cruzki123 wrote: | I'm ussing prll and think that the documentations is fine BUT is dificult to acces to them. I mind, you need to download and open de readme because some things aren't on the web documentation.
The rest is fine. Good job and thaks for the hard work. |
Sorry for taking this long to respond.
It is a good idea to link directly to the current version of the README from the web page, I will do it. However, I'm not sure I understood you correctly. If you installed prll from portage, the readme gets installed into /usr/share/doc, as with every other package. There is no need to go look for it on the web.
I did think about writing a man page, but roff is a bit... well... rough  . |
|
| Back to top |
|
|
yzg
Guru
Joined: 18 Jun 2005
Posts: 497
|
| Posted: Thu Apr 22, 2010 9:05 am Post subject: |
|
|
ExZombie thanks for the new command.
What is the difference between using the command and make -j n?
An example of Makefile to convert .vob files to .avi files.
| Code: |
.SUFFIXES: .vob .avi .log
files= $(shell ls *.vob)
all: ${files:.vob=.avi}
.vob.log:
mencoder $*.vob -quiet -passlogfile $*.log -ovc xvid -xvidencopts pass=1 -oac copy -o /dev/null
.log.avi:
mencoder $*.vob -quiet -passlogfile $*.log -ovc xvid -xvidencopts pass=2:bitrate=1200 -oac copy -o $*.avi
|
Then you run
And you get all the make features for free. |
|
| Back to top |
|
|
stobbsm
Guru
Joined: 23 May 2004
Posts: 452
|
| Posted: Thu Apr 22, 2010 12:51 pm Post subject: |
|
|
With prll, you don't need to go through the hassle of writing and moving around a makefile. Simplification at it's finest here.
_________________
Sysadmin of Ubuntu systems and servers....
Although my own server is gentoo.... |
|
| Back to top |
|
|
ExZombie
Apprentice
Joined: 29 May 2004
Posts: 170
|
| Posted: Tue Apr 27, 2010 12:09 pm Post subject: |
|
|
| Alright, version 0.5 is out. The ebuild for the impatient is here, although I'm sure the maintainer will catch up soon. |
|
| Back to top |
|
|
stobbsm
Guru
Joined: 23 May 2004
Posts: 452
|
| Posted: Tue Apr 27, 2010 8:13 pm Post subject: |
|
|
I know it's not the best spot for it, but I've recently started administrating a lot of remote systems, consisting of Ubuntu Server/Desktop.
I've created a .deb for Ubuntu of prll-0.5
May expand the user-base if you have a package for people to try.
Would you like it uploaded so you can link on your homepage?
_________________
Sysadmin of Ubuntu systems and servers....
Although my own server is gentoo.... |
|
| Back to top |
|
|
dE_logics
Advocate
Joined: 02 Jan 2009
Posts: 2253
Location: $TERM
|
| Posted: Thu Apr 29, 2010 3:36 am Post subject: |
|
|
hummm....very very interesting...
_________________
My blog |
|
| Back to top |
|
|
ExZombie
Apprentice
Joined: 29 May 2004
Posts: 170
|
| Posted: Thu Apr 29, 2010 10:05 am Post subject: |
|
|
| stobbsm: Sure, I'd love that. If you want to be credited by name instead of your nickname, send me a PM with your name and email address. |
|
| Back to top |
|
|
dE_logics
Advocate
Joined: 02 Jan 2009
Posts: 2253
Location: $TERM
|
| Posted: Thu Apr 29, 2010 11:19 am Post subject: |
|
|
But how do you use it man?? 
| Code: | bash-4.0$ pwd
/usr/bin
bash-4.0$ ls|grep prll
prll_jobserver |
_________________
My blog |
|
| Back to top |
|
|
ExZombie
Apprentice
Joined: 29 May 2004
Posts: 170
|
| Posted: Thu Apr 29, 2010 2:35 pm Post subject: |
|
|
| Well, if you're in a login shell, type 'prll' and it will give you short usage info. Further information is in /usr/share/doc/prll-VERSION/README.bz2. It includes several examples. However, I recommend that you get the latest version which is not yet in portage, since I have put a lot of effort into making the README clearer. |
|
| Back to top |
|
|
dE_logics
Advocate
Joined: 02 Jan 2009
Posts: 2253
Location: $TERM
|
| Posted: Mon May 03, 2010 2:20 am Post subject: |
|
|
What if I'm not in the login shell?
_________________
My blog |
|
| Back to top |
|
|
stobbsm
Guru
Joined: 23 May 2004
Posts: 452
|
| Posted: Mon May 03, 2010 3:13 am Post subject: |
|
|
As long as your in an interactive shell (xterm or the like) you can source prll.sh and get it working.
I can't remember where it get's installed in the ebuild, but just run the command
| Code: | | source /path/to/prll.sh |
Then your good to go!
To run a command with it, use
| Code: | | prll -s 'command "$1"' <argument list> |
Example: unarchive all tarballs in a given directory | Code: | | prll -s 'tar -axvf "$1"' /path/to/tarballs/* |
_________________
Sysadmin of Ubuntu systems and servers....
Although my own server is gentoo.... |
|
| Back to top |
|
|
ExZombie
Apprentice
Joined: 29 May 2004
Posts: 170
|
| Posted: Thu May 05, 2011 7:49 am Post subject: |
|
|
Hello!
It's been a long time, but I'm finally getting to releasing version 0.6  . It took a while not just because of lack of time, but mostly because I was hunting an elusive race condition which was not my fault at all.
Here's the changelog:
- POSIX compatibility, tested with dash and FreeBSD sh.
- Quiet mode to suppress progress messages.
- bash no longer barfs the whole prll source code when suspending
and resuming operation.
- Proper option parsing is used, so order of options is no longer
important. Exceptions were added for the '-p' and '-0' options
to maintain backwards compatibility.
- Improved performance when reading from pipe, although it is
still recommended to put large amounts of data in files.
- Better error reporting from helper programs.
- Better handling of the INT signal.
- More reliable cleanup.
Again, I invite you to test prll on as many platforms as possible. For gentoo, here is a live ebuild. For the rest, here is the git repo. Apart from running "make test", I would be grateful if you tested it in exceptional circumstances, i.e. what happens when you terminate it or suspend and resume it, whether jobs complete correctly and whether ipcs are cleaned up properly.
Thanks! |
|
| Back to top |
|
|
ExZombie
Apprentice
Joined: 29 May 2004
Posts: 170
|
| Posted: Sun May 08, 2011 5:53 am Post subject: |
|
|
| Here's a new version of the live ebuild. There have been slight changes to the build system and most importantly, I wrote a man page . It took me a while to find a reasonable tool to make it . |
|
| Back to top |
|
|
ExZombie
Apprentice
Joined: 29 May 2004
Posts: 170
|
| Posted: Wed May 18, 2011 3:44 pm Post subject: |
|
|
| Version 0.6 is out, and here's an ebuild. |
|
| Back to top |
|
|
npaust
n00b
Joined: 23 Apr 2004
Posts: 70
Location: Walla Walla, WA
|
| Posted: Mon Oct 03, 2011 6:43 pm Post subject: |
|
|
| So, prll looks like EXACTLY what I'm looking for. I have a workflow though that doesn't involve changing a bunch of files in one directory. Instead, I want to have a long shell script listing (potentially hundreds of) jobs and have prll just dole them out to the processors. Is there some simple way to make it read the individual jobs from a file rather than using wildcards on the command line? |
|
| Back to top |
|
|
ExZombie
Apprentice
Joined: 29 May 2004
Posts: 170
|
| Posted: Tue Oct 04, 2011 6:36 am Post subject: |
|
|
Sure, use the '-p' or '-0' option and pipe the file to prll's standard input. From the manpage:
| Code: | | cat file_with_arguments | prll myfunction -p > results |
|
|
| Back to top |
|
|
nixnut
Bodhisattva
Joined: 09 Apr 2004
Posts: 10974
Location: the dutch mountains
|
| Posted: Sun Oct 23, 2011 8:00 am Post subject: |
|
|
Moved from Unsupported Software to Other Things Gentoo.
_________________
Please add [solved] to the initial post's subject line if you feel your problem is resolved. Help answer the unanswered
talk is cheap. supply exceeds demand |
|
| Back to top |
|
|
|
Other Things Gentoo
