View previous topic :: View next topic |
Author |
Message |
sobers_2002 Veteran
Joined: 16 Mar 2004 Posts: 1128
|
Posted: Fri Feb 02, 2007 9:40 am Post subject: multithread downloader with http, ftp, sftp support [SOLVED] |
|
|
Hi,
Is there any client which can do all three ?? MultiGet does http and ftp but not sftp.
Kindly pour in suggestions.
thanks
Saurabh
PS: - It's cool even if the package is currently not in portage _________________ Pdict - dockable dictionary client for linux
FREE97WIN: Use this code on Dreamhost and you get $97 off !!
Last edited by sobers_2002 on Sat Feb 03, 2007 9:19 pm; edited 1 time in total |
|
Back to top |
|
|
derverstand Guru
Joined: 15 Dec 2005 Posts: 511 Location: /dev/null
|
Posted: Fri Feb 02, 2007 6:48 pm Post subject: |
|
|
hi.
i do this with small bash scripts...
/br |
|
Back to top |
|
|
Dralnu Veteran
Joined: 24 May 2006 Posts: 1919
|
Posted: Fri Feb 02, 2007 8:29 pm Post subject: |
|
|
I know you can do it with Ruby. Bash could probably do it, or maybe, hey, use wget _________________ The day Microsoft makes a product that doesn't suck, is the day they make a vacuum cleaner. |
|
Back to top |
|
|
think4urs11 Bodhisattva
Joined: 25 Jun 2003 Posts: 6659 Location: above the cloud
|
Posted: Fri Feb 02, 2007 9:12 pm Post subject: |
|
|
cURL / libcurl (libcurl supports downloading multiple URLs simultaneously, curl doesn't) _________________ Nothing is secure / Security is always a trade-off with usability / Do not assume anything / Trust no-one, nothing / Paranoia is your friend / Think for yourself |
|
Back to top |
|
|
derverstand Guru
Joined: 15 Dec 2005 Posts: 511 Location: /dev/null
|
Posted: Sat Feb 03, 2007 12:16 am Post subject: |
|
|
More concrete. My hack scripts look somehow like this:
Code: |
for file in abc def ...; do
wget -p --convert-links $file &
sleep 1 # if its goin too fast ;)
done
|
/BR |
|
Back to top |
|
|
Dralnu Veteran
Joined: 24 May 2006 Posts: 1919
|
Posted: Sat Feb 03, 2007 6:49 am Post subject: |
|
|
Think4UrS11 wrote: | cURL / libcurl (libcurl supports downloading multiple URLs simultaneously, curl doesn't) | OT: Who is the chick in the av? _________________ The day Microsoft makes a product that doesn't suck, is the day they make a vacuum cleaner. |
|
Back to top |
|
|
sobers_2002 Veteran
Joined: 16 Mar 2004 Posts: 1128
|
Posted: Sat Feb 03, 2007 7:00 am Post subject: |
|
|
thanks a lot for the options people, but I needed something that could do sftp also.
I don't know about curl, but wget can't do sftp.
thanks!
Saurabh _________________ Pdict - dockable dictionary client for linux
FREE97WIN: Use this code on Dreamhost and you get $97 off !! |
|
Back to top |
|
|
think4urs11 Bodhisattva
Joined: 25 Jun 2003 Posts: 6659 Location: above the cloud
|
Posted: Sat Feb 03, 2007 9:12 am Post subject: |
|
|
http://curl.haxx.se/ wrote: | cURL supports FTP, FTPS, HTTP, HTTPS, SCP, SFTP, TFTP, TELNET, DICT, FILE and LDAP. curl supports SSL certificates, HTTP POST, HTTP PUT, FTP uploading, HTTP form based upload, proxies, cookies, user+password authentication (Basic, Digest, NTLM, Negotiate, kerberos...), file transfer resume, proxy tunneling |
_________________ Nothing is secure / Security is always a trade-off with usability / Do not assume anything / Trust no-one, nothing / Paranoia is your friend / Think for yourself |
|
Back to top |
|
|
sobers_2002 Veteran
Joined: 16 Mar 2004 Posts: 1128
|
|
Back to top |
|
|
|