View previous topic :: View next topic |
Author |
Message |
falso n00b
Joined: 22 Feb 2003 Posts: 40 Location: Caparica, Portugal
|
Posted: Wed Sep 29, 2004 9:10 pm Post subject: Best filesystem for big files? |
|
|
Hello sirs,
Can anyone recomend me a fast and stable filesystem for mainly for storing big files?
Im going to buy a new hard disk and im going to do a 200gb partition on it and dont know which filesystem i should use.
In big files i mean 700 mb or bigger files.
Regards, _________________ I don't intend to offend, I offend with my intent
Last edited by falso on Wed Sep 29, 2004 9:21 pm; edited 1 time in total |
|
Back to top |
|
|
Deranger Veteran
Joined: 26 Aug 2004 Posts: 1215
|
Posted: Wed Sep 29, 2004 9:13 pm Post subject: |
|
|
I'm using ext3 for storage and Reiser4 for system. But I'm thinking to move 100% Reiser4 user (except /boot)
Last edited by Deranger on Wed Sep 29, 2004 9:32 pm; edited 5 times in total |
|
Back to top |
|
|
codergeek42 Bodhisattva
Joined: 05 Apr 2004 Posts: 5142 Location: Anaheim, CA (USA)
|
Posted: Wed Sep 29, 2004 9:14 pm Post subject: |
|
|
For really big files I would recommend XFS. However, I am recommending this objectively, as discussing warez/illegal material should not be done on these forums. _________________ ~~ Peter: Programmer, Mathematician, STEM & Free Software Advocate, Enlightened Agent, Transhumanist, Fedora contributor
Who am I? :: EFF & FSF |
|
Back to top |
|
|
pablo_supertux Advocate
Joined: 25 Jan 2004 Posts: 2935 Location: Somewhere between reality and Middle-Earth and in Freiburg (Germany)
|
Posted: Wed Sep 29, 2004 9:15 pm Post subject: |
|
|
Quote: | from: https://forums.gentoo.org/profile.php?mode=register
You agree not to post any abusive, obscene, vulgar, slanderous, hateful, threatening, sexually-oriented or any other material that may violate any applicable laws. Doing so may lead to you being immediately and permanently banned (and your service provider being informed). The IP address of all posts is recorded to aid in enforcing these conditions.
|
Have you read this?
Quote: |
I know that isnt like the best place to ask this, but its the only one i think ill have an answer.
|
You're right, this is not the best place for asking about such things, well about the filesystem for warez. _________________ A! Elbereth Gilthoniel!
silivren penna míriel
o menel aglar elenath,
Gilthoniel, A! Elbereth! |
|
Back to top |
|
|
falso n00b
Joined: 22 Feb 2003 Posts: 40 Location: Caparica, Portugal
|
Posted: Wed Sep 29, 2004 9:16 pm Post subject: |
|
|
Im thinking about reiser4 too, mainly becase all ive been reading about it sounds good, but i dont know if its stable enough to keep such big files. _________________ I don't intend to offend, I offend with my intent |
|
Back to top |
|
|
codergeek42 Bodhisattva
Joined: 05 Apr 2004 Posts: 5142 Location: Anaheim, CA (USA)
|
Posted: Wed Sep 29, 2004 9:17 pm Post subject: |
|
|
<deleted> _________________ ~~ Peter: Programmer, Mathematician, STEM & Free Software Advocate, Enlightened Agent, Transhumanist, Fedora contributor
Who am I? :: EFF & FSF
Last edited by codergeek42 on Wed Sep 29, 2004 9:24 pm; edited 1 time in total |
|
Back to top |
|
|
falso n00b
Joined: 22 Feb 2003 Posts: 40 Location: Caparica, Portugal
|
Posted: Wed Sep 29, 2004 9:22 pm Post subject: |
|
|
I edited the post a bit, sorry if i did something wrong. if you want you guys can delete it then. _________________ I don't intend to offend, I offend with my intent |
|
Back to top |
|
|
abacker n00b
Joined: 28 Sep 2004 Posts: 74
|
Posted: Wed Sep 29, 2004 10:49 pm Post subject: Very interested |
|
|
Whats with you ppl and warez, dammit. I was really interested in knowing which was the best.
You see, and this is a legit use, I user VMWare to run windows for work (its the tools!) , and those files go way over 700mb. Usually in the 5-7gb range just to be safe.
Now that *I* have a legit use, which one is the best?
- Andrew Backer _________________ under the line |
|
Back to top |
|
|
codergeek42 Bodhisattva
Joined: 05 Apr 2004 Posts: 5142 Location: Anaheim, CA (USA)
|
Posted: Thu Sep 30, 2004 12:37 am Post subject: Re: Very interested |
|
|
abacker wrote: | Whats with you ppl and warez, dammit. | If we discuss 'warez' and other illegal/illicit activities, then that means sooner or later, Gentoo as a distro and team of users/developers is going to get in a lot of trouble, which would be a Very Bad Thing(tm).
Gentoo Forums Guidelines (READ BEFORE POSTING) wrote: | Illegal activites - Please do not discuss illegal activities, such as cracking software, breaking into web sites, etc. on these forums. While such activities might not be illegal in all countries, this server is hosted in the US and, as such, must abide by US laws. By allowing discussions about illegal activities to take place on these forums, we may expose the Gentoo project to unnecessary legal liability. Therefore, any posts that advocate activities that are illegal under US laws may be deleted without notice. |
I would suggesting speaking with the mods or admins if you have questions or trouble complying with this.
Quote: | I was really interested in knowing which was the best. You see, and this is a legit use, I user VMWare to run windows for work (its the tools!) , and those files go way over 700mb. Usually in the 5-7gb range just to be safe.
Now that *I* have a legit use, which one is the best?
| Now that we are discussing legitimate uses for this filesystem, I will happily say that, imo, XFS is excellent at handling very large files. _________________ ~~ Peter: Programmer, Mathematician, STEM & Free Software Advocate, Enlightened Agent, Transhumanist, Fedora contributor
Who am I? :: EFF & FSF |
|
Back to top |
|
|
falso n00b
Joined: 22 Feb 2003 Posts: 40 Location: Caparica, Portugal
|
Posted: Thu Sep 30, 2004 10:25 am Post subject: |
|
|
So i think im going to do a XFS partition cause, it looks good for big files, i was thinking about reiserfs4 but if xfs is better for this, and is better tested i think im gonna stick with it then
Thanks for the replys. _________________ I don't intend to offend, I offend with my intent |
|
Back to top |
|
|
falso n00b
Joined: 22 Feb 2003 Posts: 40 Location: Caparica, Portugal
|
Posted: Thu Sep 30, 2004 10:34 am Post subject: |
|
|
By the way, which brand of hard disk you recomend? i want a 200gb IDE, the options are Seagate, Maxstore and Western Digital. _________________ I don't intend to offend, I offend with my intent |
|
Back to top |
|
|
gnuageux Veteran
Joined: 17 Apr 2004 Posts: 1201
|
Posted: Thu Sep 30, 2004 10:38 am Post subject: |
|
|
Hmmm, if each file that youre working with is 5-7G and your hdd is 200GB youre going to run out of space purty quick. _________________ The realOTW: http://forums.realotw.org/index.php
Registered Linux user#364538 |
|
Back to top |
|
|
Deranger Veteran
Joined: 26 Aug 2004 Posts: 1215
|
Posted: Thu Sep 30, 2004 10:38 am Post subject: |
|
|
I have 5 x Maxtor DiamondMax Plus 9 drives in my Linux box and one in Windows box (my parents computer). Western Digital is good too. I don't have any experience with Seagate so hard to say.
By the way, gnuageux, falso didn't said anything about 5-7 GB files, abacker did
Last edited by Deranger on Thu Sep 30, 2004 10:48 am; edited 3 times in total |
|
Back to top |
|
|
gnuageux Veteran
Joined: 17 Apr 2004 Posts: 1201
|
Posted: Thu Sep 30, 2004 10:41 am Post subject: |
|
|
Ive never had a problem with any of my Western Digital disks _________________ The realOTW: http://forums.realotw.org/index.php
Registered Linux user#364538 |
|
Back to top |
|
|
asph l33t
Joined: 25 Aug 2003 Posts: 741 Location: Barcelona, Spain
|
Posted: Thu Sep 30, 2004 10:46 am Post subject: |
|
|
reiserfs4, just do some reading and take a look at some benchmarks and you will see _________________ gentoo sex is updatedb; locate; talk; date; cd; strip; look; touch; finger; unzip; uptime; gawk; head; emerge --oneshot condom; mount; fsck; gasp; more; yes; yes; yes; more; umount; emerge -C condom; make clean; sleep
Last edited by asph on Thu Sep 30, 2004 3:59 pm; edited 1 time in total |
|
Back to top |
|
|
Fix-85 n00b
Joined: 10 Aug 2004 Posts: 22
|
Posted: Thu Sep 30, 2004 1:23 pm Post subject: |
|
|
Um, I don't see the point when talking about big filesizes it must automatically mean warez.
I believe some people exaggerate quite a bit when it comes to stuff like this.
I don't think this thread is illegal by law (even by american law ^^). |
|
Back to top |
|
|
amiatrome Apprentice
Joined: 28 Jun 2004 Posts: 180 Location: Campus | Arena Country Club | Home
|
Posted: Thu Sep 30, 2004 1:50 pm Post subject: |
|
|
Fix-85 wrote: | Um, I don't see the point when talking about big filesizes it must automatically mean warez.
I believe some people exaggerate quite a bit when it comes to stuff like this.
I don't think this thread is illegal by law (even by american law ^^). |
I didn't see the first post but I guess the thread starter must have mentioned warez. The first few replies must have cautioned him and he edited the post to comply with forum rules.
I am also very interested in knowing which FS is best. I have been using good old ext3 up till now. I agree Western Digital is generally very good. For those of you who want to find out which HDD is best for you, go to StorageReview.com. They have large-scale reliability and performance survey taken by users. Definitely something to look at if you want to buy a HDD. _________________ blog | homepage | alias | prompts |
|
Back to top |
|
|
Daganoth Apprentice
Joined: 12 Jun 2002 Posts: 194 Location: Greensboro, NC
|
Posted: Mon Oct 04, 2004 2:14 am Post subject: |
|
|
amiatrome wrote: | Fix-85 wrote: | Um, I don't see the point when talking about big filesizes it must automatically mean warez.
I believe some people exaggerate quite a bit when it comes to stuff like this.
I don't think this thread is illegal by law (even by american law ^^). |
I didn't see the first post but I guess the thread starter must have mentioned warez. The first few replies must have cautioned him and he edited the post to comply with forum rules.
I am also very interested in knowing which FS is best. I have been using good old ext3 up till now. I agree Western Digital is generally very good. For those of you who want to find out which HDD is best for you, go to StorageReview.com. They have large-scale reliability and performance survey taken by users. Definitely something to look at if you want to buy a HDD. |
Here's a quick synopsis of what file systems are good for what, at least as I understand them:
ext2 - Stable, Low CPU Load
ext3 - Same as above.
resier - Good for small files (Configs, small docs) Average all around. High CPU load. Stable.
xfs - Good for larger files. Stable-ish. Corruption issues when not properly unmounted.
resier4 - Pretty much kicks ass. Not ultra-stable yet, but good enough.
If this is only for storage of large files that you can bear to lose, XFS or Reiser4, else, stick with Resier or Ext3. |
|
Back to top |
|
|
Deranger Veteran
Joined: 26 Aug 2004 Posts: 1215
|
Posted: Mon Oct 04, 2004 5:50 am Post subject: |
|
|
I've gone insane, I'm moving all my ext-3 partitions to Reiser4! (almost one terabyte)
Reiser4 really pwnz j00!
And it's stable enough. |
|
Back to top |
|
|
moocha Watchman
Joined: 21 Oct 2003 Posts: 5722
|
Posted: Mon Oct 04, 2004 9:39 am Post subject: |
|
|
For large files go with the original XFS patchset from SGI on a 2.4.20 kernel (make sure to patch for the evil ptrace & co vulnerabilities). There's no question about it. I've got years of experience in large scale system administration behind me and have yet to see data loss due to XFS (and not due to careless rm and the like).
Get the necessary patches from http://oss.sgi.com/projects/xfs/patchlist.html _________________ Military Commissions Act of 2006: http://tinyurl.com/jrcto
"Those who would give up essential liberty to purchase a little temporary safety deserve neither liberty nor safety."
-- attributed to Benjamin Franklin |
|
Back to top |
|
|
|