Gentoo Forums
Gentoo Forums
Gentoo Forums
Quick Search: in
Best filesystem for big files?
View unanswered posts
View posts from last 24 hours

 
Reply to topic    Gentoo Forums Forum Index Other Things Gentoo
View previous topic :: View next topic  
Author Message
falso
n00b
n00b


Joined: 22 Feb 2003
Posts: 40
Location: Caparica, Portugal

PostPosted: Wed Sep 29, 2004 9:10 pm    Post subject: Best filesystem for big files? Reply with quote

Hello sirs,
Can anyone recomend me a fast and stable filesystem for mainly for storing big files?
Im going to buy a new hard disk and im going to do a 200gb partition on it and dont know which filesystem i should use.
In big files i mean 700 mb or bigger files.

Regards,
_________________
I don't intend to offend, I offend with my intent


Last edited by falso on Wed Sep 29, 2004 9:21 pm; edited 1 time in total
Back to top
View user's profile Send private message
Deranger
Veteran
Veteran


Joined: 26 Aug 2004
Posts: 1215

PostPosted: Wed Sep 29, 2004 9:13 pm    Post subject: Reply with quote

I'm using ext3 for storage and Reiser4 for system. But I'm thinking to move 100% Reiser4 user (except /boot)

Last edited by Deranger on Wed Sep 29, 2004 9:32 pm; edited 5 times in total
Back to top
View user's profile Send private message
codergeek42
Bodhisattva
Bodhisattva


Joined: 05 Apr 2004
Posts: 5142
Location: Anaheim, CA (USA)

PostPosted: Wed Sep 29, 2004 9:14 pm    Post subject: Reply with quote

For really big files I would recommend XFS. However, I am recommending this objectively, as discussing warez/illegal material should not be done on these forums.
_________________
~~ Peter: Programmer, Mathematician, STEM & Free Software Advocate, Enlightened Agent, Transhumanist, Fedora contributor
Who am I? :: EFF & FSF
Back to top
View user's profile Send private message
pablo_supertux
Advocate
Advocate


Joined: 25 Jan 2004
Posts: 2935
Location: Somewhere between reality and Middle-Earth and in Freiburg (Germany)

PostPosted: Wed Sep 29, 2004 9:15 pm    Post subject: Reply with quote

Quote:
from: https://forums.gentoo.org/profile.php?mode=register
You agree not to post any abusive, obscene, vulgar, slanderous, hateful, threatening, sexually-oriented or any other material that may violate any applicable laws. Doing so may lead to you being immediately and permanently banned (and your service provider being informed). The IP address of all posts is recorded to aid in enforcing these conditions.


Have you read this?

Quote:

I know that isnt like the best place to ask this, but its the only one i think ill have an answer.


You're right, this is not the best place for asking about such things, well about the filesystem for warez.
_________________
A! Elbereth Gilthoniel!
silivren penna míriel
o menel aglar elenath,
Gilthoniel, A! Elbereth!
Back to top
View user's profile Send private message
falso
n00b
n00b


Joined: 22 Feb 2003
Posts: 40
Location: Caparica, Portugal

PostPosted: Wed Sep 29, 2004 9:16 pm    Post subject: Reply with quote

Im thinking about reiser4 too, mainly becase all ive been reading about it sounds good, but i dont know if its stable enough to keep such big files.
_________________
I don't intend to offend, I offend with my intent
Back to top
View user's profile Send private message
codergeek42
Bodhisattva
Bodhisattva


Joined: 05 Apr 2004
Posts: 5142
Location: Anaheim, CA (USA)

PostPosted: Wed Sep 29, 2004 9:17 pm    Post subject: Reply with quote

<deleted>
_________________
~~ Peter: Programmer, Mathematician, STEM & Free Software Advocate, Enlightened Agent, Transhumanist, Fedora contributor
Who am I? :: EFF & FSF


Last edited by codergeek42 on Wed Sep 29, 2004 9:24 pm; edited 1 time in total
Back to top
View user's profile Send private message
falso
n00b
n00b


Joined: 22 Feb 2003
Posts: 40
Location: Caparica, Portugal

PostPosted: Wed Sep 29, 2004 9:22 pm    Post subject: Reply with quote

I edited the post a bit, sorry if i did something wrong. if you want you guys can delete it then.
_________________
I don't intend to offend, I offend with my intent
Back to top
View user's profile Send private message
abacker
n00b
n00b


Joined: 28 Sep 2004
Posts: 74

PostPosted: Wed Sep 29, 2004 10:49 pm    Post subject: Very interested Reply with quote

Whats with you ppl and warez, dammit. I was really interested in knowing which was the best.

You see, and this is a legit use, I user VMWare to run windows for work (its the tools!) , and those files go way over 700mb. Usually in the 5-7gb range just to be safe.

Now that *I* have a legit use, which one is the best?

- Andrew Backer
_________________
under the line
Back to top
View user's profile Send private message
codergeek42
Bodhisattva
Bodhisattva


Joined: 05 Apr 2004
Posts: 5142
Location: Anaheim, CA (USA)

PostPosted: Thu Sep 30, 2004 12:37 am    Post subject: Re: Very interested Reply with quote

abacker wrote:
Whats with you ppl and warez, dammit.
If we discuss 'warez' and other illegal/illicit activities, then that means sooner or later, Gentoo as a distro and team of users/developers is going to get in a lot of trouble, which would be a Very Bad Thing(tm).

Gentoo Forums Guidelines (READ BEFORE POSTING) wrote:
Illegal activites - Please do not discuss illegal activities, such as cracking software, breaking into web sites, etc. on these forums. While such activities might not be illegal in all countries, this server is hosted in the US and, as such, must abide by US laws. By allowing discussions about illegal activities to take place on these forums, we may expose the Gentoo project to unnecessary legal liability. Therefore, any posts that advocate activities that are illegal under US laws may be deleted without notice.

I would suggesting speaking with the mods or admins if you have questions or trouble complying with this. :)

Quote:
I was really interested in knowing which was the best. You see, and this is a legit use, I user VMWare to run windows for work (its the tools!) , and those files go way over 700mb. Usually in the 5-7gb range just to be safe.

Now that *I* have a legit use, which one is the best?
Now that we are discussing legitimate uses for this filesystem, I will happily say that, imo, XFS is excellent at handling very large files.
_________________
~~ Peter: Programmer, Mathematician, STEM & Free Software Advocate, Enlightened Agent, Transhumanist, Fedora contributor
Who am I? :: EFF & FSF
Back to top
View user's profile Send private message
falso
n00b
n00b


Joined: 22 Feb 2003
Posts: 40
Location: Caparica, Portugal

PostPosted: Thu Sep 30, 2004 10:25 am    Post subject: Reply with quote

So i think im going to do a XFS partition cause, it looks good for big files, i was thinking about reiserfs4 but if xfs is better for this, and is better tested i think im gonna stick with it then :D

Thanks for the replys.
_________________
I don't intend to offend, I offend with my intent
Back to top
View user's profile Send private message
falso
n00b
n00b


Joined: 22 Feb 2003
Posts: 40
Location: Caparica, Portugal

PostPosted: Thu Sep 30, 2004 10:34 am    Post subject: Reply with quote

By the way, which brand of hard disk you recomend? i want a 200gb IDE, the options are Seagate, Maxstore and Western Digital.
_________________
I don't intend to offend, I offend with my intent
Back to top
View user's profile Send private message
gnuageux
Veteran
Veteran


Joined: 17 Apr 2004
Posts: 1201

PostPosted: Thu Sep 30, 2004 10:38 am    Post subject: Reply with quote

Hmmm, if each file that youre working with is 5-7G and your hdd is 200GB youre going to run out of space purty quick. :)
_________________
The realOTW: http://forums.realotw.org/index.php

Registered Linux user#364538
Back to top
View user's profile Send private message
Deranger
Veteran
Veteran


Joined: 26 Aug 2004
Posts: 1215

PostPosted: Thu Sep 30, 2004 10:38 am    Post subject: Reply with quote

I have 5 x Maxtor DiamondMax Plus 9 drives in my Linux box and one in Windows box (my parents computer). Western Digital is good too. I don't have any experience with Seagate so hard to say.

By the way, gnuageux, falso didn't said anything about 5-7 GB files, abacker did :)


Last edited by Deranger on Thu Sep 30, 2004 10:48 am; edited 3 times in total
Back to top
View user's profile Send private message
gnuageux
Veteran
Veteran


Joined: 17 Apr 2004
Posts: 1201

PostPosted: Thu Sep 30, 2004 10:41 am    Post subject: Reply with quote

Ive never had a problem with any of my Western Digital disks
_________________
The realOTW: http://forums.realotw.org/index.php

Registered Linux user#364538
Back to top
View user's profile Send private message
asph
l33t
l33t


Joined: 25 Aug 2003
Posts: 741
Location: Barcelona, Spain

PostPosted: Thu Sep 30, 2004 10:46 am    Post subject: Reply with quote

reiserfs4, just do some reading and take a look at some benchmarks and you will see
_________________
gentoo sex is updatedb; locate; talk; date; cd; strip; look; touch; finger; unzip; uptime; gawk; head; emerge --oneshot condom; mount; fsck; gasp; more; yes; yes; yes; more; umount; emerge -C condom; make clean; sleep


Last edited by asph on Thu Sep 30, 2004 3:59 pm; edited 1 time in total
Back to top
View user's profile Send private message
Fix-85
n00b
n00b


Joined: 10 Aug 2004
Posts: 22

PostPosted: Thu Sep 30, 2004 1:23 pm    Post subject: Reply with quote

Um, I don't see the point when talking about big filesizes it must automatically mean warez.

I believe some people exaggerate quite a bit when it comes to stuff like this.

I don't think this thread is illegal by law (even by american law ^^).
Back to top
View user's profile Send private message
amiatrome
Apprentice
Apprentice


Joined: 28 Jun 2004
Posts: 180
Location: Campus | Arena Country Club | Home

PostPosted: Thu Sep 30, 2004 1:50 pm    Post subject: Reply with quote

Fix-85 wrote:
Um, I don't see the point when talking about big filesizes it must automatically mean warez.

I believe some people exaggerate quite a bit when it comes to stuff like this.

I don't think this thread is illegal by law (even by american law ^^).


I didn't see the first post but I guess the thread starter must have mentioned warez. The first few replies must have cautioned him and he edited the post to comply with forum rules.

I am also very interested in knowing which FS is best. I have been using good old ext3 up till now. I agree Western Digital is generally very good. For those of you who want to find out which HDD is best for you, go to StorageReview.com. They have large-scale reliability and performance survey taken by users. Definitely something to look at if you want to buy a HDD.
_________________
blog | homepage | alias | prompts
Back to top
View user's profile Send private message
Daganoth
Apprentice
Apprentice


Joined: 12 Jun 2002
Posts: 194
Location: Greensboro, NC

PostPosted: Mon Oct 04, 2004 2:14 am    Post subject: Reply with quote

amiatrome wrote:
Fix-85 wrote:
Um, I don't see the point when talking about big filesizes it must automatically mean warez.

I believe some people exaggerate quite a bit when it comes to stuff like this.

I don't think this thread is illegal by law (even by american law ^^).


I didn't see the first post but I guess the thread starter must have mentioned warez. The first few replies must have cautioned him and he edited the post to comply with forum rules.

I am also very interested in knowing which FS is best. I have been using good old ext3 up till now. I agree Western Digital is generally very good. For those of you who want to find out which HDD is best for you, go to StorageReview.com. They have large-scale reliability and performance survey taken by users. Definitely something to look at if you want to buy a HDD.


Here's a quick synopsis of what file systems are good for what, at least as I understand them:

ext2 - Stable, Low CPU Load
ext3 - Same as above.
resier - Good for small files (Configs, small docs) Average all around. High CPU load. Stable.
xfs - Good for larger files. Stable-ish. Corruption issues when not properly unmounted.
resier4 - Pretty much kicks ass. Not ultra-stable yet, but good enough.

If this is only for storage of large files that you can bear to lose, XFS or Reiser4, else, stick with Resier or Ext3.
Back to top
View user's profile Send private message
Deranger
Veteran
Veteran


Joined: 26 Aug 2004
Posts: 1215

PostPosted: Mon Oct 04, 2004 5:50 am    Post subject: Reply with quote

I've gone insane, I'm moving all my ext-3 partitions to Reiser4! (almost one terabyte)

Reiser4 really pwnz j00! :mrgreen:

And it's stable enough.
Back to top
View user's profile Send private message
moocha
Watchman
Watchman


Joined: 21 Oct 2003
Posts: 5722

PostPosted: Mon Oct 04, 2004 9:39 am    Post subject: Reply with quote

For large files go with the original XFS patchset from SGI on a 2.4.20 kernel (make sure to patch for the evil ptrace & co vulnerabilities). There's no question about it. I've got years of experience in large scale system administration behind me and have yet to see data loss due to XFS (and not due to careless rm and the like).
Get the necessary patches from http://oss.sgi.com/projects/xfs/patchlist.html
_________________
Military Commissions Act of 2006: http://tinyurl.com/jrcto

"Those who would give up essential liberty to purchase a little temporary safety deserve neither liberty nor safety."
-- attributed to Benjamin Franklin
Back to top
View user's profile Send private message
Display posts from previous:   
Reply to topic    Gentoo Forums Forum Index Other Things Gentoo All times are GMT
Page 1 of 1

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum